-- Logs begin at Thu 2022-06-23 12:14:02 UTC, end at Thu 2022-06-23 13:27:51 UTC. -- Jun 23 12:50:20.499298 dv-cinder-847335-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 12:50:20.509160 dv-cinder-847335-1-smb devstack@keystone.service[80287]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 12:50:20 2022] *** Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: nodename: dv-cinder-847335-1-smb Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: machine: x86_64 Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: clock source: unix Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: pcre jit disabled Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: detected number of CPU cores: 4 Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: current working directory: / Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: detected binary path: /usr/bin/uwsgi-core Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: your processes number limit is 47680 Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: your memory page size is 4096 bytes Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: detected max file descriptor number: 2048 Jun 23 12:50:20.512282 dv-cinder-847335-1-smb devstack@keystone.service[80287]: lock engine: pthread robust mutexes Jun 23 12:50:20.518577 dv-cinder-847335-1-smb devstack@keystone.service[80287]: thunder lock: enabled Jun 23 12:50:20.518577 dv-cinder-847335-1-smb devstack@keystone.service[80287]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 12:50:20.518577 dv-cinder-847335-1-smb devstack@keystone.service[80287]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 12:50:20.556965 dv-cinder-847335-1-smb devstack@keystone.service[80287]: Python main interpreter initialized at 0x55a8823809c0 Jun 23 12:50:20.556965 dv-cinder-847335-1-smb devstack@keystone.service[80287]: python threads support enabled Jun 23 12:50:20.556965 dv-cinder-847335-1-smb devstack@keystone.service[80287]: your server socket listen backlog is limited to 100 connections Jun 23 12:50:20.556965 dv-cinder-847335-1-smb devstack@keystone.service[80287]: your mercy for graceful operations on workers is 90 seconds Jun 23 12:50:20.557298 dv-cinder-847335-1-smb devstack@keystone.service[80287]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 12:50:20.557397 dv-cinder-847335-1-smb devstack@keystone.service[80287]: *** Operational MODE: preforking *** Jun 23 12:50:20.557674 dv-cinder-847335-1-smb devstack@keystone.service[80287]: *** uWSGI is running in multiple interpreter mode *** Jun 23 12:50:20.557674 dv-cinder-847335-1-smb devstack@keystone.service[80287]: spawned uWSGI master process (pid: 80287) Jun 23 12:50:20.557880 dv-cinder-847335-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 23 12:50:20.558427 dv-cinder-847335-1-smb devstack@keystone.service[80287]: spawned uWSGI worker 1 (pid: 80298, cores: 1) Jun 23 12:50:20.558760 dv-cinder-847335-1-smb devstack@keystone.service[80287]: spawned uWSGI worker 2 (pid: 80299, cores: 1) Jun 23 12:50:20.559971 dv-cinder-847335-1-smb devstack@keystone.service[80287]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 12:50:26.091425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 12:50:26.091425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: from cryptography.utils import int_from_bytes Jun 23 12:50:26.092221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 12:50:26.092221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: from cryptography.utils import int_from_bytes Jun 23 12:50:26.092662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 12:50:26.092662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: from cryptography.utils import int_from_bytes Jun 23 12:50:26.092793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 12:50:26.092793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: from cryptography.utils import int_from_bytes Jun 23 12:50:26.141849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 12:50:26.141998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 12:50:26.142092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 12:50:26.142170 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] command line args: [] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 12:50:26.142230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 12:50:26.142403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] command line args: [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 12:50:26.142505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 12:50:26.142578 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ================================================================================ {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 12:50:26.142654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 12:50:26.142829 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ================================================================================ {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 12:50:26.142914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] admin_token = **** {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.143073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] config_dir = [] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.143159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] admin_token = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.143263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.143348 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] config_dir = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.143448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] config_source = [] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.143532 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.143630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] debug = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.143717 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] config_source = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.143829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.144137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] debug = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.144137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.144370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.144473 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.144570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.144672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.144780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.144919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.145030 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.145128 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.145230 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] list_limit = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.145333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.145435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] log_config_append = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.145531 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_config_append = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.145636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.145744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.145905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] log_dir = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.146504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_dir = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.146604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] log_file = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.146711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_file = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.146818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.146885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.146955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.147074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.147147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.147203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.147338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.147417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.147537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.147621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.147699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.147828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.147905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.148029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.148104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.148220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.148300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.148379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.148501 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.148582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.148715 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.148793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.148989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.149090 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.149239 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.149321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.149488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.149571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.149764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.149850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.150257 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.150339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.150507 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] publish_errors = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.150584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] publish_errors = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.150707 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.150788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.150887 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.150973 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.151091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.151170 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.151299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.151394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.151537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.151664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.151774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] standard_threads = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.151857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] standard_threads = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.152006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.152093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.152251 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.152336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.152429 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.152505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.152605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] use_journal = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.152691 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] use_journal = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.152769 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] use_json = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.152869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] use_json = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.152952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] use_stderr = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.153024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] use_stderr = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.153135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] use_syslog = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.153287 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] use_syslog = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.153361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.153434 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 12:50:26.153610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.153688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.153849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.153939 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.154110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.154186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.154347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.154429 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.154597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.154681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.154836 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.154912 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.155085 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.155167 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.155323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.155407 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.155572 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.155653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.155821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.155896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.156092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.156187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.156303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.156383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.156548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.156623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.156787 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.156895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.157057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.157135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.157308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.157386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.157543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.157625 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.157798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.157875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.158051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.158134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.158296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.158372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.158533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.158609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.158785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.158861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.159047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.159135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.159300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.159382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.159551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.159627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.159782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.159859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.160014 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.160088 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.160245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.160321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.160482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.160558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.160730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.160833 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.161007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.161085 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.161241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.161317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.162105 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.162678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.162678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.162806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.162886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.162958 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.163027 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.163102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.163178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.163248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.163327 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.163398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.163466 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.163617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.163733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.163858 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.163946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.164093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.164178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.164327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.164402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.164564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.164639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.164818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.164890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.165067 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.165134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.165298 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.165445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.165591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.165718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.165802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.165929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.166011 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.166084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.166209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.166327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.166444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.166530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.166677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.166753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.166917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.167068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.167191 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.167265 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.167381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.167457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.167603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.167686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.167839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.167959 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.168073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.168161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.168328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.168419 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.168552 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.168635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.168788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.168943 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.169045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.169129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.169278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.169365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.169534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.169613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.169771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.169850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.170003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.170084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.170241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.170319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.170480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.170558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.170741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.170818 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.170981 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.171058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.171233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.171312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.171473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.171551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.171709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.171787 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.171945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.172029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.172181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.172259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.172424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.172500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.172662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.172752 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.172927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.173010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.173165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.173253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.173402 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.173488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.173640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.173718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.173877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.173954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.174112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.174197 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.174348 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.174425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.174604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.174680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.174847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.174932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.175087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.175166 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.175325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.175403 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.175561 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.175646 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.175798 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.175875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.176032 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.176109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.176267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.176357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.176498 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.176581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.176728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.176823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.176984 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.177764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.177859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.177960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.178033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.178338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.178470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.178608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.178737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.178870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.178997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.179122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.179248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.179385 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.179513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.179639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.179775 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.179901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] auth.external = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.179981 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.180050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.180111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.180199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.180391 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.external = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.180514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.180665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.180818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] auth.password = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.180956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.181100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] auth.token = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.181232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.181376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.181506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.password = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.181637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.181762 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] auth.token = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.181895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.182023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.182150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.182282 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.182408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.182541 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.182674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.182803 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.182930 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.183057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.183199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] credential.caching = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.183330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.183463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.183591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.183718 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.183890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.184013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.184142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.184279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.184405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.184532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.184668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.184863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.185001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.185138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.185271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.185405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.185532 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.185658 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.185786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.185919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.186046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.186172 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.186297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.186425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.186552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.186751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.186892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.187018 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.187144 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.187271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.187406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.187532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] federation.caching = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.187659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.187786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.187918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.188043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.188178 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.188305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.188432 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.188558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.188694 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.188837 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.188972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.189098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.189223 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.189347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.189473 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.189600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.189734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.189860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.189993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.190121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.190251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.190386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.190520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.190653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.caching = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.190785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.190912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.191037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.191164 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.191296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.191422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.191547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.191672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.191797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.191925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.192069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.192195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.192320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.192445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.192579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.192747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.192875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.192993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.193135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.193200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.193453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.193591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.193728 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.193854 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.193991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.194120 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.194246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.194374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.194508 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.194634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.194761 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.194885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.195012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.195139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.195274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.195401 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.195527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.195663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.195791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.195917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.195917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.196166 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.196293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.196419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.196545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.196680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.196856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.196992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.197119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.197248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.197374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.197517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.197517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.197757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.197757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.197994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.197994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.198240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.198368 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.198495 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.198619 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.198744 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.198869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.199006 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.199133 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.199271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.199271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.199511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.199636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.199769 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.199895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.200027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.200152 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.200278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.200410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.200545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.200671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.200797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.200945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.201073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.201199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.201340 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.201475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.201604 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.201604 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.201844 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.201971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.202105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.202105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.202352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.202480 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.202612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.202612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.202863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.202991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.203117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.203117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.203356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.203484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.203620 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.203747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.203874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.204001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.204128 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.204254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.204389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.204530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.204659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.204659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.204939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.204939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205708 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205926 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.205999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206070 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206141 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206559 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.206976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207407 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207707 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.207987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.208066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.208066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.208195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.208195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.208352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.208429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.208697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.208831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.208938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209227 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209889 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.209959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] resource.caching = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.210085 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.210177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.210322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.210402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.210561 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.210640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.210813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.210901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.211069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.211149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.211322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.211401 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.211561 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.211648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.211802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.211880 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.212045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.212124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.212282 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.212367 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] role.caching = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.212530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] role.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.212608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.212765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.212866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.213041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.213134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.213279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] role.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.213357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.213532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.213609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] role.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.213764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.213853 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.214015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.214095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.214261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.214338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.214510 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.214598 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.214760 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.214839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.214993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.215071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.215244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.215330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.215491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.215570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.215737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.215814 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.215969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.216055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.216222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.216367 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.216474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.216607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.216725 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.216864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.217002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.217118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.217369 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.217446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.217620 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.217702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.217855 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.217935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.218111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.218191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.218364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.218444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.218605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.218685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.218839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.218924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.219072 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.219151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.219307 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.219386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.219560 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.219640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.219793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.219873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.220029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.220108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.220265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.220344 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.220505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.220589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.220738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.220841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.220999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] token.caching = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.221079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.221242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.221324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.221489 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.221567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.221722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.221801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.221961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.222041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.222200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.222280 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.222441 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.222521 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.222680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.222760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.222921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.222999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.223177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.223254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.223417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.223497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.223658 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.223737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.223897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.224701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.224844 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.224917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.224977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.225035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.225158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.225238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.225404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.225486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.225692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.225770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.225947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.226026 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.connection = **** {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.226182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.226274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.226430 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.226510 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.226667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.226746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.226911 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.226999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.connection = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.227150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.227242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.227389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.227469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.227628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.227707 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.227865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.228016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.228119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.228200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.228356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.228435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.228596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.228684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.228853 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.228935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.229106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.229185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.229346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.229436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.229588 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.229667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.229821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.229900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.230061 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.230148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.230296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.230374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.230464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80298) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 12:50:26.230542 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.230780 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.231002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.231240 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 12:50:26.231410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80299) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 12:50:26.261394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.261622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.261850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.261935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.262152 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.262389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.270673 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.271708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.299258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.299435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.299520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.299670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.441591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.441769 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.490757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.490987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.491291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.491528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.555295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.555524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.555748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.555837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.555968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.556073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.556187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.556273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.556406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.556489 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.556698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.556945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.581143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.581374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.581485 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.581585 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.581724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.581808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.581953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.582037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.582178 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.582274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.582398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.582483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.582616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.582834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.596421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.597051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.609930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.610163 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.610393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.610494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.610617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.610700 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.610833 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.610916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.611047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.611138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.611259 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80299) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.611342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.611471 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.611687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80298) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 12:50:26.631491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.631704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 12:50:26.631880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.632047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.632134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 12:50:26.632255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 12:50:26.632414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.632526 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.632608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 12:50:26.632789 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.632897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.633073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.633157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.633333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.633415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.633636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.644481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.644721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.644828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.645027 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.645111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.645298 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.645392 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.645582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.654156 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.654713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.657490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.657769 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.658052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.658133 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.658335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.658417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.658620 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.658703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.658882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.658964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.659152 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.659232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.659412 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.659493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.659682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.659762 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.659952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.660041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.660219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.660299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.660492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.660759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.686927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.687365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.688569 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.688872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.689024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.689303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.694768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.695122 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.695209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.695411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.695531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.695829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.702794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.703080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.703221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.703503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.707658 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.707950 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.708089 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.708235 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.708431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.708564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.708717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.708949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.709033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.709235 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.709316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.709526 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.709609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.709797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.709878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.710080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.729231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.729359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.729509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.729634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.734128 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.734242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.737786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.737919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.738193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.738316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.743391 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.743490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.747020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.747105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.750713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.750798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.751017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.751100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.751305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.751388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.751588 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.751680 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.751865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.751950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.752142 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.752232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.774941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.775231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.775504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.775779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.778136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.778431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.778704 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.778981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.783777 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.785522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.785811 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.789194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.789479 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.789764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.790046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.790355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.792361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.795174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.795587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.798867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.799149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.799433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.799716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.800017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.803742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.804018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.804310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.804593 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.806276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.806573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.806866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.813377 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.813659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.813951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.814233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.815917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.816210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.816507 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.825472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.828764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.832076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.834536 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.835563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.836203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.836484 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.836770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.838902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.842241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.843971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.844157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.845652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.845797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.845935 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.846227 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.849239 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.849787 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.849895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.850136 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.853594 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.855212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.858486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.858779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.859168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.859696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.859820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.859927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.859927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.867724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80299) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.868006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.868286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.868560 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.868643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.868857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.869009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.869145 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.869226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.869525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.869799 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.870083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.870365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.870640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.870906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.871181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.871455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80299) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.877014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80298) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 12:50:26.877292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.877573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.877845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.878114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.878485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.878782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.879063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.879348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.879622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.879897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.880697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.881176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.881316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80298) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 12:50:26.910573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a8823809c0 pid: 80299 (default app) Jun 23 12:50:26.914119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac30ec-13ef-4b87-8466-1a428172e0c3 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:26.914415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac30ec-13ef-4b87-8466-1a428172e0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:26.914698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac30ec-13ef-4b87-8466-1a428172e0c3 None None] PATH_INFO: `/v3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:26.918963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Thu Jun 23 12:50:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:26.920209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a8823809c0 pid: 80298 (default app) Jun 23 12:50:35.576266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa764bcf-c767-4629-ab3f-5ab0699f3414 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:35.576890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa764bcf-c767-4629-ab3f-5ab0699f3414 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:35.576890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa764bcf-c767-4629-ab3f-5ab0699f3414 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:35.578188 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:50:35.586062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b389ee9-cd62-4fe1-9124-90b7a969b0c8 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:35.586470 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b389ee9-cd62-4fe1-9124-90b7a969b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:35.586630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b389ee9-cd62-4fe1-9124-90b7a969b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:35.655773 dv-cinder-847335-1-smb devstack@keystone.service[80298]: INFO dbcounter [None req-9b389ee9-cd62-4fe1-9124-90b7a969b0c8 None None] Registered counter for database keystone Jun 23 12:50:35.677802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG oslo_db.sqlalchemy.engines [None req-9b389ee9-cd62-4fe1-9124-90b7a969b0c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80298) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 12:50:35.683905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writer thread running {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 12:50:35.863336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG passlib.handlers.bcrypt [None req-9b389ee9-cd62-4fe1-9124-90b7a969b0c8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80298) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 12:50:35.863676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG passlib.handlers.bcrypt [None req-9b389ee9-cd62-4fe1-9124-90b7a969b0c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80298) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 12:50:35.919508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-9b389ee9-cd62-4fe1-9124-90b7a969b0c8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:35.921122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9b389ee9-cd62-4fe1-9124-90b7a969b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:36.042705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1/3] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 12:50:36.226642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa764bcf-c767-4629-ab3f-5ab0699f3414 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:36.297484 dv-cinder-847335-1-smb devstack@keystone.service[80299]: INFO dbcounter [None req-fa764bcf-c767-4629-ab3f-5ab0699f3414 None None] Registered counter for database keystone Jun 23 12:50:36.317969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG oslo_db.sqlalchemy.engines [None req-fa764bcf-c767-4629-ab3f-5ab0699f3414 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80299) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 12:50:36.324113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writer thread running {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 12:50:36.449025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa764bcf-c767-4629-ab3f-5ab0699f3414 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:36.453377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b968c-0cd1-4376-8bc6-b277130d57d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:36.454044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b968c-0cd1-4376-8bc6-b277130d57d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:36.454331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b968c-0cd1-4376-8bc6-b277130d57d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:36.454611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b968c-0cd1-4376-8bc6-b277130d57d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:36.462833 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b968c-0cd1-4376-8bc6-b277130d57d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:36.515355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d76b968c-0cd1-4376-8bc6-b277130d57d4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 12:50:36.515632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b968c-0cd1-4376-8bc6-b277130d57d4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:36.526078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 3/4] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Jun 23 12:50:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 12:50:36.532005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b389ee9-cd62-4fe1-9124-90b7a969b0c8 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:36.547108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b389ee9-cd62-4fe1-9124-90b7a969b0c8 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:36.552294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e313b-d886-496e-9578-08673faf3d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:36.553405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e313b-d886-496e-9578-08673faf3d6b admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:36.553691 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e313b-d886-496e-9578-08673faf3d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:36.553964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e313b-d886-496e-9578-08673faf3d6b admin admin] PATH_INFO: `/v3/projects/1fdf0ec9cffa45efa95f679088c42ed8` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:36.557966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e313b-d886-496e-9578-08673faf3d6b admin admin] RBAC: Authorizing `identity:get_project(project_id=1fdf0ec9cffa45efa95f679088c42ed8)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:36.608509 dv-cinder-847335-1-smb devstack@keystone.service[80298]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7c9e313b-d886-496e-9578-08673faf3d6b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 12:50:36.609105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e313b-d886-496e-9578-08673faf3d6b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:36.613370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 2/5] 10.222.0.16 () {56 vars in 1207 bytes} [Thu Jun 23 12:50:36 2022] GET /identity/v3/projects/1fdf0ec9cffa45efa95f679088c42ed8 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:50:38.609727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1983e3-ca3f-4552-b376-99e670c8d001 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:38.610238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1983e3-ca3f-4552-b376-99e670c8d001 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:38.610347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1983e3-ca3f-4552-b376-99e670c8d001 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:38.614470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 4/6] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:38.619845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ed05c-f767-4cbe-9f5c-82f9e5ebd562 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:38.620302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ed05c-f767-4cbe-9f5c-82f9e5ebd562 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:38.620395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ed05c-f767-4cbe-9f5c-82f9e5ebd562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:38.640300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-4f1ed05c-f767-4cbe-9f5c-82f9e5ebd562 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:38.642119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4f1ed05c-f767-4cbe-9f5c-82f9e5ebd562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:38.650848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 3/7] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 12:50:38.673497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1983e3-ca3f-4552-b376-99e670c8d001 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:38.685987 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1983e3-ca3f-4552-b376-99e670c8d001 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:38.690476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8a7a3-f141-4822-982d-da53ca0bd42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:38.691113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8a7a3-f141-4822-982d-da53ca0bd42b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:38.691397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8a7a3-f141-4822-982d-da53ca0bd42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:38.691676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8a7a3-f141-4822-982d-da53ca0bd42b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:38.700323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8a7a3-f141-4822-982d-da53ca0bd42b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:38.702139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8a7a3-f141-4822-982d-da53ca0bd42b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:38.711634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1324 bytes} [Thu Jun 23 12:50:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 12:50:38.717263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ed05c-f767-4cbe-9f5c-82f9e5ebd562 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:38.726792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ed05c-f767-4cbe-9f5c-82f9e5ebd562 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:38.731143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98e794-9d1d-4741-a9d3-1a7a1a84c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:38.732001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e794-9d1d-4741-a9d3-1a7a1a84c65c admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:38.732283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e794-9d1d-4741-a9d3-1a7a1a84c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:38.732560 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e794-9d1d-4741-a9d3-1a7a1a84c65c admin admin] PATH_INFO: `/v3/users/9a24de1c35d841e4a22851782428ca15` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:38.733974 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98e794-9d1d-4741-a9d3-1a7a1a84c65c admin admin] RBAC: Authorizing `identity:get_user(user_id=9a24de1c35d841e4a22851782428ca15)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:38.735788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98e794-9d1d-4741-a9d3-1a7a1a84c65c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:38.737370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 4/9] 10.222.0.16 () {56 vars in 1198 bytes} [Thu Jun 23 12:50:38 2022] GET /identity/v3/users/9a24de1c35d841e4a22851782428ca15 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:40.825851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363a747-93d3-471b-91f3-c094dbc4c687 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:40.826384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363a747-93d3-471b-91f3-c094dbc4c687 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:40.826475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363a747-93d3-471b-91f3-c094dbc4c687 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:40.827761 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:40.833542 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ac36d-8514-490f-9775-46d8504c5204 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:40.833971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ac36d-8514-490f-9775-46d8504c5204 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:40.834087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ac36d-8514-490f-9775-46d8504c5204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:40.849116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d9a1a-3b13-44b2-8ccd-7730bcc0e12c None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:40.849408 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d9a1a-3b13-44b2-8ccd-7730bcc0e12c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:40.849697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d9a1a-3b13-44b2-8ccd-7730bcc0e12c None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:40.851025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 7/11] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:50:40.851140 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-105ac36d-8514-490f-9775-46d8504c5204 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:40.852308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-105ac36d-8514-490f-9775-46d8504c5204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:40.856111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6eeba-6f60-40e3-b7a7-873076af82e9 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:40.856397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6eeba-6f60-40e3-b7a7-873076af82e9 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:40.856673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6eeba-6f60-40e3-b7a7-873076af82e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:40.897795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG passlib.handlers.bcrypt [None req-fac6eeba-6f60-40e3-b7a7-873076af82e9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80299) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 12:50:40.898232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG passlib.handlers.bcrypt [None req-fac6eeba-6f60-40e3-b7a7-873076af82e9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80299) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 12:50:40.936784 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 5/12] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:40.943804 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fac6eeba-6f60-40e3-b7a7-873076af82e9 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:40.945524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fac6eeba-6f60-40e3-b7a7-873076af82e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:40.960881 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ac36d-8514-490f-9775-46d8504c5204 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:40.984117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:41.047270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 8/13] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:41.065078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ac36d-8514-490f-9775-46d8504c5204 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:41.070406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6eeba-6f60-40e3-b7a7-873076af82e9 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:41.100551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341fa36-ca4e-4272-910c-69c84013b411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:41.101321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341fa36-ca4e-4272-910c-69c84013b411 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:41.101607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341fa36-ca4e-4272-910c-69c84013b411 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:41.101886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341fa36-ca4e-4272-910c-69c84013b411 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:41.113443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341fa36-ca4e-4272-910c-69c84013b411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-c341fa36-ca4e-4272-910c-69c84013b411 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:50:41.125158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:50:41.126223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:50:41.127040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 6/14] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:50:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:50:41.132266 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341fa36-ca4e-4272-910c-69c84013b411 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:41.170904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6eeba-6f60-40e3-b7a7-873076af82e9 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:41.173504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:41.207667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77a3bc-11df-4796-820f-53613ca2a12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:41.208557 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a3bc-11df-4796-820f-53613ca2a12c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:41.208864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a3bc-11df-4796-820f-53613ca2a12c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:41.209144 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77a3bc-11df-4796-820f-53613ca2a12c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:41.215440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:41.233976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341fa36-ca4e-4272-910c-69c84013b411 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:41.269316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba1957-d4dc-4838-9f79-0b1755487c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:41.270714 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba1957-d4dc-4838-9f79-0b1755487c5e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:41.271085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba1957-d4dc-4838-9f79-0b1755487c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:41.271369 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba1957-d4dc-4838-9f79-0b1755487c5e None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:41.272130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba1957-d4dc-4838-9f79-0b1755487c5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:41.272443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba1957-d4dc-4838-9f79-0b1755487c5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:41.273872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba1957-d4dc-4838-9f79-0b1755487c5e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:41.278870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77a3bc-11df-4796-820f-53613ca2a12c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:41.280419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77a3bc-11df-4796-820f-53613ca2a12c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:41.286020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 7/15] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:50:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:50:41.291475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba1957-d4dc-4838-9f79-0b1755487c5e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:41.379478 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 9/16] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:50:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 12:50:41.385258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77a3bc-11df-4796-820f-53613ca2a12c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:41.387908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:41.392110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba1957-d4dc-4838-9f79-0b1755487c5e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:41.426195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daedd2f-b1b0-4cf9-b75d-66048bf93672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:41.427069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daedd2f-b1b0-4cf9-b75d-66048bf93672 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:41.427361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daedd2f-b1b0-4cf9-b75d-66048bf93672 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:41.427637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daedd2f-b1b0-4cf9-b75d-66048bf93672 None admin] PATH_INFO: `/v3/users/9a24de1c35d841e4a22851782428ca15` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:41.428871 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daedd2f-b1b0-4cf9-b75d-66048bf93672 None admin] RBAC: Authorizing `identity:get_user(user_id=9a24de1c35d841e4a22851782428ca15)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:41.430352 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daedd2f-b1b0-4cf9-b75d-66048bf93672 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:41.431968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 8/17] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:50:41 2022] GET /identity/v3/users/9a24de1c35d841e4a22851782428ca15 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:41.437244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daedd2f-b1b0-4cf9-b75d-66048bf93672 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:41.451733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:41.484198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77a3bc-11df-4796-820f-53613ca2a12c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:41.519212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c15c96-890c-4695-9527-dec4ee043df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:41.520618 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15c96-890c-4695-9527-dec4ee043df4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:41.520942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15c96-890c-4695-9527-dec4ee043df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:41.521224 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15c96-890c-4695-9527-dec4ee043df4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:41.537060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daedd2f-b1b0-4cf9-b75d-66048bf93672 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:41.541773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c15c96-890c-4695-9527-dec4ee043df4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:41.543261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c15c96-890c-4695-9527-dec4ee043df4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-27c15c96-890c-4695-9527-dec4ee043df4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:50:41.563552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:50:41.564357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:50:41.565346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:50:41.565346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:50:41.565346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:50:41.565346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:50:41.565346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:50:41.570531 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c15c96-890c-4695-9527-dec4ee043df4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:41.571012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cb361-883c-4c8b-ac18-753c404d5aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:41.571813 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cb361-883c-4c8b-ac18-753c404d5aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:41.572102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cb361-883c-4c8b-ac18-753c404d5aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:41.572381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cb361-883c-4c8b-ac18-753c404d5aa0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:41.573679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cb361-883c-4c8b-ac18-753c404d5aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:41.575152 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cb361-883c-4c8b-ac18-753c404d5aa0 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:41.576758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:50:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:50:41.582817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cb361-883c-4c8b-ac18-753c404d5aa0 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:41.628834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:41.664143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:41.672104 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c15c96-890c-4695-9527-dec4ee043df4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:41.683460 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cb361-883c-4c8b-ac18-753c404d5aa0 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:41.706181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6af777-25b7-4944-b771-f1a3c234499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:41.706848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6af777-25b7-4944-b771-f1a3c234499f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:41.707136 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6af777-25b7-4944-b771-f1a3c234499f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:41.707795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6af777-25b7-4944-b771-f1a3c234499f None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:41.708146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6af777-25b7-4944-b771-f1a3c234499f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:41.708446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6af777-25b7-4944-b771-f1a3c234499f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:41.709875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6af777-25b7-4944-b771-f1a3c234499f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:41.718457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e651a77-0cf9-4aef-9477-b45bd6085b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:41.719111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e651a77-0cf9-4aef-9477-b45bd6085b76 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:41.719396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e651a77-0cf9-4aef-9477-b45bd6085b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:41.719675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e651a77-0cf9-4aef-9477-b45bd6085b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:41.720516 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e651a77-0cf9-4aef-9477-b45bd6085b76 None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.domain.id=default, user.id=9a24de1c35d841e4a22851782428ca15) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:41.720874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e651a77-0cf9-4aef-9477-b45bd6085b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:41.722333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e651a77-0cf9-4aef-9477-b45bd6085b76 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:41.728276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:50:41.730641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Jun 23 12:50:41 2022] GET /identity/v3/role_assignments?user.id=9a24de1c35d841e4a22851782428ca15&scope.domain.id=default&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:44.147420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b8612-f67c-4127-9911-bbc5c196a820 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:44.147890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b8612-f67c-4127-9911-bbc5c196a820 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:44.147890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b8612-f67c-4127-9911-bbc5c196a820 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:44.149310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:44.154884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c31a31-89b8-4c8a-b1e3-54b8345fb227 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:44.155705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c31a31-89b8-4c8a-b1e3-54b8345fb227 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:44.156192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c31a31-89b8-4c8a-b1e3-54b8345fb227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:44.181816 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-90c31a31-89b8-4c8a-b1e3-54b8345fb227 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:44.183378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-90c31a31-89b8-4c8a-b1e3-54b8345fb227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:44.275086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:44.326555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b8612-f67c-4127-9911-bbc5c196a820 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:44.474405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b8612-f67c-4127-9911-bbc5c196a820 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:44.498938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:44.518716 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f751da5-e09a-4022-ad32-4a2d452fde86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:44.520050 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f751da5-e09a-4022-ad32-4a2d452fde86 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:44.520513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f751da5-e09a-4022-ad32-4a2d452fde86 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:44.520900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f751da5-e09a-4022-ad32-4a2d452fde86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:44.537753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f751da5-e09a-4022-ad32-4a2d452fde86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-2f751da5-e09a-4022-ad32-4a2d452fde86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:50:44.547113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:50:44.547938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:50:44.548680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:50:44.548680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:50:44.548680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:50:44.548680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:50:44.548680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:50:44.548680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:50:44.548680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:50:44.548680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:50:44.548680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:50:44.548680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:50:44.548680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:50:44.548680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:50:44.551829 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 13/24] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:50:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:50:44.558031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c31a31-89b8-4c8a-b1e3-54b8345fb227 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:44.654016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d336-eafb-4fdc-ac27-dfbda9216f84 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:44.654725 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d336-eafb-4fdc-ac27-dfbda9216f84 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:44.655226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124d336-eafb-4fdc-ac27-dfbda9216f84 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:44.656965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 14/25] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:44.665385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320da7de-21d1-4903-a87d-3a2f5f2d269a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:44.665998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320da7de-21d1-4903-a87d-3a2f5f2d269a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:44.666489 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320da7de-21d1-4903-a87d-3a2f5f2d269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:44.682315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:44.710332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-320da7de-21d1-4903-a87d-3a2f5f2d269a None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:44.712525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-320da7de-21d1-4903-a87d-3a2f5f2d269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:44.740942 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c31a31-89b8-4c8a-b1e3-54b8345fb227 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:44.782566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b568484-33b0-4a5f-8792-5c158d30e10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:44.783241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b568484-33b0-4a5f-8792-5c158d30e10a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:44.783530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b568484-33b0-4a5f-8792-5c158d30e10a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:44.783812 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b568484-33b0-4a5f-8792-5c158d30e10a None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:44.784570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b568484-33b0-4a5f-8792-5c158d30e10a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:44.784908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b568484-33b0-4a5f-8792-5c158d30e10a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:44.787099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b568484-33b0-4a5f-8792-5c158d30e10a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:44.797490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 12/26] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:50:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:44.798758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ca034-7c93-4845-a976-b3134b3e0524 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:44.799050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ca034-7c93-4845-a976-b3134b3e0524 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:44.799339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ca034-7c93-4845-a976-b3134b3e0524 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:44.800654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:44.802564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 15/28] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:50:44.803615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320da7de-21d1-4903-a87d-3a2f5f2d269a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:44.806278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa48a-43b4-433d-a36e-19557f01a56c None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:44.806643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa48a-43b4-433d-a36e-19557f01a56c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:44.807111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4aa48a-43b4-433d-a36e-19557f01a56c None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:44.808659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 14/29] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:44.809875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898e7c1-28ba-456e-ab65-56b545ab53e8 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:44.810306 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898e7c1-28ba-456e-ab65-56b545ab53e8 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:44.810745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898e7c1-28ba-456e-ab65-56b545ab53e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:44.833644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-3898e7c1-28ba-456e-ab65-56b545ab53e8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:44.835281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-3898e7c1-28ba-456e-ab65-56b545ab53e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:44.916139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 15/30] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:44.917845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c0998-cc5f-41cd-a2e0-8dffbf8945e5 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:44.918298 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c0998-cc5f-41cd-a2e0-8dffbf8945e5 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:44.918758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c0998-cc5f-41cd-a2e0-8dffbf8945e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:44.939155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320da7de-21d1-4903-a87d-3a2f5f2d269a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:44.949872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:44.952827 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-941c0998-cc5f-41cd-a2e0-8dffbf8945e5 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:44.954280 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-941c0998-cc5f-41cd-a2e0-8dffbf8945e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:44.983434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f198-930a-4daa-bac3-cb76f15e82a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:44.984719 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f198-930a-4daa-bac3-cb76f15e82a9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:44.985480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f198-930a-4daa-bac3-cb76f15e82a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:44.985906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09f198-930a-4daa-bac3-cb76f15e82a9 None admin] PATH_INFO: `/v3/users/9a24de1c35d841e4a22851782428ca15` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:44.988028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09f198-930a-4daa-bac3-cb76f15e82a9 None admin] RBAC: Authorizing `identity:get_user(user_id=9a24de1c35d841e4a22851782428ca15)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:44.991473 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b09f198-930a-4daa-bac3-cb76f15e82a9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:44.994676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 16/31] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:50:44 2022] GET /identity/v3/users/9a24de1c35d841e4a22851782428ca15 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:44.997408 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f198-930a-4daa-bac3-cb76f15e82a9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:45.030874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:45.040414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 16/32] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:45.041553 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c0998-cc5f-41cd-a2e0-8dffbf8945e5 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:45.146735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b09f198-930a-4daa-bac3-cb76f15e82a9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:45.150984 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c0998-cc5f-41cd-a2e0-8dffbf8945e5 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:45.183297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a217cf6-492d-41b8-a071-b0076e389a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:45.184652 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a217cf6-492d-41b8-a071-b0076e389a04 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:45.185119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a217cf6-492d-41b8-a071-b0076e389a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:45.185536 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a217cf6-492d-41b8-a071-b0076e389a04 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:45.186530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a217cf6-492d-41b8-a071-b0076e389a04 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:45.188427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a217cf6-492d-41b8-a071-b0076e389a04 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:45.189959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f049d-5116-4c3d-b616-19f10f957838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:45.191213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f049d-5116-4c3d-b616-19f10f957838 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:45.192077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f049d-5116-4c3d-b616-19f10f957838 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:45.192576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f049d-5116-4c3d-b616-19f10f957838 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:45.193564 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f049d-5116-4c3d-b616-19f10f957838 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:45.195926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f049d-5116-4c3d-b616-19f10f957838 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:45.403150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 17/33] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jun 23 12:50:45 2022] POST /identity/v3/roles => generated 225 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:50:45.404498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f049d-5116-4c3d-b616-19f10f957838 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:45.410635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 17/34] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jun 23 12:50:44 2022] POST /identity/v3/roles => generated 219 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:50:45.413535 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a217cf6-492d-41b8-a071-b0076e389a04 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:45.482662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:45.484692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:45.546749 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f049d-5116-4c3d-b616-19f10f957838 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:45.594512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b408d-2afe-4f2b-8e88-23ce04f52b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:45.595783 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b408d-2afe-4f2b-8e88-23ce04f52b23 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:45.596443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b408d-2afe-4f2b-8e88-23ce04f52b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:45.596956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b408d-2afe-4f2b-8e88-23ce04f52b23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:45.599116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b408d-2afe-4f2b-8e88-23ce04f52b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:45.601795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b408d-2afe-4f2b-8e88-23ce04f52b23 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:45.604374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 18/35] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:50:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:45.606373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0bce7-d436-444f-961e-d118ea345037 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:45.606851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0bce7-d436-444f-961e-d118ea345037 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:45.607278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0bce7-d436-444f-961e-d118ea345037 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:45.609569 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:45.610502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0bce7-d436-444f-961e-d118ea345037 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:45.655875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a217cf6-492d-41b8-a071-b0076e389a04 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:45.715206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde1a58-2b8f-4707-a361-ced4bb6190d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:45.716650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde1a58-2b8f-4707-a361-ced4bb6190d1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:45.717284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde1a58-2b8f-4707-a361-ced4bb6190d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:45.717786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde1a58-2b8f-4707-a361-ced4bb6190d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:45.735438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde1a58-2b8f-4707-a361-ced4bb6190d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:45.737116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde1a58-2b8f-4707-a361-ced4bb6190d1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-7bde1a58-2b8f-4707-a361-ced4bb6190d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:50:45.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:50:45.760516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:50:45.762431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:50:45.762431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:50:45.762431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:50:45.762431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:50:45.762431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 18/37] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:50:45.762431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a5e1e-599c-4a6f-8be1-841258fd39b5 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:45.762963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a5e1e-599c-4a6f-8be1-841258fd39b5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:45.762963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a5e1e-599c-4a6f-8be1-841258fd39b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:45.782994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1a7a5e1e-599c-4a6f-8be1-841258fd39b5 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:45.784525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1a7a5e1e-599c-4a6f-8be1-841258fd39b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:45.853156 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 19/38] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:45.854647 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e5c78-7898-4b3d-ba93-8059762e7dd5 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:45.854945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e5c78-7898-4b3d-ba93-8059762e7dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:45.855224 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e5c78-7898-4b3d-ba93-8059762e7dd5 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:45.860431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 20/39] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:45.860579 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0bce7-d436-444f-961e-d118ea345037 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:45.860672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e5c78-7898-4b3d-ba93-8059762e7dd5 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:45.883051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:45.890217 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:45.901197 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c877a5-ed37-4ff4-8835-64ccc26490f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:45.902070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c877a5-ed37-4ff4-8835-64ccc26490f9 None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:45.902356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c877a5-ed37-4ff4-8835-64ccc26490f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:45.902634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c877a5-ed37-4ff4-8835-64ccc26490f9 None admin] PATH_INFO: `/v3/domains/default/users/9a24de1c35d841e4a22851782428ca15/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:45.904778 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c877a5-ed37-4ff4-8835-64ccc26490f9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9a24de1c35d841e4a22851782428ca15, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:45.906310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c877a5-ed37-4ff4-8835-64ccc26490f9 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:45.967363 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e5c78-7898-4b3d-ba93-8059762e7dd5 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:45.997004 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 20/40] 10.222.0.16 () {58 vars in 1361 bytes} [Thu Jun 23 12:50:45 2022] PUT /identity/v3/domains/default/users/9a24de1c35d841e4a22851782428ca15/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:50:45.998390 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf05b-d57f-45bb-b0fd-a686bcd678ce None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:45.998679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf05b-d57f-45bb-b0fd-a686bcd678ce None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:45.998959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cf05b-d57f-45bb-b0fd-a686bcd678ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:46.010338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a341a-ccea-45c5-9cef-324c58c51a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:46.011047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a341a-ccea-45c5-9cef-324c58c51a13 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:46.011338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a341a-ccea-45c5-9cef-324c58c51a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:46.012158 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a341a-ccea-45c5-9cef-324c58c51a13 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:46.012388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a341a-ccea-45c5-9cef-324c58c51a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:46.012710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a341a-ccea-45c5-9cef-324c58c51a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:46.014227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a341a-ccea-45c5-9cef-324c58c51a13 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:46.019087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-f74cf05b-d57f-45bb-b0fd-a686bcd678ce None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:46.021648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f74cf05b-d57f-45bb-b0fd-a686bcd678ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:46.034103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 21/41] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:46.034103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a341a-ccea-45c5-9cef-324c58c51a13 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:46.102991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 21/42] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:46.103832 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cf05b-d57f-45bb-b0fd-a686bcd678ce None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:46.138120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:46.171031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a341a-ccea-45c5-9cef-324c58c51a13 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:46.206217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5878f9-5fd6-4925-ba45-bbd5de8519ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:46.206932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5878f9-5fd6-4925-ba45-bbd5de8519ab None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:46.207525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5878f9-5fd6-4925-ba45-bbd5de8519ab None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:46.207525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5878f9-5fd6-4925-ba45-bbd5de8519ab None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:46.208296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5878f9-5fd6-4925-ba45-bbd5de8519ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:46.209718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5878f9-5fd6-4925-ba45-bbd5de8519ab None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:46.224911 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cf05b-d57f-45bb-b0fd-a686bcd678ce None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:46.240086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:46.259941 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdba6b-42c2-48e4-8e8f-9f0b018f6e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:46.260616 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdba6b-42c2-48e4-8e8f-9f0b018f6e80 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:46.260939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdba6b-42c2-48e4-8e8f-9f0b018f6e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:46.261223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdba6b-42c2-48e4-8e8f-9f0b018f6e80 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:46.261936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdba6b-42c2-48e4-8e8f-9f0b018f6e80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:46.263422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdba6b-42c2-48e4-8e8f-9f0b018f6e80 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:46.273461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 22/43] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jun 23 12:50:46 2022] POST /identity/v3/roles => generated 223 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:50:46.274477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5878f9-5fd6-4925-ba45-bbd5de8519ab None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:46.357452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 22/44] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:50:46 2022] POST /identity/v3/projects => generated 301 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:50:46.420054 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5878f9-5fd6-4925-ba45-bbd5de8519ab None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:46.463389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e54244-0f75-46db-86af-74832b1093f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:46.464135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e54244-0f75-46db-86af-74832b1093f4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:46.464428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e54244-0f75-46db-86af-74832b1093f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:46.464714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e54244-0f75-46db-86af-74832b1093f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:46.466026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e54244-0f75-46db-86af-74832b1093f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:46.467698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e54244-0f75-46db-86af-74832b1093f4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:46.469451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 23/45] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:50:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:46.475210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdba6b-42c2-48e4-8e8f-9f0b018f6e80 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:46.599636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdba6b-42c2-48e4-8e8f-9f0b018f6e80 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:46.633706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c456778-dd1e-4dfe-bbc3-b9e14c4c4819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:46.634378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c456778-dd1e-4dfe-bbc3-b9e14c4c4819 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:46.634669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c456778-dd1e-4dfe-bbc3-b9e14c4c4819 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:46.634952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c456778-dd1e-4dfe-bbc3-b9e14c4c4819 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:46.635680 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c456778-dd1e-4dfe-bbc3-b9e14c4c4819 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:46.637189 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c456778-dd1e-4dfe-bbc3-b9e14c4c4819 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:46.706789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 23/46] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:50:46 2022] POST /identity/v3/projects => generated 312 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:50:48.053373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dd944-ea4b-4e25-b100-cf618bad1e64 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:48.053876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dd944-ea4b-4e25-b100-cf618bad1e64 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:48.053956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dd944-ea4b-4e25-b100-cf618bad1e64 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:48.055303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 24/47] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:48.060563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553e308-40ae-44f4-a06b-a2d357aca9ab None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:48.061001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553e308-40ae-44f4-a06b-a2d357aca9ab None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:48.061172 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f553e308-40ae-44f4-a06b-a2d357aca9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:48.078283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-f553e308-40ae-44f4-a06b-a2d357aca9ab None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:48.079485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f553e308-40ae-44f4-a06b-a2d357aca9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:48.093306 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:48.152031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 24/48] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:48.174880 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dd944-ea4b-4e25-b100-cf618bad1e64 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:48.179384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:48.276872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dd944-ea4b-4e25-b100-cf618bad1e64 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:48.310028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae533f-903e-4b95-a2ae-658dc2c20b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:48.310847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae533f-903e-4b95-a2ae-658dc2c20b50 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:48.311135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae533f-903e-4b95-a2ae-658dc2c20b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:48.311417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae533f-903e-4b95-a2ae-658dc2c20b50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:48.322216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae533f-903e-4b95-a2ae-658dc2c20b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-03ae533f-903e-4b95-a2ae-658dc2c20b50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:50:48.329812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:50:48.330633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:50:48.331364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 25/49] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:50:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:50:48.337924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553e308-40ae-44f4-a06b-a2d357aca9ab None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:48.441543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f553e308-40ae-44f4-a06b-a2d357aca9ab None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:48.475393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4063c32-64a0-488d-bef1-0d444fe5ee4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:48.476069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4063c32-64a0-488d-bef1-0d444fe5ee4a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:48.476360 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4063c32-64a0-488d-bef1-0d444fe5ee4a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:48.476643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4063c32-64a0-488d-bef1-0d444fe5ee4a None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:48.477437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4063c32-64a0-488d-bef1-0d444fe5ee4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:48.477754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4063c32-64a0-488d-bef1-0d444fe5ee4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:48.479191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4063c32-64a0-488d-bef1-0d444fe5ee4a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:48.487333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 25/50] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:50:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:48.493657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae533f-903e-4b95-a2ae-658dc2c20b50 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:48.556343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:48.593364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae533f-903e-4b95-a2ae-658dc2c20b50 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:48.626585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97fba0-ac81-4984-9e6b-f84d3c2dde77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:48.627463 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97fba0-ac81-4984-9e6b-f84d3c2dde77 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:48.627748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97fba0-ac81-4984-9e6b-f84d3c2dde77 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:48.628026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97fba0-ac81-4984-9e6b-f84d3c2dde77 None admin] PATH_INFO: `/v3/users/9a24de1c35d841e4a22851782428ca15` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:48.629338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97fba0-ac81-4984-9e6b-f84d3c2dde77 None admin] RBAC: Authorizing `identity:get_user(user_id=9a24de1c35d841e4a22851782428ca15)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:48.630801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a97fba0-ac81-4984-9e6b-f84d3c2dde77 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:48.632437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 26/51] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:50:48 2022] GET /identity/v3/users/9a24de1c35d841e4a22851782428ca15 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:48.637817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4063c32-64a0-488d-bef1-0d444fe5ee4a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:48.650676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:48.743362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4063c32-64a0-488d-bef1-0d444fe5ee4a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:48.751641 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8dde-fc64-406c-91b0-f531db5f2cde None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:48.751930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8dde-fc64-406c-91b0-f531db5f2cde None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:48.752209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab8dde-fc64-406c-91b0-f531db5f2cde None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:48.753660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 27/52] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:48.758583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb48b7-7ed2-4eab-a7e7-bf8d640ad9a2 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:48.758875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb48b7-7ed2-4eab-a7e7-bf8d640ad9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:48.759160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb48b7-7ed2-4eab-a7e7-bf8d640ad9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:48.776181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-05bb48b7-7ed2-4eab-a7e7-bf8d640ad9a2 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:48.777426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-05bb48b7-7ed2-4eab-a7e7-bf8d640ad9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:48.777528 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d243758-b689-411e-b385-4812f7e3af4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:48.778289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d243758-b689-411e-b385-4812f7e3af4e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:48.778575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d243758-b689-411e-b385-4812f7e3af4e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:48.778853 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d243758-b689-411e-b385-4812f7e3af4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:48.780051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d243758-b689-411e-b385-4812f7e3af4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:48.781879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d243758-b689-411e-b385-4812f7e3af4e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:48.783482 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:50:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:48.789568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d243758-b689-411e-b385-4812f7e3af4e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:48.845360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 28/54] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:50:48.868864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:48.869371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb48b7-7ed2-4eab-a7e7-bf8d640ad9a2 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:48.889670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d243758-b689-411e-b385-4812f7e3af4e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:48.924479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946cdec-ff8f-41cc-97d8-d87ff2c7a71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:48.925169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946cdec-ff8f-41cc-97d8-d87ff2c7a71c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:48.925484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946cdec-ff8f-41cc-97d8-d87ff2c7a71c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:48.925776 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946cdec-ff8f-41cc-97d8-d87ff2c7a71c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:48.926732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946cdec-ff8f-41cc-97d8-d87ff2c7a71c None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.domain.id=default, user.id=9a24de1c35d841e4a22851782428ca15) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:48.927054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946cdec-ff8f-41cc-97d8-d87ff2c7a71c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:48.928530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946cdec-ff8f-41cc-97d8-d87ff2c7a71c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:48.930172 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:48.934354 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1322 bytes} [Thu Jun 23 12:50:48 2022] GET /identity/v3/role_assignments?user.id=9a24de1c35d841e4a22851782428ca15&scope.domain.id=default&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:50:48.970818 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb48b7-7ed2-4eab-a7e7-bf8d640ad9a2 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:49.116860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480764a-4596-45d3-8c59-c42c9777021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:49.117606 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480764a-4596-45d3-8c59-c42c9777021c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:49.117893 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480764a-4596-45d3-8c59-c42c9777021c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:49.118173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480764a-4596-45d3-8c59-c42c9777021c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:49.119347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480764a-4596-45d3-8c59-c42c9777021c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:49.120848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9480764a-4596-45d3-8c59-c42c9777021c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:49.122576 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 29/56] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:50:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:50:49.128129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946cdec-ff8f-41cc-97d8-d87ff2c7a71c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:49.227703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946cdec-ff8f-41cc-97d8-d87ff2c7a71c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:49.260062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48881b8c-cab1-4c4b-85c5-88365e6dacf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:49.260713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881b8c-cab1-4c4b-85c5-88365e6dacf7 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:49.261027 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881b8c-cab1-4c4b-85c5-88365e6dacf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:49.261309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881b8c-cab1-4c4b-85c5-88365e6dacf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:49.262033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48881b8c-cab1-4c4b-85c5-88365e6dacf7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:49.263493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48881b8c-cab1-4c4b-85c5-88365e6dacf7 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:49.277315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:49.363827 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 28/57] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Jun 23 12:50:49 2022] POST /identity/v3/projects => generated 298 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:50:51.489095 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc22b64-9893-41cf-a014-f5314f974de0 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:51.489611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc22b64-9893-41cf-a014-f5314f974de0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:51.489697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc22b64-9893-41cf-a014-f5314f974de0 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:51.491026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 30/58] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:51.496177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176992db-c088-4ad9-b47e-48b0fa9ae990 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:51.496538 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176992db-c088-4ad9-b47e-48b0fa9ae990 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:51.496747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176992db-c088-4ad9-b47e-48b0fa9ae990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:51.513340 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-176992db-c088-4ad9-b47e-48b0fa9ae990 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:51.514539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-176992db-c088-4ad9-b47e-48b0fa9ae990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:51.582997 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 29/59] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:51.608287 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc22b64-9893-41cf-a014-f5314f974de0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:51.709892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc22b64-9893-41cf-a014-f5314f974de0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:51.745117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:51.750586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37daed-01ad-4f8f-8e9e-654b85a106c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:51.751385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37daed-01ad-4f8f-8e9e-654b85a106c7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:51.751673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37daed-01ad-4f8f-8e9e-654b85a106c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:51.751956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37daed-01ad-4f8f-8e9e-654b85a106c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:51.753161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37daed-01ad-4f8f-8e9e-654b85a106c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:51.754690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37daed-01ad-4f8f-8e9e-654b85a106c7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:51.756303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 31/60] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:50:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:51.762039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176992db-c088-4ad9-b47e-48b0fa9ae990 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:51.869424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176992db-c088-4ad9-b47e-48b0fa9ae990 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:51.892547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:51.903675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16edd81-2579-42b7-bbef-e2bd4b6ca816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:51.904349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16edd81-2579-42b7-bbef-e2bd4b6ca816 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:51.904642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16edd81-2579-42b7-bbef-e2bd4b6ca816 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:51.904963 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16edd81-2579-42b7-bbef-e2bd4b6ca816 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:51.905691 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16edd81-2579-42b7-bbef-e2bd4b6ca816 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:51.907162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16edd81-2579-42b7-bbef-e2bd4b6ca816 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:51.990733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 30/61] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:50:51 2022] POST /identity/v3/users => generated 275 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:50:55.054149 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf2a8-fb6b-4651-9dc3-2d561f1e3b81 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.054646 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf2a8-fb6b-4651-9dc3-2d561f1e3b81 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.054718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf2a8-fb6b-4651-9dc3-2d561f1e3b81 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.056095 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 32/62] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:55.061394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292d85b-eac5-41e3-9b68-89b2965f7489 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.062231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292d85b-eac5-41e3-9b68-89b2965f7489 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.062662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292d85b-eac5-41e3-9b68-89b2965f7489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.089927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-0292d85b-eac5-41e3-9b68-89b2965f7489 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:55.091400 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0292d85b-eac5-41e3-9b68-89b2965f7489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:55.177390 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 31/63] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:55.214971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf2a8-fb6b-4651-9dc3-2d561f1e3b81 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:55.314602 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e66481-7fb1-4a7a-b29b-55eae95774e4 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.315230 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e66481-7fb1-4a7a-b29b-55eae95774e4 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.315769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e66481-7fb1-4a7a-b29b-55eae95774e4 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.317502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 32/64] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:50:55.323096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9e23e-116e-41d4-9b95-b789fb6a094d None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.323674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9e23e-116e-41d4-9b95-b789fb6a094d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.324148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9e23e-116e-41d4-9b95-b789fb6a094d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.352957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-cea9e23e-116e-41d4-9b95-b789fb6a094d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:55.354513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cea9e23e-116e-41d4-9b95-b789fb6a094d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:55.359145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf2a8-fb6b-4651-9dc3-2d561f1e3b81 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:55.412226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d35637-cb19-4382-a7f3-6ab9b31fc84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:55.413090 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d35637-cb19-4382-a7f3-6ab9b31fc84c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.413377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d35637-cb19-4382-a7f3-6ab9b31fc84c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.413655 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d35637-cb19-4382-a7f3-6ab9b31fc84c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.434280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d35637-cb19-4382-a7f3-6ab9b31fc84c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-d7d35637-cb19-4382-a7f3-6ab9b31fc84c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:50:55.446092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:50:55.446952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:50:55.447690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 33/65] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:50:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:50:55.448528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9165f9d-cf6d-4961-8e3f-c290f49e95a0 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.449103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9165f9d-cf6d-4961-8e3f-c290f49e95a0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.450468 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9165f9d-cf6d-4961-8e3f-c290f49e95a0 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.451870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 33/66] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:50:55.451999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 34/67] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:55.457654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9165f9d-cf6d-4961-8e3f-c290f49e95a0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:55.471576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71348b-aeab-4e2a-8971-95fcd756a0cf None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.472747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71348b-aeab-4e2a-8971-95fcd756a0cf None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.473283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71348b-aeab-4e2a-8971-95fcd756a0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.494788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-6a71348b-aeab-4e2a-8971-95fcd756a0cf None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:55.496854 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6a71348b-aeab-4e2a-8971-95fcd756a0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:55.541468 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:55.544762 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:55.588471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9165f9d-cf6d-4961-8e3f-c290f49e95a0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:55.594732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 34/68] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:55.595895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71348b-aeab-4e2a-8971-95fcd756a0cf None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:55.652659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574a635-88e4-49ee-ada0-925775e38a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:55.653917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a635-88e4-49ee-ada0-925775e38a07 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.654408 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a635-88e4-49ee-ada0-925775e38a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.655718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574a635-88e4-49ee-ada0-925775e38a07 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.657990 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574a635-88e4-49ee-ada0-925775e38a07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:55.658519 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574a635-88e4-49ee-ada0-925775e38a07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:55.661002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574a635-88e4-49ee-ada0-925775e38a07 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:55.681110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 35/69] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:50:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:50:55.682362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574a635-88e4-49ee-ada0-925775e38a07 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:55.733913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71348b-aeab-4e2a-8971-95fcd756a0cf None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:55.770751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb0285-3e4b-4efc-994a-d7cfa83e2912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:55.771561 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb0285-3e4b-4efc-994a-d7cfa83e2912 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.771846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb0285-3e4b-4efc-994a-d7cfa83e2912 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.772126 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb0285-3e4b-4efc-994a-d7cfa83e2912 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.782842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb0285-3e4b-4efc-994a-d7cfa83e2912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-04bb0285-3e4b-4efc-994a-d7cfa83e2912 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:50:55.791359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:50:55.792300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:50:55.797891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:50:55.797891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:50:55.797891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:50:55.797891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:50:55.797891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:50:55.797891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:50:55.797891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:50:55.797891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:50:55.797891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:50:55.797891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:50:55.797891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:50:55.797891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:50:55.798612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574a635-88e4-49ee-ada0-925775e38a07 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:55.798704 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 35/70] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:50:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:50:55.798704 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb0285-3e4b-4efc-994a-d7cfa83e2912 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:55.814621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:55.826975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:55.828365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c31e64-f9ea-4114-851a-ef49b9e51bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:55.829231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31e64-f9ea-4114-851a-ef49b9e51bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.829506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31e64-f9ea-4114-851a-ef49b9e51bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.829786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c31e64-f9ea-4114-851a-ef49b9e51bb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.840615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c31e64-f9ea-4114-851a-ef49b9e51bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-35c31e64-f9ea-4114-851a-ef49b9e51bb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:50:55.849860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:50:55.856722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 36/71] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:50:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:50:55.857504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf14386-c4a1-4293-a2ed-33bdc4691693 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.858170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf14386-c4a1-4293-a2ed-33bdc4691693 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.858170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf14386-c4a1-4293-a2ed-33bdc4691693 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.858170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 37/72] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:55.858170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fa0fa-7cdd-49c7-b48b-72eb86df961f None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.858170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fa0fa-7cdd-49c7-b48b-72eb86df961f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.858170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18fa0fa-7cdd-49c7-b48b-72eb86df961f None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.858170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 38/73] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:50:55.859127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fa0fa-7cdd-49c7-b48b-72eb86df961f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:55.904771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb0285-3e4b-4efc-994a-d7cfa83e2912 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:55.937874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31453435-64b8-4cfa-8af8-26e12fc5d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:55.938750 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31453435-64b8-4cfa-8af8-26e12fc5d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:55.939038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31453435-64b8-4cfa-8af8-26e12fc5d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:55.939325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31453435-64b8-4cfa-8af8-26e12fc5d3c1 None admin] PATH_INFO: `/v3/users/9a24de1c35d841e4a22851782428ca15` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:55.940528 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31453435-64b8-4cfa-8af8-26e12fc5d3c1 None admin] RBAC: Authorizing `identity:get_user(user_id=9a24de1c35d841e4a22851782428ca15)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:55.942704 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31453435-64b8-4cfa-8af8-26e12fc5d3c1 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:55.944546 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 36/74] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:50:55 2022] GET /identity/v3/users/9a24de1c35d841e4a22851782428ca15 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:55.945138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31453435-64b8-4cfa-8af8-26e12fc5d3c1 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:55.969092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18fa0fa-7cdd-49c7-b48b-72eb86df961f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:56.001582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a33290c-3c49-40c5-9dd2-a5ce79bea29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:56.002168 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33290c-3c49-40c5-9dd2-a5ce79bea29d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:56.002456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33290c-3c49-40c5-9dd2-a5ce79bea29d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:56.002735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a33290c-3c49-40c5-9dd2-a5ce79bea29d None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:56.004021 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33290c-3c49-40c5-9dd2-a5ce79bea29d None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:56.004323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33290c-3c49-40c5-9dd2-a5ce79bea29d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:56.005743 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a33290c-3c49-40c5-9dd2-a5ce79bea29d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:56.014075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 39/75] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:50:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:56.019837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa495fba-3cc8-4355-a4ad-e14dfda29d9a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:56.019837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa495fba-3cc8-4355-a4ad-e14dfda29d9a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:56.019837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa495fba-3cc8-4355-a4ad-e14dfda29d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:56.032429 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fa495fba-3cc8-4355-a4ad-e14dfda29d9a None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:56.033670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fa495fba-3cc8-4355-a4ad-e14dfda29d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:56.040637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:56.044394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31453435-64b8-4cfa-8af8-26e12fc5d3c1 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:56.068463 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:56.078138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71a7da-ce01-4804-9e99-5f0f640f3b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:56.078806 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a7da-ce01-4804-9e99-5f0f640f3b37 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:56.079093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a7da-ce01-4804-9e99-5f0f640f3b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:56.079375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71a7da-ce01-4804-9e99-5f0f640f3b37 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:56.080128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71a7da-ce01-4804-9e99-5f0f640f3b37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:56.080445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71a7da-ce01-4804-9e99-5f0f640f3b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:56.082010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71a7da-ce01-4804-9e99-5f0f640f3b37 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:56.089985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 37/76] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:50:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:56.089985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ceea3-e8a3-46c6-9f72-d791b3f99ce1 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:56.089985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ceea3-e8a3-46c6-9f72-d791b3f99ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:56.089985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ceea3-e8a3-46c6-9f72-d791b3f99ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:56.105331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 40/77] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:56.106173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa495fba-3cc8-4355-a4ad-e14dfda29d9a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:56.108105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d12ceea3-e8a3-46c6-9f72-d791b3f99ce1 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:50:56.109326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d12ceea3-e8a3-46c6-9f72-d791b3f99ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:50:56.176859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 38/78] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:50:56.177692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ceea3-e8a3-46c6-9f72-d791b3f99ce1 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:56.210378 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa495fba-3cc8-4355-a4ad-e14dfda29d9a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:56.243215 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81d85f-90d2-4280-87c7-31f5c6228981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:56.243870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81d85f-90d2-4280-87c7-31f5c6228981 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:56.244160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81d85f-90d2-4280-87c7-31f5c6228981 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:56.244446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81d85f-90d2-4280-87c7-31f5c6228981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:56.270858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:56.280065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ceea3-e8a3-46c6-9f72-d791b3f99ce1 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:56.285370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:56.312557 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81d85f-90d2-4280-87c7-31f5c6228981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:56.314138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81d85f-90d2-4280-87c7-31f5c6228981 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:56.314472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4170e45-7d6a-498f-9bbb-07a606cbf000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:56.315436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4170e45-7d6a-498f-9bbb-07a606cbf000 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:56.316378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4170e45-7d6a-498f-9bbb-07a606cbf000 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:56.316661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4170e45-7d6a-498f-9bbb-07a606cbf000 None admin] PATH_INFO: `/v3/users/66aae726fe6c49fe9ae28384be5409f7` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:56.330160 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4170e45-7d6a-498f-9bbb-07a606cbf000 None admin] RBAC: Authorizing `identity:get_user(user_id=66aae726fe6c49fe9ae28384be5409f7)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:56.331853 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4170e45-7d6a-498f-9bbb-07a606cbf000 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:56.333574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 39/79] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:50:56 2022] GET /identity/v3/users/66aae726fe6c49fe9ae28384be5409f7 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:56.334333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4170e45-7d6a-498f-9bbb-07a606cbf000 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:56.413262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 41/80] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:50:56.414007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81d85f-90d2-4280-87c7-31f5c6228981 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:56.438951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4170e45-7d6a-498f-9bbb-07a606cbf000 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:56.473532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e30e2-ec36-449d-9003-ca05be199a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:56.474405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e30e2-ec36-449d-9003-ca05be199a18 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:56.474697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e30e2-ec36-449d-9003-ca05be199a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:56.474981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e30e2-ec36-449d-9003-ca05be199a18 None admin] PATH_INFO: `/v3/users/66aae726fe6c49fe9ae28384be5409f7` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:56.476182 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e30e2-ec36-449d-9003-ca05be199a18 None admin] RBAC: Authorizing `identity:get_user(user_id=66aae726fe6c49fe9ae28384be5409f7)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:56.477683 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e30e2-ec36-449d-9003-ca05be199a18 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:56.479320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 40/81] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:50:56 2022] GET /identity/v3/users/66aae726fe6c49fe9ae28384be5409f7 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:56.480079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e30e2-ec36-449d-9003-ca05be199a18 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:56.482003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:56.499520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:56.512369 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81d85f-90d2-4280-87c7-31f5c6228981 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:56.547340 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8570f-670e-4412-a842-bf9d429c31e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:56.548066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8570f-670e-4412-a842-bf9d429c31e7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:56.548367 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8570f-670e-4412-a842-bf9d429c31e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:56.548645 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8570f-670e-4412-a842-bf9d429c31e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:56.559146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa8570f-670e-4412-a842-bf9d429c31e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-7aa8570f-670e-4412-a842-bf9d429c31e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:50:56.567345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:50:56.568276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:50:56.569241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 42/82] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:50:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:50:56.569856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8570f-670e-4412-a842-bf9d429c31e7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:56.582825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e30e2-ec36-449d-9003-ca05be199a18 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:56.616755 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9e029-4324-4389-822d-110e843f7d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:56.617567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9e029-4324-4389-822d-110e843f7d10 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:56.617855 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9e029-4324-4389-822d-110e843f7d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:56.618135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc9e029-4324-4389-822d-110e843f7d10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:56.619309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9e029-4324-4389-822d-110e843f7d10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:56.620771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc9e029-4324-4389-822d-110e843f7d10 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:56.622399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 41/83] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:50:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:56.623158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9e029-4324-4389-822d-110e843f7d10 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:56.666733 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8570f-670e-4412-a842-bf9d429c31e7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:56.695563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:56.700641 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8ee8d-13d1-45b1-8f29-c79fb409157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:56.701314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8ee8d-13d1-45b1-8f29-c79fb409157f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:56.701600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8ee8d-13d1-45b1-8f29-c79fb409157f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:56.701880 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8ee8d-13d1-45b1-8f29-c79fb409157f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:56.705484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:56.721521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc9e029-4324-4389-822d-110e843f7d10 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:56.762492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8901b1-c395-4016-8a11-7054f2ad049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:56.763373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8901b1-c395-4016-8a11-7054f2ad049a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:56.763663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8901b1-c395-4016-8a11-7054f2ad049a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:56.763946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8901b1-c395-4016-8a11-7054f2ad049a None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:56.765184 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8901b1-c395-4016-8a11-7054f2ad049a None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:56.766909 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8901b1-c395-4016-8a11-7054f2ad049a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:56.774261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 42/84] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:50:56 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:56.774261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8901b1-c395-4016-8a11-7054f2ad049a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:56.774497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8ee8d-13d1-45b1-8f29-c79fb409157f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:56.774497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8ee8d-13d1-45b1-8f29-c79fb409157f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:56.870298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 43/85] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:50:56.870949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8ee8d-13d1-45b1-8f29-c79fb409157f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:56.878886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8901b1-c395-4016-8a11-7054f2ad049a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:56.903105 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:56.913241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb82ee-2033-486e-8122-72ebff3bf479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:56.913900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb82ee-2033-486e-8122-72ebff3bf479 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:56.914186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb82ee-2033-486e-8122-72ebff3bf479 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:56.914506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb82ee-2033-486e-8122-72ebff3bf479 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:56.934954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:56.970420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8ee8d-13d1-45b1-8f29-c79fb409157f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:56.983071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb82ee-2033-486e-8122-72ebff3bf479 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:56.984551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb82ee-2033-486e-8122-72ebff3bf479 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:57.005404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6c726-db12-4d4c-b085-5d5558f57600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:57.006072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6c726-db12-4d4c-b085-5d5558f57600 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:57.006361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6c726-db12-4d4c-b085-5d5558f57600 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:57.006644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6c726-db12-4d4c-b085-5d5558f57600 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:57.007389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6c726-db12-4d4c-b085-5d5558f57600 None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:57.007696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6c726-db12-4d4c-b085-5d5558f57600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:57.009101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6c726-db12-4d4c-b085-5d5558f57600 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:57.017195 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 44/86] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:50:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:57.017966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6c726-db12-4d4c-b085-5d5558f57600 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:57.086932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 43/87] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:50:57.088327 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb82ee-2033-486e-8122-72ebff3bf479 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:57.108444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:57.115636 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6c726-db12-4d4c-b085-5d5558f57600 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:57.139248 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:57.149773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736721a-fd3b-402e-83b3-4c35b6b36d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:57.150459 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736721a-fd3b-402e-83b3-4c35b6b36d60 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:57.150747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736721a-fd3b-402e-83b3-4c35b6b36d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:57.151031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6736721a-fd3b-402e-83b3-4c35b6b36d60 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:57.151750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736721a-fd3b-402e-83b3-4c35b6b36d60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:57.153254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6736721a-fd3b-402e-83b3-4c35b6b36d60 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:57.187738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb82ee-2033-486e-8122-72ebff3bf479 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:57.220314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6ca3a-c0f9-46a3-965e-1cd55d7b1ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:57.220996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6ca3a-c0f9-46a3-965e-1cd55d7b1ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:57.221288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6ca3a-c0f9-46a3-965e-1cd55d7b1ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:57.221572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6ca3a-c0f9-46a3-965e-1cd55d7b1ab0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:57.222445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6ca3a-c0f9-46a3-965e-1cd55d7b1ab0 None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0, user.id=9a24de1c35d841e4a22851782428ca15) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:57.222765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6ca3a-c0f9-46a3-965e-1cd55d7b1ab0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:57.224224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6ca3a-c0f9-46a3-965e-1cd55d7b1ab0 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:57.229536 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 44/88] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:50:57 2022] GET /identity/v3/role_assignments?user.id=9a24de1c35d841e4a22851782428ca15&scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:57.230303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6ca3a-c0f9-46a3-965e-1cd55d7b1ab0 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:57.281750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 45/89] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:50:57 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:50:57.283012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736721a-fd3b-402e-83b3-4c35b6b36d60 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:57.376357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6ca3a-c0f9-46a3-965e-1cd55d7b1ab0 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:57.401679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:57.418379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6736721a-fd3b-402e-83b3-4c35b6b36d60 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:57.423256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f770a7-76bc-4d6f-a97c-a02acbc05da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:57.424149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f770a7-76bc-4d6f-a97c-a02acbc05da3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:57.424439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f770a7-76bc-4d6f-a97c-a02acbc05da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:57.424724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f770a7-76bc-4d6f-a97c-a02acbc05da3 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:57.426425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f770a7-76bc-4d6f-a97c-a02acbc05da3 None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:57.427954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f770a7-76bc-4d6f-a97c-a02acbc05da3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:57.430199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 45/90] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:50:57 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:57.431087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f770a7-76bc-4d6f-a97c-a02acbc05da3 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:57.463082 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f6da1-b75b-458c-a9bb-73233a34e8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:57.464269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f6da1-b75b-458c-a9bb-73233a34e8be None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:57.464753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f6da1-b75b-458c-a9bb-73233a34e8be None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:57.465224 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f6da1-b75b-458c-a9bb-73233a34e8be None admin] PATH_INFO: `/v3/users/66aae726fe6c49fe9ae28384be5409f7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:57.466678 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f6da1-b75b-458c-a9bb-73233a34e8be None admin] RBAC: Authorizing `identity:get_user(user_id=66aae726fe6c49fe9ae28384be5409f7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:57.468320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f6da1-b75b-458c-a9bb-73233a34e8be None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:57.470277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 46/91] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:50:57 2022] GET /identity/v3/users/66aae726fe6c49fe9ae28384be5409f7 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:57.471923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f6da1-b75b-458c-a9bb-73233a34e8be None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:57.493413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:57.569976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f770a7-76bc-4d6f-a97c-a02acbc05da3 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:57.610513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f6da1-b75b-458c-a9bb-73233a34e8be None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:57.613003 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed89bd6-04ba-468a-a06f-2c2deba2a174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:57.614622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89bd6-04ba-468a-a06f-2c2deba2a174 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:57.614622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89bd6-04ba-468a-a06f-2c2deba2a174 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:57.614622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed89bd6-04ba-468a-a06f-2c2deba2a174 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:57.615794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed89bd6-04ba-468a-a06f-2c2deba2a174 None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:57.617318 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed89bd6-04ba-468a-a06f-2c2deba2a174 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:57.619049 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 46/92] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:50:57 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:57.619829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed89bd6-04ba-468a-a06f-2c2deba2a174 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:57.655854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e036c1a-908c-4d3c-aec8-f1085c2cd6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:57.657046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e036c1a-908c-4d3c-aec8-f1085c2cd6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:57.657338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e036c1a-908c-4d3c-aec8-f1085c2cd6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:57.657625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e036c1a-908c-4d3c-aec8-f1085c2cd6d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:57.658817 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e036c1a-908c-4d3c-aec8-f1085c2cd6d7 None admin] RBAC: Adding query filter params (role.id=3d2f155e5f1f4acbaff64a9c464d9d92, scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0, user.id=66aae726fe6c49fe9ae28384be5409f7) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:57.659930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e036c1a-908c-4d3c-aec8-f1085c2cd6d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:57.661602 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e036c1a-908c-4d3c-aec8-f1085c2cd6d7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:57.674394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 47/93] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:50:57 2022] GET /identity/v3/role_assignments?user.id=66aae726fe6c49fe9ae28384be5409f7&scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0&role.id=3d2f155e5f1f4acbaff64a9c464d9d92 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:57.675375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e036c1a-908c-4d3c-aec8-f1085c2cd6d7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:57.719446 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:57.800328 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed89bd6-04ba-468a-a06f-2c2deba2a174 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:57.801042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:57.854851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e036c1a-908c-4d3c-aec8-f1085c2cd6d7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:57.891405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f862b-4d00-4e5d-9bd9-992461be9bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:57.891944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f862b-4d00-4e5d-9bd9-992461be9bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:57.892289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f862b-4d00-4e5d-9bd9-992461be9bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:57.892574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f862b-4d00-4e5d-9bd9-992461be9bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:57.909065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49b54a-9a83-4542-8c88-28a38f7f50ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:57.910780 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49b54a-9a83-4542-8c88-28a38f7f50ce None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:57.911293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49b54a-9a83-4542-8c88-28a38f7f50ce None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:57.911778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49b54a-9a83-4542-8c88-28a38f7f50ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:57.912914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49b54a-9a83-4542-8c88-28a38f7f50ce None admin] RBAC: Adding query filter params (role.id=d773dfde38e5426799f6b947044767bb, scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0, user.id=66aae726fe6c49fe9ae28384be5409f7) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:57.913491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49b54a-9a83-4542-8c88-28a38f7f50ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:57.915772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d49b54a-9a83-4542-8c88-28a38f7f50ce None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:57.922492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 48/94] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:50:57 2022] GET /identity/v3/role_assignments?user.id=66aae726fe6c49fe9ae28384be5409f7&scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0&role.id=d773dfde38e5426799f6b947044767bb => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:50:57.999777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f862b-4d00-4e5d-9bd9-992461be9bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:58.001777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f862b-4d00-4e5d-9bd9-992461be9bc3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:58.087806 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:50:58.154512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 47/95] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:50:58.161204 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49b54a-9a83-4542-8c88-28a38f7f50ce None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:58.292180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d49b54a-9a83-4542-8c88-28a38f7f50ce None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:58.328679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bbd72-c0d3-4d39-96d9-bccd94f28dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:58.329988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bbd72-c0d3-4d39-96d9-bccd94f28dbf None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:58.330485 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bbd72-c0d3-4d39-96d9-bccd94f28dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:58.330966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bbd72-c0d3-4d39-96d9-bccd94f28dbf None admin] PATH_INFO: `/v3/projects/8c009114954c459da45da3213f6e7720` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:58.332643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bbd72-c0d3-4d39-96d9-bccd94f28dbf None admin] RBAC: Authorizing `identity:get_project(project_id=8c009114954c459da45da3213f6e7720)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:58.334339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bbd72-c0d3-4d39-96d9-bccd94f28dbf None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:58.336278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:50:58 2022] GET /identity/v3/projects/8c009114954c459da45da3213f6e7720 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:50:58.345910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f862b-4d00-4e5d-9bd9-992461be9bc3 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:50:58.485342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f862b-4d00-4e5d-9bd9-992461be9bc3 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:50:58.526108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2727a02-8026-443c-9e95-e82a8b89b29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:50:58.526774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2727a02-8026-443c-9e95-e82a8b89b29a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:50:58.527067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2727a02-8026-443c-9e95-e82a8b89b29a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:50:58.527352 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2727a02-8026-443c-9e95-e82a8b89b29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:50:58.528211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2727a02-8026-443c-9e95-e82a8b89b29a None admin] RBAC: Adding query filter params (role.id=3d2f155e5f1f4acbaff64a9c464d9d92, scope.project.id=8c009114954c459da45da3213f6e7720, user.id=66aae726fe6c49fe9ae28384be5409f7) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:50:58.528531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2727a02-8026-443c-9e95-e82a8b89b29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:50:58.530095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2727a02-8026-443c-9e95-e82a8b89b29a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:50:58.541320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 48/97] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:50:58 2022] GET /identity/v3/role_assignments?user.id=66aae726fe6c49fe9ae28384be5409f7&scope.project.id=8c009114954c459da45da3213f6e7720&role.id=3d2f155e5f1f4acbaff64a9c464d9d92 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:00.402866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f71581-3cdf-41cd-90b5-14e90dbc7b55 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:00.403397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f71581-3cdf-41cd-90b5-14e90dbc7b55 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:00.403397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f71581-3cdf-41cd-90b5-14e90dbc7b55 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:00.405112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 50/98] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:00.410907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22eb8b-54a8-4875-a314-2271287fc22d None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:00.411348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22eb8b-54a8-4875-a314-2271287fc22d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:00.411522 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22eb8b-54a8-4875-a314-2271287fc22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:00.421367 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2eaac-5e9e-46b0-9a6a-159ed9bae69f None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:00.421660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2eaac-5e9e-46b0-9a6a-159ed9bae69f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:00.421943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2eaac-5e9e-46b0-9a6a-159ed9bae69f None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:00.423520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 51/99] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:00.429203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada192fd-25de-4ae7-9ae7-443a2f59c840 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:00.429492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada192fd-25de-4ae7-9ae7-443a2f59c840 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:00.429774 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada192fd-25de-4ae7-9ae7-443a2f59c840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:00.445503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-0f22eb8b-54a8-4875-a314-2271287fc22d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:00.446788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0f22eb8b-54a8-4875-a314-2271287fc22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:00.459093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ada192fd-25de-4ae7-9ae7-443a2f59c840 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:00.460302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ada192fd-25de-4ae7-9ae7-443a2f59c840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:00.466373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:00.473704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:00.555275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 49/100] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:00.556732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e22ea3-dbde-448d-9443-7db36fce7116 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:00.557058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e22ea3-dbde-448d-9443-7db36fce7116 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:00.557344 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e22ea3-dbde-448d-9443-7db36fce7116 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:00.558696 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 50/101] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:00.559779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b4a57-2a85-4f5b-a237-0ea757543db9 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:00.559950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b4a57-2a85-4f5b-a237-0ea757543db9 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:00.560235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b4a57-2a85-4f5b-a237-0ea757543db9 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:00.561473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 51/102] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:00.563815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39f947-d14d-4fec-8896-092c90ae3f7b None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:00.564103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39f947-d14d-4fec-8896-092c90ae3f7b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:00.564386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39f947-d14d-4fec-8896-092c90ae3f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:00.577391 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 52/103] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:00.579086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c379-6eb3-4ed6-a333-1b914c90badd None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:00.579382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c379-6eb3-4ed6-a333-1b914c90badd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:00.579664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63c379-6eb3-4ed6-a333-1b914c90badd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:00.583324 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-4e39f947-d14d-4fec-8896-092c90ae3f7b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:00.585132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4e39f947-d14d-4fec-8896-092c90ae3f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:00.608900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7c63c379-6eb3-4ed6-a333-1b914c90badd None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:00.610854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7c63c379-6eb3-4ed6-a333-1b914c90badd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:00.690786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 52/104] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:00.692670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39f947-d14d-4fec-8896-092c90ae3f7b None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:00.703498 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 53/105] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:00.704414 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63c379-6eb3-4ed6-a333-1b914c90badd None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:00.791523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:00.810106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:00.821284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63c379-6eb3-4ed6-a333-1b914c90badd None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:00.842332 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39f947-d14d-4fec-8896-092c90ae3f7b None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:00.859954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1cc1f-bb79-4163-8af7-0421fbfabb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:00.861089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1cc1f-bb79-4163-8af7-0421fbfabb61 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:00.861610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1cc1f-bb79-4163-8af7-0421fbfabb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:00.862063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c1cc1f-bb79-4163-8af7-0421fbfabb61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:00.877163 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c1cc1f-bb79-4163-8af7-0421fbfabb61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-20c1cc1f-bb79-4163-8af7-0421fbfabb61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:00.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:00.887065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:00.887806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:00.887806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:00.887806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:00.887806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:00.887806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:00.887806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:00.887806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:00.887806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:00.887806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:00.887806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:00.887806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:00.887806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:00.890299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 54/106] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:00.891537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1cc1f-bb79-4163-8af7-0421fbfabb61 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:00.898789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3fcd7-5c77-4f52-9889-996f00a958f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:00.899606 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3fcd7-5c77-4f52-9889-996f00a958f9 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:00.899893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3fcd7-5c77-4f52-9889-996f00a958f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:00.900174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3fcd7-5c77-4f52-9889-996f00a958f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:00.905022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3fcd7-5c77-4f52-9889-996f00a958f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:00.907300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3fcd7-5c77-4f52-9889-996f00a958f9 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:00.910738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 53/107] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:00.911970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3fcd7-5c77-4f52-9889-996f00a958f9 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:01.032798 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c1cc1f-bb79-4163-8af7-0421fbfabb61 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:01.043746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3fcd7-5c77-4f52-9889-996f00a958f9 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:01.078550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b2c09-5f54-416f-b7eb-261aa41446c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:01.079651 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b2c09-5f54-416f-b7eb-261aa41446c5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.079943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b2c09-5f54-416f-b7eb-261aa41446c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.080226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394b2c09-5f54-416f-b7eb-261aa41446c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.083214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:01.086949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558caf08-0887-433e-9da9-8753e3358b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:01.087935 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558caf08-0887-433e-9da9-8753e3358b80 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.088221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558caf08-0887-433e-9da9-8753e3358b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.088590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558caf08-0887-433e-9da9-8753e3358b80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.094357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394b2c09-5f54-416f-b7eb-261aa41446c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:01.100642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558caf08-0887-433e-9da9-8753e3358b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-394b2c09-5f54-416f-b7eb-261aa41446c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:01.103140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:01.103970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:01.104748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:01.104748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:01.104748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:01.104748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:01.104748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:01.104748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:01.104748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:01.104748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:01.104748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:01.104748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:01.104748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:01.104748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:01.107501 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 55/108] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:51:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:01.108503 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b2c09-5f54-416f-b7eb-261aa41446c5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-558caf08-0887-433e-9da9-8753e3358b80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:01.108615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:01.109591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:01.110357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 54/109] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:01.110964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558caf08-0887-433e-9da9-8753e3358b80 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:01.115936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:01.231282 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394b2c09-5f54-416f-b7eb-261aa41446c5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:01.253647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558caf08-0887-433e-9da9-8753e3358b80 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:01.268829 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75cad-f582-41a3-bd1f-eafcb8b2fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:01.269679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75cad-f582-41a3-bd1f-eafcb8b2fe7b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.269822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75cad-f582-41a3-bd1f-eafcb8b2fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.270098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f75cad-f582-41a3-bd1f-eafcb8b2fe7b None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.270865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75cad-f582-41a3-bd1f-eafcb8b2fe7b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:01.271179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75cad-f582-41a3-bd1f-eafcb8b2fe7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:01.272597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f75cad-f582-41a3-bd1f-eafcb8b2fe7b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:01.282070 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 56/110] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:01.282986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75cad-f582-41a3-bd1f-eafcb8b2fe7b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:01.310443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae300a-a069-48f9-b317-49e5d442a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:01.311500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae300a-a069-48f9-b317-49e5d442a83e None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.311987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae300a-a069-48f9-b317-49e5d442a83e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.313303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae300a-a069-48f9-b317-49e5d442a83e None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.316111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae300a-a069-48f9-b317-49e5d442a83e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:01.318537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae300a-a069-48f9-b317-49e5d442a83e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:01.358052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:01.402011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f75cad-f582-41a3-bd1f-eafcb8b2fe7b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:01.420910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 55/111] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:51:01 2022] POST /identity/v3/projects => generated 302 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:51:01.421758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae300a-a069-48f9-b317-49e5d442a83e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:01.446661 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949654a1-8bd3-40de-9069-8ab7d0c90957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:01.447372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949654a1-8bd3-40de-9069-8ab7d0c90957 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.447681 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949654a1-8bd3-40de-9069-8ab7d0c90957 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.447952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949654a1-8bd3-40de-9069-8ab7d0c90957 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.448737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949654a1-8bd3-40de-9069-8ab7d0c90957 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:01.449089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949654a1-8bd3-40de-9069-8ab7d0c90957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:01.450558 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949654a1-8bd3-40de-9069-8ab7d0c90957 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:01.460753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 57/112] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:01.465927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949654a1-8bd3-40de-9069-8ab7d0c90957 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:01.491855 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:01.542453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae300a-a069-48f9-b317-49e5d442a83e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:01.583682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48b835-842c-44fb-9cd2-e6a8840fa794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:01.584461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48b835-842c-44fb-9cd2-e6a8840fa794 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.585029 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48b835-842c-44fb-9cd2-e6a8840fa794 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.585129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48b835-842c-44fb-9cd2-e6a8840fa794 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.585870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48b835-842c-44fb-9cd2-e6a8840fa794 None admin] RBAC: Adding query filter params (name=member) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:01.586187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48b835-842c-44fb-9cd2-e6a8840fa794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:01.587607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48b835-842c-44fb-9cd2-e6a8840fa794 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:01.592688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949654a1-8bd3-40de-9069-8ab7d0c90957 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:01.601290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 56/113] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:01.602366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db3357-e27b-4826-bba8-b10c721595fd None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.602658 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db3357-e27b-4826-bba8-b10c721595fd None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.603194 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db3357-e27b-4826-bba8-b10c721595fd None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.604503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 57/114] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:01.605547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf614c3-757c-473e-83fb-f0540468bd35 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.605668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf614c3-757c-473e-83fb-f0540468bd35 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.605989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf614c3-757c-473e-83fb-f0540468bd35 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.607225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 58/115] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:01.607800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf614c3-757c-473e-83fb-f0540468bd35 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:01.614472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:01.635561 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772eb41-b610-45cc-9f67-2fa5158ab64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:01.636650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772eb41-b610-45cc-9f67-2fa5158ab64f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.636979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772eb41-b610-45cc-9f67-2fa5158ab64f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.637276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8772eb41-b610-45cc-9f67-2fa5158ab64f None admin] PATH_INFO: `/v3/users/0f097ed400dd477f814e703ee089a915` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.659596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772eb41-b610-45cc-9f67-2fa5158ab64f None admin] RBAC: Authorizing `identity:get_user(user_id=0f097ed400dd477f814e703ee089a915)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:01.661123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8772eb41-b610-45cc-9f67-2fa5158ab64f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:01.663491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 58/116] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:01 2022] GET /identity/v3/users/0f097ed400dd477f814e703ee089a915 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:01.664487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772eb41-b610-45cc-9f67-2fa5158ab64f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:01.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf614c3-757c-473e-83fb-f0540468bd35 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:01.750460 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:01.769082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39a915-41c1-464b-8b1f-c3f9adeb030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:01.770070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39a915-41c1-464b-8b1f-c3f9adeb030b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.770431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39a915-41c1-464b-8b1f-c3f9adeb030b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.770789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39a915-41c1-464b-8b1f-c3f9adeb030b None admin] PATH_INFO: `/v3/users/9a24de1c35d841e4a22851782428ca15` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.772091 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39a915-41c1-464b-8b1f-c3f9adeb030b None admin] RBAC: Authorizing `identity:get_user(user_id=9a24de1c35d841e4a22851782428ca15)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:01.773588 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39a915-41c1-464b-8b1f-c3f9adeb030b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:01.775250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 59/117] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:01 2022] GET /identity/v3/users/9a24de1c35d841e4a22851782428ca15 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:01.776640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8772eb41-b610-45cc-9f67-2fa5158ab64f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:01.781029 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec76b9-6b69-4a9f-99f8-afbeb7fc7547 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.781789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec76b9-6b69-4a9f-99f8-afbeb7fc7547 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.782435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec76b9-6b69-4a9f-99f8-afbeb7fc7547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.800360 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-64ec76b9-6b69-4a9f-99f8-afbeb7fc7547 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:01.801645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-64ec76b9-6b69-4a9f-99f8-afbeb7fc7547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:01.813895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fd874-9057-40d9-9457-ab6b0ab21a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:01.814743 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fd874-9057-40d9-9457-ab6b0ab21a26 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.815030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fd874-9057-40d9-9457-ab6b0ab21a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.815397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fd874-9057-40d9-9457-ab6b0ab21a26 None admin] PATH_INFO: `/v3/users/66aae726fe6c49fe9ae28384be5409f7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.816587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fd874-9057-40d9-9457-ab6b0ab21a26 None admin] RBAC: Authorizing `identity:get_user(user_id=66aae726fe6c49fe9ae28384be5409f7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:01.818091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896fd874-9057-40d9-9457-ab6b0ab21a26 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:01.819907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 59/118] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:01 2022] GET /identity/v3/users/66aae726fe6c49fe9ae28384be5409f7 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:01.820928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233d867-f875-4791-ab14-c27803888e02 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:01.821217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233d867-f875-4791-ab14-c27803888e02 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:01.821500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233d867-f875-4791-ab14-c27803888e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:01.838658 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c233d867-f875-4791-ab14-c27803888e02 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:01.839850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c233d867-f875-4791-ab14-c27803888e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:01.883329 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:01.884859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 60/119] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:01.885891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec76b9-6b69-4a9f-99f8-afbeb7fc7547 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:01.928848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 60/120] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:01.928848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233d867-f875-4791-ab14-c27803888e02 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:02.013099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec76b9-6b69-4a9f-99f8-afbeb7fc7547 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:02.031443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:02.036777 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233d867-f875-4791-ab14-c27803888e02 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:02.050061 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c85386-aa55-4947-83c0-e846232efea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:02.050781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c85386-aa55-4947-83c0-e846232efea9 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:02.051014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c85386-aa55-4947-83c0-e846232efea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:02.051297 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c85386-aa55-4947-83c0-e846232efea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:02.074347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62048df-b539-4d33-b170-72fbb8737265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:02.075422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62048df-b539-4d33-b170-72fbb8737265 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:02.075850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62048df-b539-4d33-b170-72fbb8737265 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:02.076268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62048df-b539-4d33-b170-72fbb8737265 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:02.077653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62048df-b539-4d33-b170-72fbb8737265 None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:02.079362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62048df-b539-4d33-b170-72fbb8737265 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:02.081343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 61/121] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:01 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:02.082199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62048df-b539-4d33-b170-72fbb8737265 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:02.126168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c85386-aa55-4947-83c0-e846232efea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:02.128483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c85386-aa55-4947-83c0-e846232efea9 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:02.131211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:02.192758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62048df-b539-4d33-b170-72fbb8737265 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:02.229254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351a40e-dd82-4715-bc6b-35b84f5dbdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:02.230126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351a40e-dd82-4715-bc6b-35b84f5dbdfb None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:02.230419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351a40e-dd82-4715-bc6b-35b84f5dbdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:02.230704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351a40e-dd82-4715-bc6b-35b84f5dbdfb None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:02.231887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351a40e-dd82-4715-bc6b-35b84f5dbdfb None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:02.232444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 61/122] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:02.237140 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c85386-aa55-4947-83c0-e846232efea9 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:02.237305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351a40e-dd82-4715-bc6b-35b84f5dbdfb None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:02.237305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 62/123] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:02 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:02.237305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351a40e-dd82-4715-bc6b-35b84f5dbdfb None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:02.253904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:02.339978 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c85386-aa55-4947-83c0-e846232efea9 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:02.345281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351a40e-dd82-4715-bc6b-35b84f5dbdfb None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:02.357019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:02.375285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66153ff-fb3a-45f7-a52c-199be82d2e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:02.376014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66153ff-fb3a-45f7-a52c-199be82d2e96 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:02.376275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66153ff-fb3a-45f7-a52c-199be82d2e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:02.376557 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66153ff-fb3a-45f7-a52c-199be82d2e96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:02.382063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6086-6296-4008-9e22-2fcce9fc5f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:02.382861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6086-6296-4008-9e22-2fcce9fc5f40 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:02.383147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6086-6296-4008-9e22-2fcce9fc5f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:02.383424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b6086-6296-4008-9e22-2fcce9fc5f40 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:02.388223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66153ff-fb3a-45f7-a52c-199be82d2e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:02.394304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b6086-6296-4008-9e22-2fcce9fc5f40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-b66153ff-fb3a-45f7-a52c-199be82d2e96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:02.396924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:02.397768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:02.398530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 62/124] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:51:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:02.399140 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66153ff-fb3a-45f7-a52c-199be82d2e96 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-ce6b6086-6296-4008-9e22-2fcce9fc5f40 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:02.402193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:02.403343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 63/125] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:02.404298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6086-6296-4008-9e22-2fcce9fc5f40 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:02.489564 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:02.512296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b6086-6296-4008-9e22-2fcce9fc5f40 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:02.514957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66153ff-fb3a-45f7-a52c-199be82d2e96 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:02.548445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69459339-9437-4cdb-add3-2312606e43c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:02.549359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459339-9437-4cdb-add3-2312606e43c2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:02.550190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459339-9437-4cdb-add3-2312606e43c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:02.550473 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69459339-9437-4cdb-add3-2312606e43c2 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:02.551665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69459339-9437-4cdb-add3-2312606e43c2 None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:02.552520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851dd55-c71c-46dd-9c36-ee402dcada5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:02.553150 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69459339-9437-4cdb-add3-2312606e43c2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:02.553465 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851dd55-c71c-46dd-9c36-ee402dcada5b None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:02.553756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851dd55-c71c-46dd-9c36-ee402dcada5b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:02.554039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851dd55-c71c-46dd-9c36-ee402dcada5b None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0/users/9a24de1c35d841e4a22851782428ca15/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:02.554868 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 64/126] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:02 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:02.555608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69459339-9437-4cdb-add3-2312606e43c2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:02.561132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851dd55-c71c-46dd-9c36-ee402dcada5b None admin] RBAC: Authorizing `identity:create_grant(project_id=4ff3c74fe05b404b94de5c9958d7f5d0, user_id=9a24de1c35d841e4a22851782428ca15, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:02.562799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1851dd55-c71c-46dd-9c36-ee402dcada5b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:02.604211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:02.652841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 63/127] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:51:02 2022] PUT /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0/users/9a24de1c35d841e4a22851782428ca15/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:02.652841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851dd55-c71c-46dd-9c36-ee402dcada5b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:02.664631 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69459339-9437-4cdb-add3-2312606e43c2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:02.707407 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202908e-4792-4be6-9b58-0802ce84e11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:02.708627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202908e-4792-4be6-9b58-0802ce84e11e None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:02.708945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202908e-4792-4be6-9b58-0802ce84e11e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:02.710134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202908e-4792-4be6-9b58-0802ce84e11e None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0/users/66aae726fe6c49fe9ae28384be5409f7/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:02.712407 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202908e-4792-4be6-9b58-0802ce84e11e None admin] RBAC: Authorizing `identity:create_grant(project_id=4ff3c74fe05b404b94de5c9958d7f5d0, user_id=66aae726fe6c49fe9ae28384be5409f7, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:02.713961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202908e-4792-4be6-9b58-0802ce84e11e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:02.789292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851dd55-c71c-46dd-9c36-ee402dcada5b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:02.821390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 65/128] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:51:02 2022] PUT /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0/users/66aae726fe6c49fe9ae28384be5409f7/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:02.822528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202908e-4792-4be6-9b58-0802ce84e11e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:02.843162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85506fdd-3afa-4d44-81f0-dcbbf32b71ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:02.844362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85506fdd-3afa-4d44-81f0-dcbbf32b71ce None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:02.844968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85506fdd-3afa-4d44-81f0-dcbbf32b71ce None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:02.845317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85506fdd-3afa-4d44-81f0-dcbbf32b71ce None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:02.846179 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85506fdd-3afa-4d44-81f0-dcbbf32b71ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:02.847222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85506fdd-3afa-4d44-81f0-dcbbf32b71ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:02.848932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85506fdd-3afa-4d44-81f0-dcbbf32b71ce None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:02.852082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:02.866433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 64/129] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:02.866433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85506fdd-3afa-4d44-81f0-dcbbf32b71ce None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:02.957497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:02.962207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202908e-4792-4be6-9b58-0802ce84e11e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:03.000183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdf3d7-9599-42cd-a8b6-dd3d7c03d176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:03.000898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdf3d7-9599-42cd-a8b6-dd3d7c03d176 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:03.001235 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdf3d7-9599-42cd-a8b6-dd3d7c03d176 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:03.001520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bdf3d7-9599-42cd-a8b6-dd3d7c03d176 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:03.002302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdf3d7-9599-42cd-a8b6-dd3d7c03d176 None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:03.003152 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdf3d7-9599-42cd-a8b6-dd3d7c03d176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:03.004707 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bdf3d7-9599-42cd-a8b6-dd3d7c03d176 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:03.014772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 66/130] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:03.016117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdf3d7-9599-42cd-a8b6-dd3d7c03d176 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:03.042900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85506fdd-3afa-4d44-81f0-dcbbf32b71ce None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:03.097819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46513-ef8d-4c89-8eb9-5fda48e54292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:03.098497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46513-ef8d-4c89-8eb9-5fda48e54292 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:03.098791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46513-ef8d-4c89-8eb9-5fda48e54292 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:03.099080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46513-ef8d-4c89-8eb9-5fda48e54292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:03.099941 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f46513-ef8d-4c89-8eb9-5fda48e54292 None admin] RBAC: Adding query filter params (role.id=4817c412bd3c4291b6a5523de64b2729, scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0, user.id=0f097ed400dd477f814e703ee089a915) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:03.100329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f46513-ef8d-4c89-8eb9-5fda48e54292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:03.101897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f46513-ef8d-4c89-8eb9-5fda48e54292 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:03.108043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 65/131] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:02 2022] GET /identity/v3/role_assignments?user.id=0f097ed400dd477f814e703ee089a915&scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0&role.id=4817c412bd3c4291b6a5523de64b2729 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:03.108887 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46513-ef8d-4c89-8eb9-5fda48e54292 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:03.135906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bdf3d7-9599-42cd-a8b6-dd3d7c03d176 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:03.173997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cca011-b989-4056-a8f7-6a7150a83958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:03.175557 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cca011-b989-4056-a8f7-6a7150a83958 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:03.175852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cca011-b989-4056-a8f7-6a7150a83958 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:03.176138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cca011-b989-4056-a8f7-6a7150a83958 None admin] PATH_INFO: `/v3/users/66aae726fe6c49fe9ae28384be5409f7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:03.177446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cca011-b989-4056-a8f7-6a7150a83958 None admin] RBAC: Authorizing `identity:get_user(user_id=66aae726fe6c49fe9ae28384be5409f7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:03.178979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cca011-b989-4056-a8f7-6a7150a83958 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:03.180751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 67/132] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:03 2022] GET /identity/v3/users/66aae726fe6c49fe9ae28384be5409f7 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:03.186680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cca011-b989-4056-a8f7-6a7150a83958 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:03.193072 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:03.238371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:03.239948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46513-ef8d-4c89-8eb9-5fda48e54292 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:03.280307 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb672a-35f4-4b85-ac27-c9379a7e95b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:03.281228 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb672a-35f4-4b85-ac27-c9379a7e95b8 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:03.281516 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb672a-35f4-4b85-ac27-c9379a7e95b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:03.281799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb672a-35f4-4b85-ac27-c9379a7e95b8 None admin] PATH_INFO: `/v3/users/66aae726fe6c49fe9ae28384be5409f7` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:03.286745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb672a-35f4-4b85-ac27-c9379a7e95b8 None admin] RBAC: Authorizing `identity:get_user(user_id=66aae726fe6c49fe9ae28384be5409f7)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:03.288268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb672a-35f4-4b85-ac27-c9379a7e95b8 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:03.291326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 66/133] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:03 2022] GET /identity/v3/users/66aae726fe6c49fe9ae28384be5409f7 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:03.297975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb672a-35f4-4b85-ac27-c9379a7e95b8 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:03.358541 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cca011-b989-4056-a8f7-6a7150a83958 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:03.412863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb672a-35f4-4b85-ac27-c9379a7e95b8 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:03.418632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba79f49-9005-41be-b8d5-b6f46428b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:03.419524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba79f49-9005-41be-b8d5-b6f46428b7ba None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:03.419817 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba79f49-9005-41be-b8d5-b6f46428b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:03.420196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba79f49-9005-41be-b8d5-b6f46428b7ba None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:03.425718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba79f49-9005-41be-b8d5-b6f46428b7ba None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:03.427341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba79f49-9005-41be-b8d5-b6f46428b7ba None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:03.429434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 68/134] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:03 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:03.435289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba79f49-9005-41be-b8d5-b6f46428b7ba None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:03.444216 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:03.456102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856308d-69c4-4d2f-8060-7501fc2e69ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:03.458285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856308d-69c4-4d2f-8060-7501fc2e69ff None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:03.463448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856308d-69c4-4d2f-8060-7501fc2e69ff None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:03.463448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856308d-69c4-4d2f-8060-7501fc2e69ff None admin] PATH_INFO: `/v3/projects/8c009114954c459da45da3213f6e7720` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:03.463448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856308d-69c4-4d2f-8060-7501fc2e69ff None admin] RBAC: Authorizing `identity:get_project(project_id=8c009114954c459da45da3213f6e7720)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:03.465365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8856308d-69c4-4d2f-8060-7501fc2e69ff None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:03.470460 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 67/135] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:03 2022] GET /identity/v3/projects/8c009114954c459da45da3213f6e7720 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:03.478206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856308d-69c4-4d2f-8060-7501fc2e69ff None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:03.585283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:03.593376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba79f49-9005-41be-b8d5-b6f46428b7ba None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:03.609837 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856308d-69c4-4d2f-8060-7501fc2e69ff None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:03.633683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf403a6-c65b-487f-af03-49cb8b82176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:03.635085 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf403a6-c65b-487f-af03-49cb8b82176f None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:03.635689 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf403a6-c65b-487f-af03-49cb8b82176f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:03.636171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf403a6-c65b-487f-af03-49cb8b82176f None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0/users/66aae726fe6c49fe9ae28384be5409f7/roles/d773dfde38e5426799f6b947044767bb` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:03.638841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf403a6-c65b-487f-af03-49cb8b82176f None admin] RBAC: Authorizing `identity:create_grant(project_id=4ff3c74fe05b404b94de5c9958d7f5d0, user_id=66aae726fe6c49fe9ae28384be5409f7, role_id=d773dfde38e5426799f6b947044767bb)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:03.640603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf403a6-c65b-487f-af03-49cb8b82176f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:03.647570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93ac72-f502-4892-aae7-8ccef34f0647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:03.648469 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93ac72-f502-4892-aae7-8ccef34f0647 None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:03.648834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93ac72-f502-4892-aae7-8ccef34f0647 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:03.649255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93ac72-f502-4892-aae7-8ccef34f0647 None admin] PATH_INFO: `/v3/projects/8c009114954c459da45da3213f6e7720/users/66aae726fe6c49fe9ae28384be5409f7/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:03.657074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93ac72-f502-4892-aae7-8ccef34f0647 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c009114954c459da45da3213f6e7720, user_id=66aae726fe6c49fe9ae28384be5409f7, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:03.657074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93ac72-f502-4892-aae7-8ccef34f0647 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:03.712247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 69/136] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:51:03 2022] PUT /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0/users/66aae726fe6c49fe9ae28384be5409f7/roles/d773dfde38e5426799f6b947044767bb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:03.735088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8db899-7a0e-4262-aa84-f6c018036079 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:03.735383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8db899-7a0e-4262-aa84-f6c018036079 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:03.735671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8db899-7a0e-4262-aa84-f6c018036079 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:03.737775 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 70/137] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:51:03.743843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c48a3-aa10-4bf4-8973-024034457885 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:03.746512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c48a3-aa10-4bf4-8973-024034457885 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:03.746512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c48a3-aa10-4bf4-8973-024034457885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:03.749377 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 68/138] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:51:03 2022] PUT /identity/v3/projects/8c009114954c459da45da3213f6e7720/users/66aae726fe6c49fe9ae28384be5409f7/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:03.764611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f42c48a3-aa10-4bf4-8973-024034457885 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:03.766176 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f42c48a3-aa10-4bf4-8973-024034457885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:03.848856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 71/139] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:03.885259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93ac72-f502-4892-aae7-8ccef34f0647 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:03.972580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:04.028646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93ac72-f502-4892-aae7-8ccef34f0647 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:04.108833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083af61-ca44-44b4-ba93-6c7abeeabf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:04.108833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083af61-ca44-44b4-ba93-6c7abeeabf1e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:04.108833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083af61-ca44-44b4-ba93-6c7abeeabf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:04.108833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083af61-ca44-44b4-ba93-6c7abeeabf1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:04.109246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083af61-ca44-44b4-ba93-6c7abeeabf1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:04.109699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083af61-ca44-44b4-ba93-6c7abeeabf1e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:04.111647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 69/140] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:04.117194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c48a3-aa10-4bf4-8973-024034457885 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:04.321956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:04.340617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c48a3-aa10-4bf4-8973-024034457885 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:04.406594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bfe90-fc99-4aba-8772-e551c7646b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:04.407288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bfe90-fc99-4aba-8772-e551c7646b04 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:04.407583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bfe90-fc99-4aba-8772-e551c7646b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:04.407868 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bfe90-fc99-4aba-8772-e551c7646b04 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:04.408610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bfe90-fc99-4aba-8772-e551c7646b04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:04.410419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6bfe90-fc99-4aba-8772-e551c7646b04 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:04.519908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 72/141] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:51:04 2022] POST /identity/v3/users => generated 283 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:51:05.594995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e4f60-66ea-4e9a-9980-de3f33c4a394 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:05.595519 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e4f60-66ea-4e9a-9980-de3f33c4a394 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:05.595596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e4f60-66ea-4e9a-9980-de3f33c4a394 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:05.597857 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 70/142] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:05.608870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3366b05-1306-4e6f-9d22-d9b548d1d97b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:05.609325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3366b05-1306-4e6f-9d22-d9b548d1d97b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:05.609490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3366b05-1306-4e6f-9d22-d9b548d1d97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:05.629979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a3366b05-1306-4e6f-9d22-d9b548d1d97b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:05.631201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a3366b05-1306-4e6f-9d22-d9b548d1d97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:05.720653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 73/143] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:05.760947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e4f60-66ea-4e9a-9980-de3f33c4a394 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:05.905101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e4f60-66ea-4e9a-9980-de3f33c4a394 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:05.932455 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:05.946108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd989a8-b095-4833-9da2-cba7e602ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:05.946914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd989a8-b095-4833-9da2-cba7e602ffbe None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:05.948417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd989a8-b095-4833-9da2-cba7e602ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:05.948417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd989a8-b095-4833-9da2-cba7e602ffbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:05.962075 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd989a8-b095-4833-9da2-cba7e602ffbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-efd989a8-b095-4833-9da2-cba7e602ffbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:05.970065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:05.970960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:05.972308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 71/144] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:51:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:05.980476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3366b05-1306-4e6f-9d22-d9b548d1d97b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:06.077179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:06.109898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3366b05-1306-4e6f-9d22-d9b548d1d97b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:06.149505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f337762-69d3-4226-a36f-74170d6d80ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:06.150109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337762-69d3-4226-a36f-74170d6d80ed None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:06.150401 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337762-69d3-4226-a36f-74170d6d80ed None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:06.150687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f337762-69d3-4226-a36f-74170d6d80ed None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:06.151466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337762-69d3-4226-a36f-74170d6d80ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:06.151780 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337762-69d3-4226-a36f-74170d6d80ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:06.153201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f337762-69d3-4226-a36f-74170d6d80ed None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:06.165145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 74/145] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:06.168127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd989a8-b095-4833-9da2-cba7e602ffbe None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:06.184932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc091c2-c9c9-48fd-b636-252a057b1716 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:06.185239 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc091c2-c9c9-48fd-b636-252a057b1716 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:06.185474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc091c2-c9c9-48fd-b636-252a057b1716 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:06.187185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 75/146] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:06.192747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06cb61-d2cf-48d5-b5bb-13233484f0de None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:06.193097 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06cb61-d2cf-48d5-b5bb-13233484f0de None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:06.194075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06cb61-d2cf-48d5-b5bb-13233484f0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:06.213836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8c06cb61-d2cf-48d5-b5bb-13233484f0de None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:06.215093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8c06cb61-d2cf-48d5-b5bb-13233484f0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:06.302850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 76/147] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:06.344187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06cb61-d2cf-48d5-b5bb-13233484f0de None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:06.415243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd989a8-b095-4833-9da2-cba7e602ffbe None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:06.458708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:06.465308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614005cb-254e-46f9-8bac-b638b81ee8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:06.466206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614005cb-254e-46f9-8bac-b638b81ee8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:06.466495 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614005cb-254e-46f9-8bac-b638b81ee8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:06.466771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614005cb-254e-46f9-8bac-b638b81ee8a3 None admin] PATH_INFO: `/v3/users/9a24de1c35d841e4a22851782428ca15` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:06.468019 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614005cb-254e-46f9-8bac-b638b81ee8a3 None admin] RBAC: Authorizing `identity:get_user(user_id=9a24de1c35d841e4a22851782428ca15)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:06.469505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614005cb-254e-46f9-8bac-b638b81ee8a3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:06.471568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 72/148] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:06 2022] GET /identity/v3/users/9a24de1c35d841e4a22851782428ca15 => generated 247 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:06.473264 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe179fb9-2a20-4bc0-9ecb-f514b4e49627 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:06.473549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe179fb9-2a20-4bc0-9ecb-f514b4e49627 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:06.473893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe179fb9-2a20-4bc0-9ecb-f514b4e49627 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:06.475321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 73/149] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:06.480536 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe179fb9-2a20-4bc0-9ecb-f514b4e49627 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:06.538519 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06cb61-d2cf-48d5-b5bb-13233484f0de None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:06.600087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:06.602941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932e9f8-9a2d-40ea-83e9-4810d7ff23c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:06.603822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932e9f8-9a2d-40ea-83e9-4810d7ff23c9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:06.604115 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932e9f8-9a2d-40ea-83e9-4810d7ff23c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:06.604393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932e9f8-9a2d-40ea-83e9-4810d7ff23c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:06.618669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932e9f8-9a2d-40ea-83e9-4810d7ff23c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-2932e9f8-9a2d-40ea-83e9-4810d7ff23c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:06.631219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:06.632120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:06.632897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 77/150] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:06.634281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40738512-0209-4e00-a295-c3eb8cba6b25 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:06.634281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40738512-0209-4e00-a295-c3eb8cba6b25 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:06.634520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40738512-0209-4e00-a295-c3eb8cba6b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:06.663517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-40738512-0209-4e00-a295-c3eb8cba6b25 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:06.664747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-40738512-0209-4e00-a295-c3eb8cba6b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:06.722169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe179fb9-2a20-4bc0-9ecb-f514b4e49627 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:06.738434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 78/151] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:06.739298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40738512-0209-4e00-a295-c3eb8cba6b25 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:06.797559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621e682-d2c3-4037-a1cc-629c55308228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:06.798242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621e682-d2c3-4037-a1cc-629c55308228 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:06.798534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621e682-d2c3-4037-a1cc-629c55308228 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:06.798820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621e682-d2c3-4037-a1cc-629c55308228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:06.804486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:06.856154 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40738512-0209-4e00-a295-c3eb8cba6b25 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:06.895148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359f87b-3861-4076-b717-6eb02aab2647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:06.895838 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359f87b-3861-4076-b717-6eb02aab2647 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:06.896125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359f87b-3861-4076-b717-6eb02aab2647 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:06.896417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359f87b-3861-4076-b717-6eb02aab2647 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:06.897202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359f87b-3861-4076-b717-6eb02aab2647 None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:06.897517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359f87b-3861-4076-b717-6eb02aab2647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:06.898914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359f87b-3861-4076-b717-6eb02aab2647 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:06.907961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 79/152] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:06.908925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359f87b-3861-4076-b717-6eb02aab2647 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:06.951090 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621e682-d2c3-4037-a1cc-629c55308228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:06.952588 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621e682-d2c3-4037-a1cc-629c55308228 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:07.016000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359f87b-3861-4076-b717-6eb02aab2647 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:07.042421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:07.064892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ddb69-169e-4a91-ad82-08120a1cbca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:07.065816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ddb69-169e-4a91-ad82-08120a1cbca8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:07.066108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ddb69-169e-4a91-ad82-08120a1cbca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:07.066390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ddb69-169e-4a91-ad82-08120a1cbca8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:07.068272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:07.079411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298ddb69-169e-4a91-ad82-08120a1cbca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-298ddb69-169e-4a91-ad82-08120a1cbca8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:07.088301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:07.089413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:07.090260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 80/153] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:07.090888 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ddb69-169e-4a91-ad82-08120a1cbca8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:07.142232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 74/154] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:07.143729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621e682-d2c3-4037-a1cc-629c55308228 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:07.211101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ddb69-169e-4a91-ad82-08120a1cbca8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:07.248472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bd229-ea5f-4efc-b930-d494d2f942ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:07.249573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bd229-ea5f-4efc-b930-d494d2f942ee None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:07.249863 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bd229-ea5f-4efc-b930-d494d2f942ee None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:07.250148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bd229-ea5f-4efc-b930-d494d2f942ee None admin] PATH_INFO: `/v3/users/66aae726fe6c49fe9ae28384be5409f7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:07.251483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bd229-ea5f-4efc-b930-d494d2f942ee None admin] RBAC: Authorizing `identity:get_user(user_id=66aae726fe6c49fe9ae28384be5409f7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:07.253663 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bd229-ea5f-4efc-b930-d494d2f942ee None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:07.255637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 81/155] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:07 2022] GET /identity/v3/users/66aae726fe6c49fe9ae28384be5409f7 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:07.256504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bd229-ea5f-4efc-b930-d494d2f942ee None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:07.289656 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621e682-d2c3-4037-a1cc-629c55308228 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:07.329216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:07.368607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9691fae-3b57-4d1a-935d-8c7058837399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:07.369315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9691fae-3b57-4d1a-935d-8c7058837399 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:07.369601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9691fae-3b57-4d1a-935d-8c7058837399 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:07.369883 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9691fae-3b57-4d1a-935d-8c7058837399 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:07.370651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9691fae-3b57-4d1a-935d-8c7058837399 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:07.370961 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9691fae-3b57-4d1a-935d-8c7058837399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:07.374891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9691fae-3b57-4d1a-935d-8c7058837399 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:07.396308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 75/156] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:07.398238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9691fae-3b57-4d1a-935d-8c7058837399 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:07.416932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:07.448733 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bd229-ea5f-4efc-b930-d494d2f942ee None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:07.510199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9691fae-3b57-4d1a-935d-8c7058837399 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:07.534988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612921b-4da2-491b-8edd-d82db64ab42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:07.536261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612921b-4da2-491b-8edd-d82db64ab42f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:07.536769 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612921b-4da2-491b-8edd-d82db64ab42f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:07.537271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612921b-4da2-491b-8edd-d82db64ab42f None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:07.541649 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612921b-4da2-491b-8edd-d82db64ab42f None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:07.543342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612921b-4da2-491b-8edd-d82db64ab42f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:07.545321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 82/157] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:07 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:07.546746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2406a-45bc-4021-9b92-d28d347a7ae2 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:07.547233 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2406a-45bc-4021-9b92-d28d347a7ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:07.547770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2406a-45bc-4021-9b92-d28d347a7ae2 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:07.549800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 83/158] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:07.550713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2406a-45bc-4021-9b92-d28d347a7ae2 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:07.557047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc6dac-cfef-40d3-a30e-807d7fe2bbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:07.557047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6dac-cfef-40d3-a30e-807d7fe2bbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:07.557047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6dac-cfef-40d3-a30e-807d7fe2bbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:07.557047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc6dac-cfef-40d3-a30e-807d7fe2bbe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:07.635201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc6dac-cfef-40d3-a30e-807d7fe2bbe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:07.636750 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc6dac-cfef-40d3-a30e-807d7fe2bbe9 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:07.656510 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:07.756953 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 76/159] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:07.758739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc612df-b966-4f13-9088-0882f813894c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:07.759258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc612df-b966-4f13-9088-0882f813894c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:07.759742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc612df-b966-4f13-9088-0882f813894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:07.779083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ebc612df-b966-4f13-9088-0882f813894c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:07.780743 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ebc612df-b966-4f13-9088-0882f813894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:07.817638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2406a-45bc-4021-9b92-d28d347a7ae2 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:07.839208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:07.858412 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 77/160] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:07.859617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc612df-b966-4f13-9088-0882f813894c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:07.898436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7900-3e35-4dce-b14a-c0aec4707ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:07.899329 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7900-3e35-4dce-b14a-c0aec4707ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:07.899613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7900-3e35-4dce-b14a-c0aec4707ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:07.899894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f7900-3e35-4dce-b14a-c0aec4707ad8 None admin] PATH_INFO: `/v3/users/0f097ed400dd477f814e703ee089a915` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:07.901220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f7900-3e35-4dce-b14a-c0aec4707ad8 None admin] RBAC: Authorizing `identity:get_user(user_id=0f097ed400dd477f814e703ee089a915)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:07.902577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f7900-3e35-4dce-b14a-c0aec4707ad8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:07.909080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 84/161] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:07 2022] GET /identity/v3/users/0f097ed400dd477f814e703ee089a915 => generated 289 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:07.909936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7900-3e35-4dce-b14a-c0aec4707ad8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:07.915294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:07.976247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc612df-b966-4f13-9088-0882f813894c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:08.016255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f6a2e-dedd-49f0-b116-5bd91ed49737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:08.017367 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f6a2e-dedd-49f0-b116-5bd91ed49737 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:08.018055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f6a2e-dedd-49f0-b116-5bd91ed49737 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:08.018539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f6a2e-dedd-49f0-b116-5bd91ed49737 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:08.019684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f6a2e-dedd-49f0-b116-5bd91ed49737 None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0, user.id=9a24de1c35d841e4a22851782428ca15) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:08.020229 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f6a2e-dedd-49f0-b116-5bd91ed49737 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:08.022037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f6a2e-dedd-49f0-b116-5bd91ed49737 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:08.029454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 78/162] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:07 2022] GET /identity/v3/role_assignments?user.id=9a24de1c35d841e4a22851782428ca15&scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:08.031080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1ed0c-6ce5-4c62-9ad8-868e6ef78dd0 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:08.037166 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1ed0c-6ce5-4c62-9ad8-868e6ef78dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:08.037877 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1ed0c-6ce5-4c62-9ad8-868e6ef78dd0 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:08.039842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 79/163] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:08.040934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1ed0c-6ce5-4c62-9ad8-868e6ef78dd0 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:08.043810 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f7900-3e35-4dce-b14a-c0aec4707ad8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:08.088638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e483695-5939-47ba-841c-09b05c373dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:08.089490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e483695-5939-47ba-841c-09b05c373dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:08.089773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e483695-5939-47ba-841c-09b05c373dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:08.090048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e483695-5939-47ba-841c-09b05c373dd6 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:08.091321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e483695-5939-47ba-841c-09b05c373dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:08.092876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e483695-5939-47ba-841c-09b05c373dd6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:08.099560 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 85/164] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:07 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:08.100349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e483695-5939-47ba-841c-09b05c373dd6 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:08.202554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:08.293245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e483695-5939-47ba-841c-09b05c373dd6 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:08.349105 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef267f-a267-4ee8-8b8d-98c0ef654676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:08.350335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef267f-a267-4ee8-8b8d-98c0ef654676 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:08.350824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef267f-a267-4ee8-8b8d-98c0ef654676 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:08.351315 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef267f-a267-4ee8-8b8d-98c0ef654676 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:08.359818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1ed0c-6ce5-4c62-9ad8-868e6ef78dd0 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:08.367895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef267f-a267-4ee8-8b8d-98c0ef654676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-13ef267f-a267-4ee8-8b8d-98c0ef654676 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:08.378384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:08.379281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:08.380053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:08.380053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:08.380053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:08.380053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:08.380053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:08.380053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:08.380053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:08.380053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:08.380053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:08.380053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:08.380053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:08.380053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:08.382652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:08.384745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 86/165] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:51:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:08.386394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e60cb-4115-4365-b9a1-4fee1fc86e4c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:08.387049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e60cb-4115-4365-b9a1-4fee1fc86e4c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:08.387528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e60cb-4115-4365-b9a1-4fee1fc86e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:08.409189 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-eb4e60cb-4115-4365-b9a1-4fee1fc86e4c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:08.410879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-eb4e60cb-4115-4365-b9a1-4fee1fc86e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:08.434956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ac1ca-59c0-4406-b206-c5c6b09667a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:08.436134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ac1ca-59c0-4406-b206-c5c6b09667a2 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:08.436421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ac1ca-59c0-4406-b206-c5c6b09667a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:08.436700 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ac1ca-59c0-4406-b206-c5c6b09667a2 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:08.440258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ac1ca-59c0-4406-b206-c5c6b09667a2 None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:08.442057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ac1ca-59c0-4406-b206-c5c6b09667a2 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:08.448036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 80/166] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:08 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:08.448036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ac1ca-59c0-4406-b206-c5c6b09667a2 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:08.528827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 87/167] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:08.532036 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e60cb-4115-4365-b9a1-4fee1fc86e4c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:08.604050 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:08.630122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ac1ca-59c0-4406-b206-c5c6b09667a2 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:08.699207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e66b2e-2a13-44f0-9c17-7c0a4293d189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:08.699952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e66b2e-2a13-44f0-9c17-7c0a4293d189 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:08.700153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e66b2e-2a13-44f0-9c17-7c0a4293d189 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:08.700434 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e66b2e-2a13-44f0-9c17-7c0a4293d189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:08.701305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e66b2e-2a13-44f0-9c17-7c0a4293d189 None admin] RBAC: Adding query filter params (role.id=3d2f155e5f1f4acbaff64a9c464d9d92, scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0, user.id=66aae726fe6c49fe9ae28384be5409f7) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:08.701624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e66b2e-2a13-44f0-9c17-7c0a4293d189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:08.703083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e66b2e-2a13-44f0-9c17-7c0a4293d189 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:08.716994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 81/168] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:08 2022] GET /identity/v3/role_assignments?user.id=66aae726fe6c49fe9ae28384be5409f7&scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0&role.id=3d2f155e5f1f4acbaff64a9c464d9d92 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:08.717862 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e66b2e-2a13-44f0-9c17-7c0a4293d189 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:08.723028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e60cb-4115-4365-b9a1-4fee1fc86e4c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:08.762885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1866f7-cdb6-4b3b-aaca-f2a554fe8cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:08.763596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1866f7-cdb6-4b3b-aaca-f2a554fe8cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:08.763887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1866f7-cdb6-4b3b-aaca-f2a554fe8cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:08.764172 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1866f7-cdb6-4b3b-aaca-f2a554fe8cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:08.765008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1866f7-cdb6-4b3b-aaca-f2a554fe8cb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:08.765324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1866f7-cdb6-4b3b-aaca-f2a554fe8cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:08.769153 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1866f7-cdb6-4b3b-aaca-f2a554fe8cb7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:08.778296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 88/169] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:08.779076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1866f7-cdb6-4b3b-aaca-f2a554fe8cb7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:08.847262 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:08.953364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:08.957830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1866f7-cdb6-4b3b-aaca-f2a554fe8cb7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:08.977389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e66b2e-2a13-44f0-9c17-7c0a4293d189 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:09.032063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b158809-9823-4997-b5d9-4856e6616bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:09.034152 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b158809-9823-4997-b5d9-4856e6616bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.037286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b158809-9823-4997-b5d9-4856e6616bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.037805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b158809-9823-4997-b5d9-4856e6616bc1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.054370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb466ef-ec97-4f56-b980-3ff77a100bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:09.055787 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb466ef-ec97-4f56-b980-3ff77a100bb7 None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.057088 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb466ef-ec97-4f56-b980-3ff77a100bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.059456 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb466ef-ec97-4f56-b980-3ff77a100bb7 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0/users/0f097ed400dd477f814e703ee089a915/roles/4817c412bd3c4291b6a5523de64b2729` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.061693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b158809-9823-4997-b5d9-4856e6616bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:09.062759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb466ef-ec97-4f56-b980-3ff77a100bb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ff3c74fe05b404b94de5c9958d7f5d0, user_id=0f097ed400dd477f814e703ee089a915, role_id=4817c412bd3c4291b6a5523de64b2729)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:09.067210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb466ef-ec97-4f56-b980-3ff77a100bb7 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-8b158809-9823-4997-b5d9-4856e6616bc1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:09.077957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:09.078935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:09.079720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:09.079720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:09.079720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:09.079720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:09.079720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:09.079720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:09.079720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:09.079720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:09.079720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:09.079720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:09.079720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:09.079720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:09.083195 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 89/170] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:09.087165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b158809-9823-4997-b5d9-4856e6616bc1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:09.141220 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 82/171] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:51:08 2022] PUT /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0/users/0f097ed400dd477f814e703ee089a915/roles/4817c412bd3c4291b6a5523de64b2729 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:09.142466 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb466ef-ec97-4f56-b980-3ff77a100bb7 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:09.259598 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b158809-9823-4997-b5d9-4856e6616bc1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:09.297859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f348c6-2401-482d-9fb6-564f829ad070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:09.298772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f348c6-2401-482d-9fb6-564f829ad070 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.299108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f348c6-2401-482d-9fb6-564f829ad070 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.299449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f348c6-2401-482d-9fb6-564f829ad070 None admin] PATH_INFO: `/v3/users/66aae726fe6c49fe9ae28384be5409f7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.300737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f348c6-2401-482d-9fb6-564f829ad070 None admin] RBAC: Authorizing `identity:get_user(user_id=66aae726fe6c49fe9ae28384be5409f7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:09.302253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f348c6-2401-482d-9fb6-564f829ad070 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:09.304129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 90/172] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:09 2022] GET /identity/v3/users/66aae726fe6c49fe9ae28384be5409f7 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:09.306208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49409e5-50e0-40e3-8bc6-aa3156ba66c8 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.306501 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49409e5-50e0-40e3-8bc6-aa3156ba66c8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.306786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49409e5-50e0-40e3-8bc6-aa3156ba66c8 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.308106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 91/173] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:09.312856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1cf0f-3b72-4a53-821b-7838e88b193b None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.312856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1cf0f-3b72-4a53-821b-7838e88b193b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.312856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1cf0f-3b72-4a53-821b-7838e88b193b None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.312856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 92/174] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:09.312856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1cf0f-3b72-4a53-821b-7838e88b193b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:09.339050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb466ef-ec97-4f56-b980-3ff77a100bb7 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:09.347566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:09.350000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:09.382752 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb6d71-a087-4d40-93c2-bb881bfd65c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:09.383439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb6d71-a087-4d40-93c2-bb881bfd65c3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.383730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb6d71-a087-4d40-93c2-bb881bfd65c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.384039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb6d71-a087-4d40-93c2-bb881bfd65c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.384781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb6d71-a087-4d40-93c2-bb881bfd65c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:09.385219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb6d71-a087-4d40-93c2-bb881bfd65c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:09.386658 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb6d71-a087-4d40-93c2-bb881bfd65c3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:09.397567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 83/175] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:09.398704 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae970-9239-4783-8e2d-52251c04034f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.398995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae970-9239-4783-8e2d-52251c04034f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.399274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ae970-9239-4783-8e2d-52251c04034f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.417001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-6a7ae970-9239-4783-8e2d-52251c04034f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:09.418290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6a7ae970-9239-4783-8e2d-52251c04034f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:09.441082 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1cf0f-3b72-4a53-821b-7838e88b193b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:09.477289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a93fd-19e5-48cd-b80d-afcba0ad27d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:09.478054 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a93fd-19e5-48cd-b80d-afcba0ad27d2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.478343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a93fd-19e5-48cd-b80d-afcba0ad27d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.478621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a93fd-19e5-48cd-b80d-afcba0ad27d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.504830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 84/176] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:09.504830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218dcb-04ab-4c42-ab96-732941a05b4f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.504830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218dcb-04ab-4c42-ab96-732941a05b4f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.504830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218dcb-04ab-4c42-ab96-732941a05b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.519534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d4218dcb-04ab-4c42-ab96-732941a05b4f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:09.520953 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d4218dcb-04ab-4c42-ab96-732941a05b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:09.559398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a93fd-19e5-48cd-b80d-afcba0ad27d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:09.560899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a93fd-19e5-48cd-b80d-afcba0ad27d2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:09.589707 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:09.598429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 85/177] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:09.599609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b1a5-ae0b-467d-a8ae-0469506633ab None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.599902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b1a5-ae0b-467d-a8ae-0469506633ab None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.600181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b1a5-ae0b-467d-a8ae-0469506633ab None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.605851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 86/178] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:09.606626 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69b1a5-ae0b-467d-a8ae-0469506633ab None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:09.636902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:09.675207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 93/179] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:09.676001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a93fd-19e5-48cd-b80d-afcba0ad27d2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:09.730058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69b1a5-ae0b-467d-a8ae-0469506633ab None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:09.767494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa3c19-5029-45c4-8996-033f8e37a88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:09.769220 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa3c19-5029-45c4-8996-033f8e37a88b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.769574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa3c19-5029-45c4-8996-033f8e37a88b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.769952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa3c19-5029-45c4-8996-033f8e37a88b None admin] PATH_INFO: `/v3/users/66aae726fe6c49fe9ae28384be5409f7` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.771925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa3c19-5029-45c4-8996-033f8e37a88b None admin] RBAC: Authorizing `identity:get_user(user_id=66aae726fe6c49fe9ae28384be5409f7)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:09.774548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa3c19-5029-45c4-8996-033f8e37a88b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:09.777485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 87/180] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:09 2022] GET /identity/v3/users/66aae726fe6c49fe9ae28384be5409f7 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:09.779433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41461b1f-6631-484e-88ef-255d9c225d27 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.779906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41461b1f-6631-484e-88ef-255d9c225d27 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.780371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41461b1f-6631-484e-88ef-255d9c225d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.790079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a93fd-19e5-48cd-b80d-afcba0ad27d2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:09.801065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-41461b1f-6631-484e-88ef-255d9c225d27 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:09.802245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-41461b1f-6631-484e-88ef-255d9c225d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:09.818839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:09.826841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87d9a1-f85c-4e26-84a3-1c64f946234e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:09.827642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87d9a1-f85c-4e26-84a3-1c64f946234e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:09.827925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87d9a1-f85c-4e26-84a3-1c64f946234e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:09.828201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba87d9a1-f85c-4e26-84a3-1c64f946234e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:09.839424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba87d9a1-f85c-4e26-84a3-1c64f946234e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-ba87d9a1-f85c-4e26-84a3-1c64f946234e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:09.847794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:09.848701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:09.849537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 94/181] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:09.852830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87d9a1-f85c-4e26-84a3-1c64f946234e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:09.884839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 88/182] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:09.884839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41461b1f-6631-484e-88ef-255d9c225d27 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:09.907872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:09.981962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba87d9a1-f85c-4e26-84a3-1c64f946234e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:09.992136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41461b1f-6631-484e-88ef-255d9c225d27 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:10.016905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19719b-9148-4318-af38-b6e3de9a071e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:10.017745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19719b-9148-4318-af38-b6e3de9a071e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:10.018084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19719b-9148-4318-af38-b6e3de9a071e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:10.018341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19719b-9148-4318-af38-b6e3de9a071e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:10.028187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1347d0-efe1-4972-b6fb-4f93415c550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:10.028317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19719b-9148-4318-af38-b6e3de9a071e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:10.029078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1347d0-efe1-4972-b6fb-4f93415c550c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:10.029367 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1347d0-efe1-4972-b6fb-4f93415c550c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:10.029638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1347d0-efe1-4972-b6fb-4f93415c550c None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:10.030801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1347d0-efe1-4972-b6fb-4f93415c550c None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:10.032254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1347d0-efe1-4972-b6fb-4f93415c550c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:10.038988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 89/183] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:09 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:10.038988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1347d0-efe1-4972-b6fb-4f93415c550c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-ba19719b-9148-4318-af38-b6e3de9a071e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:10.039192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:10.040006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 95/184] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:51:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:10.040831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19719b-9148-4318-af38-b6e3de9a071e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:10.091389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:10.136830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:10.143608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19719b-9148-4318-af38-b6e3de9a071e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:10.146627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1347d0-efe1-4972-b6fb-4f93415c550c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:10.179773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a5ac-8a74-479d-abdc-14ea47d108dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:10.180882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a5ac-8a74-479d-abdc-14ea47d108dd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:10.181070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b90e49-87ed-45f9-866f-2d0f1ff0b13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:10.181498 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a5ac-8a74-479d-abdc-14ea47d108dd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:10.181716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b90e49-87ed-45f9-866f-2d0f1ff0b13c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:10.181997 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b90e49-87ed-45f9-866f-2d0f1ff0b13c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:10.182224 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a5ac-8a74-479d-abdc-14ea47d108dd None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:10.182326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b90e49-87ed-45f9-866f-2d0f1ff0b13c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:10.183318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991a5ac-8a74-479d-abdc-14ea47d108dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:10.183771 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991a5ac-8a74-479d-abdc-14ea47d108dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:10.185468 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991a5ac-8a74-479d-abdc-14ea47d108dd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:10.195116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 96/185] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:10.196114 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a5ac-8a74-479d-abdc-14ea47d108dd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:10.257898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b90e49-87ed-45f9-866f-2d0f1ff0b13c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:10.259300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b90e49-87ed-45f9-866f-2d0f1ff0b13c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:10.307404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a5ac-8a74-479d-abdc-14ea47d108dd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:10.318596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:10.343528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d8171-b4f9-4d40-9c4a-62743396e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:10.344683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d8171-b4f9-4d40-9c4a-62743396e613 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:10.345003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d8171-b4f9-4d40-9c4a-62743396e613 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:10.345289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d8171-b4f9-4d40-9c4a-62743396e613 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:10.346674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d8171-b4f9-4d40-9c4a-62743396e613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:10.348186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d8171-b4f9-4d40-9c4a-62743396e613 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:10.349866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 97/186] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:10.350632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d8171-b4f9-4d40-9c4a-62743396e613 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:10.357682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:10.373101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 90/187] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:10.373101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b90e49-87ed-45f9-866f-2d0f1ff0b13c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:10.459430 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d8171-b4f9-4d40-9c4a-62743396e613 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:10.476700 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b90e49-87ed-45f9-866f-2d0f1ff0b13c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:10.493562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a71305-f5a1-4259-b65b-291474eee7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:10.494307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a71305-f5a1-4259-b65b-291474eee7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:10.494640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a71305-f5a1-4259-b65b-291474eee7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:10.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a71305-f5a1-4259-b65b-291474eee7a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:10.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a71305-f5a1-4259-b65b-291474eee7a7 None admin] RBAC: Adding query filter params (role.id=d773dfde38e5426799f6b947044767bb, scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0, user.id=66aae726fe6c49fe9ae28384be5409f7) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:10.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a71305-f5a1-4259-b65b-291474eee7a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:10.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a71305-f5a1-4259-b65b-291474eee7a7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:10.503829 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 98/188] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:10 2022] GET /identity/v3/role_assignments?user.id=66aae726fe6c49fe9ae28384be5409f7&scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0&role.id=d773dfde38e5426799f6b947044767bb => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:10.504608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a71305-f5a1-4259-b65b-291474eee7a7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:10.527032 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59c25f-b08a-4378-a702-7026b2d0d7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:10.528121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59c25f-b08a-4378-a702-7026b2d0d7cd None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:10.528481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59c25f-b08a-4378-a702-7026b2d0d7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:10.528861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59c25f-b08a-4378-a702-7026b2d0d7cd None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:10.529807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59c25f-b08a-4378-a702-7026b2d0d7cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:10.530190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59c25f-b08a-4378-a702-7026b2d0d7cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:10.531797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59c25f-b08a-4378-a702-7026b2d0d7cd None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:10.547842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 91/189] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:10.550118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59c25f-b08a-4378-a702-7026b2d0d7cd None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:10.571809 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:10.616832 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:10.639549 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a71305-f5a1-4259-b65b-291474eee7a7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:10.677798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59c25f-b08a-4378-a702-7026b2d0d7cd None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:10.680896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c7236-abac-40c5-98c9-3f5dca379696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:10.682586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c7236-abac-40c5-98c9-3f5dca379696 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:10.683030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c7236-abac-40c5-98c9-3f5dca379696 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:10.683437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c7236-abac-40c5-98c9-3f5dca379696 None admin] PATH_INFO: `/v3/users/ff9f02c9476842aa8f0ebdb4b5310974` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:10.699481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c7236-abac-40c5-98c9-3f5dca379696 None admin] RBAC: Authorizing `identity:get_user(user_id=ff9f02c9476842aa8f0ebdb4b5310974)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:10.701230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c7236-abac-40c5-98c9-3f5dca379696 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:10.703410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 99/190] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:10 2022] GET /identity/v3/users/ff9f02c9476842aa8f0ebdb4b5310974 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:10.704344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c7236-abac-40c5-98c9-3f5dca379696 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:10.725679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bb778-c72f-4c0c-8ef1-b9fcad39e704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:10.726366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bb778-c72f-4c0c-8ef1-b9fcad39e704 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:10.726653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bb778-c72f-4c0c-8ef1-b9fcad39e704 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:10.726932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684bb778-c72f-4c0c-8ef1-b9fcad39e704 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:10.727651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bb778-c72f-4c0c-8ef1-b9fcad39e704 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:10.729148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684bb778-c72f-4c0c-8ef1-b9fcad39e704 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:10.816968 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:10.820250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c7236-abac-40c5-98c9-3f5dca379696 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:10.836635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 92/191] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:51:10 2022] POST /identity/v3/users => generated 297 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:51:10.838041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bb778-c72f-4c0c-8ef1-b9fcad39e704 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:10.870024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a80e3a-696f-426f-a699-ef8e1cded4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:10.871364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a80e3a-696f-426f-a699-ef8e1cded4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:10.871756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a80e3a-696f-426f-a699-ef8e1cded4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:10.871952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a80e3a-696f-426f-a699-ef8e1cded4f6 None admin] PATH_INFO: `/v3/projects/8c009114954c459da45da3213f6e7720` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:10.873518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a80e3a-696f-426f-a699-ef8e1cded4f6 None admin] RBAC: Authorizing `identity:get_project(project_id=8c009114954c459da45da3213f6e7720)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:10.874981 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a80e3a-696f-426f-a699-ef8e1cded4f6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:10.883411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 100/192] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:10 2022] GET /identity/v3/projects/8c009114954c459da45da3213f6e7720 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:10.883411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a80e3a-696f-426f-a699-ef8e1cded4f6 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:11.007734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a80e3a-696f-426f-a699-ef8e1cded4f6 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:11.018400 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684bb778-c72f-4c0c-8ef1-b9fcad39e704 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:11.030630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:11.055379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c77d9-a5aa-4792-9c3f-086dea515b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:11.056055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c77d9-a5aa-4792-9c3f-086dea515b08 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:11.056340 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c77d9-a5aa-4792-9c3f-086dea515b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:11.066904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c77d9-a5aa-4792-9c3f-086dea515b08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:11.067100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1d8b8-1267-43c6-b2b0-e83cbd28cce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:11.067100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d8b8-1267-43c6-b2b0-e83cbd28cce2 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:11.067100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d8b8-1267-43c6-b2b0-e83cbd28cce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:11.067100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1d8b8-1267-43c6-b2b0-e83cbd28cce2 None admin] PATH_INFO: `/v3/users/ff9f02c9476842aa8f0ebdb4b5310974` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:11.067430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1d8b8-1267-43c6-b2b0-e83cbd28cce2 None admin] RBAC: Authorizing `identity:get_user(user_id=ff9f02c9476842aa8f0ebdb4b5310974)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:11.069025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1d8b8-1267-43c6-b2b0-e83cbd28cce2 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:11.071108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 93/193] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:10 2022] GET /identity/v3/users/ff9f02c9476842aa8f0ebdb4b5310974 => generated 283 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:11.072012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1d8b8-1267-43c6-b2b0-e83cbd28cce2 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:11.106867 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:11.151561 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c77d9-a5aa-4792-9c3f-086dea515b08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:11.153382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c77d9-a5aa-4792-9c3f-086dea515b08 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:11.213467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1d8b8-1267-43c6-b2b0-e83cbd28cce2 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:11.261878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8476171-03a4-4d77-b2cc-e9d346b19a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:11.262951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8476171-03a4-4d77-b2cc-e9d346b19a31 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:11.263240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8476171-03a4-4d77-b2cc-e9d346b19a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:11.263789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8476171-03a4-4d77-b2cc-e9d346b19a31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:11.264645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8476171-03a4-4d77-b2cc-e9d346b19a31 None admin] RBAC: Adding query filter params (role.id=3d2f155e5f1f4acbaff64a9c464d9d92, scope.project.id=8c009114954c459da45da3213f6e7720, user.id=66aae726fe6c49fe9ae28384be5409f7) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:11.265243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8476171-03a4-4d77-b2cc-e9d346b19a31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:11.268296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8476171-03a4-4d77-b2cc-e9d346b19a31 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:11.276689 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 94/194] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:11 2022] GET /identity/v3/role_assignments?user.id=66aae726fe6c49fe9ae28384be5409f7&scope.project.id=8c009114954c459da45da3213f6e7720&role.id=3d2f155e5f1f4acbaff64a9c464d9d92 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:11.278454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8476171-03a4-4d77-b2cc-e9d346b19a31 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:11.291482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 101/195] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:11.298012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c77d9-a5aa-4792-9c3f-086dea515b08 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:11.337281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:11.381344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:11.407968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8476171-03a4-4d77-b2cc-e9d346b19a31 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:11.427505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c77d9-a5aa-4792-9c3f-086dea515b08 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:11.454039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b32e46-4697-4a26-bd2c-99538e823ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:11.454702 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b32e46-4697-4a26-bd2c-99538e823ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:11.454990 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b32e46-4697-4a26-bd2c-99538e823ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:11.455965 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b32e46-4697-4a26-bd2c-99538e823ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:11.477074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34ae20-7030-46e4-8b0c-a21c9a66ed53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:11.478795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34ae20-7030-46e4-8b0c-a21c9a66ed53 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:11.479522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34ae20-7030-46e4-8b0c-a21c9a66ed53 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:11.479977 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34ae20-7030-46e4-8b0c-a21c9a66ed53 None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:11.482067 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34ae20-7030-46e4-8b0c-a21c9a66ed53 None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:11.483716 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34ae20-7030-46e4-8b0c-a21c9a66ed53 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:11.486106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 102/196] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:11 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:11.491406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8aebb-3813-4c26-aa77-f470bbc030b6 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:11.491406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8aebb-3813-4c26-aa77-f470bbc030b6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:11.491406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8aebb-3813-4c26-aa77-f470bbc030b6 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:11.491701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 103/197] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:11.492482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8aebb-3813-4c26-aa77-f470bbc030b6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:11.548780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b32e46-4697-4a26-bd2c-99538e823ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:11.551634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b32e46-4697-4a26-bd2c-99538e823ae0 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:11.598609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:11.609587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8aebb-3813-4c26-aa77-f470bbc030b6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:11.646946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745c357-ae69-4e8e-829e-69dfb089735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:11.647622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745c357-ae69-4e8e-829e-69dfb089735d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:11.647909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745c357-ae69-4e8e-829e-69dfb089735d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:11.648470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745c357-ae69-4e8e-829e-69dfb089735d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:11.649670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745c357-ae69-4e8e-829e-69dfb089735d None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=2343001f1c2e4e549eea7d3fa97e5303, user.id=ff9f02c9476842aa8f0ebdb4b5310974) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:11.649779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745c357-ae69-4e8e-829e-69dfb089735d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:11.651245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7745c357-ae69-4e8e-829e-69dfb089735d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:11.654419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:11.657577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 104/198] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:11 2022] GET /identity/v3/role_assignments?user.id=ff9f02c9476842aa8f0ebdb4b5310974&scope.project.id=2343001f1c2e4e549eea7d3fa97e5303&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:11.659393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49999c5-cc7a-4d3a-910a-94717079f80e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:11.659684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49999c5-cc7a-4d3a-910a-94717079f80e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:11.660031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49999c5-cc7a-4d3a-910a-94717079f80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:11.669599 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 95/199] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:11.675582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b32e46-4697-4a26-bd2c-99538e823ae0 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:11.678851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c49999c5-cc7a-4d3a-910a-94717079f80e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:11.680126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c49999c5-cc7a-4d3a-910a-94717079f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:11.771725 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 105/200] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:11.801034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49999c5-cc7a-4d3a-910a-94717079f80e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:11.810801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b32e46-4697-4a26-bd2c-99538e823ae0 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:11.864817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f885f01-50a5-4c7b-a360-dfb92e854e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:11.865425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f885f01-50a5-4c7b-a360-dfb92e854e50 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:11.865663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f885f01-50a5-4c7b-a360-dfb92e854e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:11.865936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f885f01-50a5-4c7b-a360-dfb92e854e50 None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:11.867468 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f885f01-50a5-4c7b-a360-dfb92e854e50 None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:11.871697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f885f01-50a5-4c7b-a360-dfb92e854e50 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:11.879176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 96/201] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:11 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:11.885290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f885f01-50a5-4c7b-a360-dfb92e854e50 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:11.900732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:11.934794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49999c5-cc7a-4d3a-910a-94717079f80e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:11.975513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:11.982415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8968b7-b867-410a-961f-f1f2f9c1e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:11.983884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8968b7-b867-410a-961f-f1f2f9c1e242 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:11.983884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8968b7-b867-410a-961f-f1f2f9c1e242 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:11.983884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8968b7-b867-410a-961f-f1f2f9c1e242 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:11.996924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8968b7-b867-410a-961f-f1f2f9c1e242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-2c8968b7-b867-410a-961f-f1f2f9c1e242 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:12.006253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:12.007275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:12.008474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:12.008474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:12.008474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:12.008474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:12.008474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:12.008474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:12.008474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:12.008474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:12.008474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:12.008474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:12.008474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:12.008474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:12.009100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 106/202] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:12.015808 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8968b7-b867-410a-961f-f1f2f9c1e242 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:12.027810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f885f01-50a5-4c7b-a360-dfb92e854e50 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:12.074928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b53198-e2c4-4367-aa5c-aabd10e223a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:12.076073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53198-e2c4-4367-aa5c-aabd10e223a9 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:12.076817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53198-e2c4-4367-aa5c-aabd10e223a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:12.077272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b53198-e2c4-4367-aa5c-aabd10e223a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:12.078306 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b53198-e2c4-4367-aa5c-aabd10e223a9 None admin] RBAC: Adding query filter params (role.id=d773dfde38e5426799f6b947044767bb, scope.project.id=2343001f1c2e4e549eea7d3fa97e5303, user.id=ff9f02c9476842aa8f0ebdb4b5310974) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:12.078790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b53198-e2c4-4367-aa5c-aabd10e223a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:12.081756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b53198-e2c4-4367-aa5c-aabd10e223a9 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:12.089478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 97/203] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:11 2022] GET /identity/v3/role_assignments?user.id=ff9f02c9476842aa8f0ebdb4b5310974&scope.project.id=2343001f1c2e4e549eea7d3fa97e5303&role.id=d773dfde38e5426799f6b947044767bb => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:12.136638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8968b7-b867-410a-961f-f1f2f9c1e242 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:12.178059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534b6a9-9a4d-4734-a5a3-3dc824827327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:12.179053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534b6a9-9a4d-4734-a5a3-3dc824827327 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:12.179516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534b6a9-9a4d-4734-a5a3-3dc824827327 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:12.179972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534b6a9-9a4d-4734-a5a3-3dc824827327 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:12.180946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534b6a9-9a4d-4734-a5a3-3dc824827327 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:12.181468 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534b6a9-9a4d-4734-a5a3-3dc824827327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:12.183055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534b6a9-9a4d-4734-a5a3-3dc824827327 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:12.197564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 107/204] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:12.202985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b53198-e2c4-4367-aa5c-aabd10e223a9 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:12.282388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:12.315207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b53198-e2c4-4367-aa5c-aabd10e223a9 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:12.360453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04057a3f-c0dd-4297-9bbb-d000e1b33f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:12.362472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04057a3f-c0dd-4297-9bbb-d000e1b33f2f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:12.362951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04057a3f-c0dd-4297-9bbb-d000e1b33f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:12.363416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04057a3f-c0dd-4297-9bbb-d000e1b33f2f None admin] PATH_INFO: `/v3/users/0f097ed400dd477f814e703ee089a915` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:12.369722 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04057a3f-c0dd-4297-9bbb-d000e1b33f2f None admin] RBAC: Authorizing `identity:get_user(user_id=0f097ed400dd477f814e703ee089a915)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:12.371244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04057a3f-c0dd-4297-9bbb-d000e1b33f2f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:12.373012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 98/205] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:12 2022] GET /identity/v3/users/0f097ed400dd477f814e703ee089a915 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:12.378637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534b6a9-9a4d-4734-a5a3-3dc824827327 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:12.481017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:12.536782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534b6a9-9a4d-4734-a5a3-3dc824827327 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:12.577907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2e23d-a5d0-4e8a-9d64-7042a088af7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:12.578578 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2e23d-a5d0-4e8a-9d64-7042a088af7f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:12.578867 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2e23d-a5d0-4e8a-9d64-7042a088af7f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:12.579205 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2e23d-a5d0-4e8a-9d64-7042a088af7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:12.688139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2e23d-a5d0-4e8a-9d64-7042a088af7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:12.690213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2e23d-a5d0-4e8a-9d64-7042a088af7f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:12.780886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:12.899110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 108/206] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:12.905882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04057a3f-c0dd-4297-9bbb-d000e1b33f2f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:13.068919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04057a3f-c0dd-4297-9bbb-d000e1b33f2f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:13.118406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13496ec-f544-4d9f-8ff0-98c3ec90b753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:13.119284 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13496ec-f544-4d9f-8ff0-98c3ec90b753 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:13.119569 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13496ec-f544-4d9f-8ff0-98c3ec90b753 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:13.119844 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13496ec-f544-4d9f-8ff0-98c3ec90b753 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:13.121077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13496ec-f544-4d9f-8ff0-98c3ec90b753 None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:13.122553 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13496ec-f544-4d9f-8ff0-98c3ec90b753 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:13.124381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 99/207] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:12 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:13.131056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2e23d-a5d0-4e8a-9d64-7042a088af7f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:13.293881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2e23d-a5d0-4e8a-9d64-7042a088af7f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:13.347244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa3cb0-5db4-4ffd-be14-4646c2783a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:13.348275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa3cb0-5db4-4ffd-be14-4646c2783a9b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:13.348785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa3cb0-5db4-4ffd-be14-4646c2783a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:13.349285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa3cb0-5db4-4ffd-be14-4646c2783a9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:13.350335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa3cb0-5db4-4ffd-be14-4646c2783a9b None admin] RBAC: Adding query filter params (role.id=4817c412bd3c4291b6a5523de64b2729, scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0, user.id=0f097ed400dd477f814e703ee089a915) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:13.350872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa3cb0-5db4-4ffd-be14-4646c2783a9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:13.352580 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa3cb0-5db4-4ffd-be14-4646c2783a9b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:13.362335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 109/208] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:13 2022] GET /identity/v3/role_assignments?user.id=0f097ed400dd477f814e703ee089a915&scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0&role.id=4817c412bd3c4291b6a5523de64b2729 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:13.487653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0abd5-2ce5-49e5-8139-2f5f02fa4c5d None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:13.487966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0abd5-2ce5-49e5-8139-2f5f02fa4c5d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:13.488223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0abd5-2ce5-49e5-8139-2f5f02fa4c5d None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:13.489898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 100/209] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:13.495467 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8990d76-5013-4d30-a04f-79a8285071cd None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:13.496075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8990d76-5013-4d30-a04f-79a8285071cd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:13.496638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8990d76-5013-4d30-a04f-79a8285071cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:13.518305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d8990d76-5013-4d30-a04f-79a8285071cd None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:13.519818 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d8990d76-5013-4d30-a04f-79a8285071cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:13.537884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:13.610983 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 110/210] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:13.651723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0abd5-2ce5-49e5-8139-2f5f02fa4c5d None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:13.666998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:13.701660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df44fe-eec3-43dd-9066-0a511a37499a None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:13.702424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df44fe-eec3-43dd-9066-0a511a37499a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:13.702727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df44fe-eec3-43dd-9066-0a511a37499a None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:13.704355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 111/211] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:13.714830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37d36d-e734-45d6-b614-d1ea3eb15e62 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:13.715169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37d36d-e734-45d6-b614-d1ea3eb15e62 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:13.715393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c37d36d-e734-45d6-b614-d1ea3eb15e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:13.739044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1c37d36d-e734-45d6-b614-d1ea3eb15e62 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:13.740696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1c37d36d-e734-45d6-b614-d1ea3eb15e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:13.803961 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0abd5-2ce5-49e5-8139-2f5f02fa4c5d None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:13.840140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 112/212] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:13.857966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a22b59-8e7c-4d7c-bc7e-00a70a249055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:13.859198 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a22b59-8e7c-4d7c-bc7e-00a70a249055 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:13.859713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a22b59-8e7c-4d7c-bc7e-00a70a249055 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:13.860183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a22b59-8e7c-4d7c-bc7e-00a70a249055 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:13.862399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a22b59-8e7c-4d7c-bc7e-00a70a249055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:13.864143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a22b59-8e7c-4d7c-bc7e-00a70a249055 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:13.866410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 101/213] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:13.871921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37d36d-e734-45d6-b614-d1ea3eb15e62 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:13.879629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a22b59-8e7c-4d7c-bc7e-00a70a249055 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:13.963626 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:13.976780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:13.989829 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c37d36d-e734-45d6-b614-d1ea3eb15e62 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:14.006184 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a22b59-8e7c-4d7c-bc7e-00a70a249055 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:14.026696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b202a4-cc37-420a-bbc1-b56b1d946f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:14.027474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b202a4-cc37-420a-bbc1-b56b1d946f9f None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:14.027834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b202a4-cc37-420a-bbc1-b56b1d946f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:14.028188 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b202a4-cc37-420a-bbc1-b56b1d946f9f None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:14.029061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b202a4-cc37-420a-bbc1-b56b1d946f9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:14.030905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b202a4-cc37-420a-bbc1-b56b1d946f9f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:14.047903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a068b97-9af3-40da-b2b4-fd81ade3c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:14.049583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a068b97-9af3-40da-b2b4-fd81ade3c785 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:14.050100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a068b97-9af3-40da-b2b4-fd81ade3c785 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:14.050562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a068b97-9af3-40da-b2b4-fd81ade3c785 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:14.061375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a068b97-9af3-40da-b2b4-fd81ade3c785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-6a068b97-9af3-40da-b2b4-fd81ade3c785 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:14.069695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:14.070598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:14.071393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:14.071393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:14.071393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:14.071393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:14.071393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:14.071393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:14.071393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:14.071393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:14.071393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:14.071393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:14.071393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:14.071393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:14.072876 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 102/214] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:14.077448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a068b97-9af3-40da-b2b4-fd81ade3c785 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:14.130883 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 113/215] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:51:13 2022] POST /identity/v3/users => generated 297 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:51:14.206904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a068b97-9af3-40da-b2b4-fd81ade3c785 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:14.248246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23afd5-7ce0-4ca7-a88b-59ad0544dd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:14.249352 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23afd5-7ce0-4ca7-a88b-59ad0544dd18 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:14.249834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23afd5-7ce0-4ca7-a88b-59ad0544dd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:14.250302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23afd5-7ce0-4ca7-a88b-59ad0544dd18 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:14.251302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23afd5-7ce0-4ca7-a88b-59ad0544dd18 None admin] RBAC: Adding query filter params (name=member) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:14.251909 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23afd5-7ce0-4ca7-a88b-59ad0544dd18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:14.253879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23afd5-7ce0-4ca7-a88b-59ad0544dd18 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:14.256932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:14.285629 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b202a4-cc37-420a-bbc1-b56b1d946f9f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:14.296713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 103/216] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:14.401410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b202a4-cc37-420a-bbc1-b56b1d946f9f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:14.429290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7f572-3bde-4029-856f-93bf594d9f10 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:14.429898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7f572-3bde-4029-856f-93bf594d9f10 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:14.430370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7f572-3bde-4029-856f-93bf594d9f10 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:14.431927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 104/217] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:14.434739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:14.438483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b1b7b-bb99-4e23-baeb-571b3792befb None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:14.438773 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b1b7b-bb99-4e23-baeb-571b3792befb None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:14.439104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b1b7b-bb99-4e23-baeb-571b3792befb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:14.442066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f16c9-b3ad-4ab0-ab62-888534169f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:14.448961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f16c9-b3ad-4ab0-ab62-888534169f2d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:14.448961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f16c9-b3ad-4ab0-ab62-888534169f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:14.448961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f16c9-b3ad-4ab0-ab62-888534169f2d None admin] PATH_INFO: `/v3/users/db978b51f56b4630a32b5a21fd6f02d2` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:14.459541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-631b1b7b-bb99-4e23-baeb-571b3792befb None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:14.460359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f16c9-b3ad-4ab0-ab62-888534169f2d None admin] RBAC: Authorizing `identity:get_user(user_id=db978b51f56b4630a32b5a21fd6f02d2)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:14.461243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-631b1b7b-bb99-4e23-baeb-571b3792befb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:14.461890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f16c9-b3ad-4ab0-ab62-888534169f2d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:14.464225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 114/218] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:14 2022] GET /identity/v3/users/db978b51f56b4630a32b5a21fd6f02d2 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:14.469567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f16c9-b3ad-4ab0-ab62-888534169f2d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:14.552600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 105/219] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:14.577318 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b1b7b-bb99-4e23-baeb-571b3792befb None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:14.602843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f16c9-b3ad-4ab0-ab62-888534169f2d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:14.646643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab840a50-076e-4d2d-a063-55dceffb40bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:14.647334 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840a50-076e-4d2d-a063-55dceffb40bc None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:14.647620 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840a50-076e-4d2d-a063-55dceffb40bc None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:14.647898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab840a50-076e-4d2d-a063-55dceffb40bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:14.707331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b1b7b-bb99-4e23-baeb-571b3792befb None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:14.712056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:14.723793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab840a50-076e-4d2d-a063-55dceffb40bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:14.725626 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab840a50-076e-4d2d-a063-55dceffb40bc None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:14.738339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:14.754549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fad4ab-0d3b-4b35-a533-0459aae17d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:14.755428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fad4ab-0d3b-4b35-a533-0459aae17d09 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:14.755688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fad4ab-0d3b-4b35-a533-0459aae17d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:14.755978 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fad4ab-0d3b-4b35-a533-0459aae17d09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:14.777567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fad4ab-0d3b-4b35-a533-0459aae17d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-b1fad4ab-0d3b-4b35-a533-0459aae17d09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:14.788334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:14.789283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:14.790087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:14.790087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:14.790087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:14.790087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:14.790087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:14.790087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:14.790087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:14.790087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:14.790087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:14.790087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:14.790087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:14.790087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:14.793199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 106/220] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:51:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:14.794324 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f911e3-b5da-4b9b-af3f-3c6980a6a615 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:14.794583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f911e3-b5da-4b9b-af3f-3c6980a6a615 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:14.794865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f911e3-b5da-4b9b-af3f-3c6980a6a615 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:14.801240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 107/221] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:14.802902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f911e3-b5da-4b9b-af3f-3c6980a6a615 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:14.849906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 115/222] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:14.855766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490564-83be-41c7-a85d-1a911e74fd76 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:14.856073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490564-83be-41c7-a85d-1a911e74fd76 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:14.856359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39490564-83be-41c7-a85d-1a911e74fd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:14.885490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-39490564-83be-41c7-a85d-1a911e74fd76 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:14.886810 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-39490564-83be-41c7-a85d-1a911e74fd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:14.919986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f911e3-b5da-4b9b-af3f-3c6980a6a615 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:14.959300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083d216-0cfd-4dcd-a595-607d0b4e3102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:14.960295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083d216-0cfd-4dcd-a595-607d0b4e3102 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:14.960775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083d216-0cfd-4dcd-a595-607d0b4e3102 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:14.961291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083d216-0cfd-4dcd-a595-607d0b4e3102 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:14.962237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083d216-0cfd-4dcd-a595-607d0b4e3102 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:14.962752 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083d216-0cfd-4dcd-a595-607d0b4e3102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:14.964331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083d216-0cfd-4dcd-a595-607d0b4e3102 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:14.971630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 116/223] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:14.972614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39490564-83be-41c7-a85d-1a911e74fd76 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:14.973923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 108/224] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:14.986432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083d216-0cfd-4dcd-a595-607d0b4e3102 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:14.999777 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:15.081252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:15.087805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39490564-83be-41c7-a85d-1a911e74fd76 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:15.125507 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7c9da-f6cf-4a91-87e0-5a3cf1cd71d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:15.126475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7c9da-f6cf-4a91-87e0-5a3cf1cd71d9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:15.127509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7c9da-f6cf-4a91-87e0-5a3cf1cd71d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:15.127801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7c9da-f6cf-4a91-87e0-5a3cf1cd71d9 None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:15.129095 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7c9da-f6cf-4a91-87e0-5a3cf1cd71d9 None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:15.130843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7c9da-f6cf-4a91-87e0-5a3cf1cd71d9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:15.136857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 117/225] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:14 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:15.136857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7c9da-f6cf-4a91-87e0-5a3cf1cd71d9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:15.142416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083d216-0cfd-4dcd-a595-607d0b4e3102 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:15.177974 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4c6b9-b037-4719-9690-29cbdee21797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:15.179062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4c6b9-b037-4719-9690-29cbdee21797 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:15.179551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4c6b9-b037-4719-9690-29cbdee21797 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:15.180049 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4c6b9-b037-4719-9690-29cbdee21797 None admin] PATH_INFO: `/v3/users/ff9f02c9476842aa8f0ebdb4b5310974` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:15.181499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4c6b9-b037-4719-9690-29cbdee21797 None admin] RBAC: Authorizing `identity:get_user(user_id=ff9f02c9476842aa8f0ebdb4b5310974)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:15.183204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4c6b9-b037-4719-9690-29cbdee21797 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:15.185471 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 109/226] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:14 2022] GET /identity/v3/users/ff9f02c9476842aa8f0ebdb4b5310974 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:15.186566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4c6b9-b037-4719-9690-29cbdee21797 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:15.246639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:15.262594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7c9da-f6cf-4a91-87e0-5a3cf1cd71d9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:15.297155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4c6b9-b037-4719-9690-29cbdee21797 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:15.306252 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea2a88-b524-41b7-8d9a-2ad27be238ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:15.307212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea2a88-b524-41b7-8d9a-2ad27be238ad None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:15.307641 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea2a88-b524-41b7-8d9a-2ad27be238ad None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:15.308247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea2a88-b524-41b7-8d9a-2ad27be238ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:15.320194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea2a88-b524-41b7-8d9a-2ad27be238ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:15.321330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-0bea2a88-b524-41b7-8d9a-2ad27be238ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:15.329650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:15.330675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:15.331505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:15.331505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:15.331505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:15.331505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:15.331505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:15.331505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:15.331505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:15.331505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:15.331505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:15.331505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:15.331505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:15.331505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:15.332147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 118/227] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:51:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:15.337516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea2a88-b524-41b7-8d9a-2ad27be238ad None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:15.343689 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a682f3-b0d0-42fa-944b-94c2a8474d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:15.344580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a682f3-b0d0-42fa-944b-94c2a8474d4c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:15.345095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a682f3-b0d0-42fa-944b-94c2a8474d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:15.345770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a682f3-b0d0-42fa-944b-94c2a8474d4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:15.346791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a682f3-b0d0-42fa-944b-94c2a8474d4c None admin] RBAC: Adding query filter params (role.id=3d2f155e5f1f4acbaff64a9c464d9d92, scope.project.id=2343001f1c2e4e549eea7d3fa97e5303, user.id=db978b51f56b4630a32b5a21fd6f02d2) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:15.347276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a682f3-b0d0-42fa-944b-94c2a8474d4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:15.349577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a682f3-b0d0-42fa-944b-94c2a8474d4c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:15.363078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 110/228] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:15 2022] GET /identity/v3/role_assignments?user.id=db978b51f56b4630a32b5a21fd6f02d2&scope.project.id=2343001f1c2e4e549eea7d3fa97e5303&role.id=3d2f155e5f1f4acbaff64a9c464d9d92 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:15.364517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a682f3-b0d0-42fa-944b-94c2a8474d4c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:15.541496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea2a88-b524-41b7-8d9a-2ad27be238ad None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:15.579689 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a682f3-b0d0-42fa-944b-94c2a8474d4c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:15.603878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc9176-99b9-4c49-97d3-a401ba650165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:15.604874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9176-99b9-4c49-97d3-a401ba650165 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:15.605232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9176-99b9-4c49-97d3-a401ba650165 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:15.605606 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc9176-99b9-4c49-97d3-a401ba650165 None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:15.606896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc9176-99b9-4c49-97d3-a401ba650165 None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:15.608418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc9176-99b9-4c49-97d3-a401ba650165 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:15.610272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 119/229] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:15 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:15.617011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc9176-99b9-4c49-97d3-a401ba650165 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:15.624475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf9a85-eea2-47dd-94e4-da0923cc9b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:15.625405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf9a85-eea2-47dd-94e4-da0923cc9b1e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:15.625861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf9a85-eea2-47dd-94e4-da0923cc9b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:15.626319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf9a85-eea2-47dd-94e4-da0923cc9b1e None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:15.628282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf9a85-eea2-47dd-94e4-da0923cc9b1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:15.628766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf9a85-eea2-47dd-94e4-da0923cc9b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:15.630357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf9a85-eea2-47dd-94e4-da0923cc9b1e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:15.640631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 111/230] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:15.649948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf9a85-eea2-47dd-94e4-da0923cc9b1e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:15.652481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:15.747869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:15.808258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc9176-99b9-4c49-97d3-a401ba650165 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:15.856704 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf9a85-eea2-47dd-94e4-da0923cc9b1e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:15.893901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd33275-058d-4ed4-baee-a0740084200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:15.894786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33275-058d-4ed4-baee-a0740084200b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:15.895067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33275-058d-4ed4-baee-a0740084200b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:15.895345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33275-058d-4ed4-baee-a0740084200b None admin] PATH_INFO: `/v3/users/ff9f02c9476842aa8f0ebdb4b5310974` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:15.896550 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd33275-058d-4ed4-baee-a0740084200b None admin] RBAC: Authorizing `identity:get_user(user_id=ff9f02c9476842aa8f0ebdb4b5310974)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:15.898043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd33275-058d-4ed4-baee-a0740084200b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:15.899678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 112/231] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:15 2022] GET /identity/v3/users/ff9f02c9476842aa8f0ebdb4b5310974 => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:15.900522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fd124-93f8-4fc7-9e62-a0051efb32aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:15.901465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fd124-93f8-4fc7-9e62-a0051efb32aa None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:15.901753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fd124-93f8-4fc7-9e62-a0051efb32aa None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:15.902034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805fd124-93f8-4fc7-9e62-a0051efb32aa None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303/users/ff9f02c9476842aa8f0ebdb4b5310974/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:15.905137 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd33275-058d-4ed4-baee-a0740084200b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:15.909781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fd124-93f8-4fc7-9e62-a0051efb32aa None admin] RBAC: Authorizing `identity:create_grant(project_id=2343001f1c2e4e549eea7d3fa97e5303, user_id=ff9f02c9476842aa8f0ebdb4b5310974, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:15.911266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805fd124-93f8-4fc7-9e62-a0051efb32aa None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:16.015609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 120/232] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:51:15 2022] PUT /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303/users/ff9f02c9476842aa8f0ebdb4b5310974/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:16.038422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd33275-058d-4ed4-baee-a0740084200b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:16.057423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:16.078921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8934f0-577b-4f4b-9376-50ca8dda6947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:16.079710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8934f0-577b-4f4b-9376-50ca8dda6947 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:16.080781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8934f0-577b-4f4b-9376-50ca8dda6947 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:16.081110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8934f0-577b-4f4b-9376-50ca8dda6947 None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:16.082433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8934f0-577b-4f4b-9376-50ca8dda6947 None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:16.083913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8934f0-577b-4f4b-9376-50ca8dda6947 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:16.086144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 113/233] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:15 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:16.091808 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fd124-93f8-4fc7-9e62-a0051efb32aa None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:16.210726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:16.241512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805fd124-93f8-4fc7-9e62-a0051efb32aa None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:16.280570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7efb4-f882-4679-8656-8bcdeb0c5dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:16.281506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7efb4-f882-4679-8656-8bcdeb0c5dab None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:16.281795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7efb4-f882-4679-8656-8bcdeb0c5dab None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:16.282072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7efb4-f882-4679-8656-8bcdeb0c5dab None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303/users/ff9f02c9476842aa8f0ebdb4b5310974/roles/d773dfde38e5426799f6b947044767bb` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:16.284551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7efb4-f882-4679-8656-8bcdeb0c5dab None admin] RBAC: Authorizing `identity:create_grant(project_id=2343001f1c2e4e549eea7d3fa97e5303, user_id=ff9f02c9476842aa8f0ebdb4b5310974, role_id=d773dfde38e5426799f6b947044767bb)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:16.286174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7efb4-f882-4679-8656-8bcdeb0c5dab None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:16.380694 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 121/234] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:51:16 2022] PUT /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303/users/ff9f02c9476842aa8f0ebdb4b5310974/roles/d773dfde38e5426799f6b947044767bb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:16.529104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f276f2-bacc-402f-aef9-c3ef90c6a93b None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:16.529685 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f276f2-bacc-402f-aef9-c3ef90c6a93b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:16.530108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f276f2-bacc-402f-aef9-c3ef90c6a93b None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:16.531915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 114/235] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:16.537113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791aa852-b63c-42bc-bd26-fe7630b969a0 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:16.537535 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791aa852-b63c-42bc-bd26-fe7630b969a0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:16.537924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791aa852-b63c-42bc-bd26-fe7630b969a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:16.563593 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-791aa852-b63c-42bc-bd26-fe7630b969a0 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:16.564927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-791aa852-b63c-42bc-bd26-fe7630b969a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:16.656768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 122/236] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:16.683234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f276f2-bacc-402f-aef9-c3ef90c6a93b None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:16.801089 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f276f2-bacc-402f-aef9-c3ef90c6a93b None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:16.846367 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba888e98-40d8-4614-ac17-d579e2e0c50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:16.847530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba888e98-40d8-4614-ac17-d579e2e0c50a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:16.848042 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba888e98-40d8-4614-ac17-d579e2e0c50a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:16.848518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba888e98-40d8-4614-ac17-d579e2e0c50a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:16.873801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba888e98-40d8-4614-ac17-d579e2e0c50a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-ba888e98-40d8-4614-ac17-d579e2e0c50a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:16.882207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:16.883087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:16.883863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:16.883863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:16.883863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:16.883863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:16.883863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:16.883863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:16.883863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:16.883863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:16.883863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:16.883863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:16.883863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:16.883863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:16.892253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791aa852-b63c-42bc-bd26-fe7630b969a0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:16.893009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 115/237] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:16.972756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:17.017273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791aa852-b63c-42bc-bd26-fe7630b969a0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:17.053565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108223a7-7a32-43de-a645-ef37421b1d07 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:17.054103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108223a7-7a32-43de-a645-ef37421b1d07 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:17.054103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108223a7-7a32-43de-a645-ef37421b1d07 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:17.059284 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 116/238] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:51:17.060794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daed0cb-2c78-4e69-9a30-3473975bee6e None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:17.061117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daed0cb-2c78-4e69-9a30-3473975bee6e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:17.061403 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daed0cb-2c78-4e69-9a30-3473975bee6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:17.082389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1829cd-fef7-4707-b094-4265220af6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:17.083072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1829cd-fef7-4707-b094-4265220af6cc None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:17.083357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1829cd-fef7-4707-b094-4265220af6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:17.083640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1829cd-fef7-4707-b094-4265220af6cc None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:17.084406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1829cd-fef7-4707-b094-4265220af6cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:17.084714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1829cd-fef7-4707-b094-4265220af6cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:17.086155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1829cd-fef7-4707-b094-4265220af6cc None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:17.093199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-5daed0cb-2c78-4e69-9a30-3473975bee6e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:17.094415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5daed0cb-2c78-4e69-9a30-3473975bee6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:17.109325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 123/239] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:17.115149 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1829cd-fef7-4707-b094-4265220af6cc None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:17.162211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:17.213334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 117/240] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:17.244656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1829cd-fef7-4707-b094-4265220af6cc None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:17.246225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daed0cb-2c78-4e69-9a30-3473975bee6e None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:17.275146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:17.282729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da8f0-6d45-42ae-b8a6-ab2e41652b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:17.287280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da8f0-6d45-42ae-b8a6-ab2e41652b1f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:17.287280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da8f0-6d45-42ae-b8a6-ab2e41652b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:17.287280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da8f0-6d45-42ae-b8a6-ab2e41652b1f None admin] PATH_INFO: `/v3/users/c7e95600a923489b8b273f34bde88475` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:17.315477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645da8f0-6d45-42ae-b8a6-ab2e41652b1f None admin] RBAC: Authorizing `identity:get_user(user_id=c7e95600a923489b8b273f34bde88475)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:17.320829 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645da8f0-6d45-42ae-b8a6-ab2e41652b1f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:17.320829 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 124/241] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:17 2022] GET /identity/v3/users/c7e95600a923489b8b273f34bde88475 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:17.324765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da8f0-6d45-42ae-b8a6-ab2e41652b1f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:17.427739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da8f0-6d45-42ae-b8a6-ab2e41652b1f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:17.463112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4d60a-35ed-4294-9fbb-9ea3dd487e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:17.463783 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4d60a-35ed-4294-9fbb-9ea3dd487e7f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:17.464075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4d60a-35ed-4294-9fbb-9ea3dd487e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:17.464357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4d60a-35ed-4294-9fbb-9ea3dd487e7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:17.528832 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:17.535701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4d60a-35ed-4294-9fbb-9ea3dd487e7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:17.537259 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4d60a-35ed-4294-9fbb-9ea3dd487e7f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:17.558842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daed0cb-2c78-4e69-9a30-3473975bee6e None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:17.642972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 125/242] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:17.648369 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4d60a-35ed-4294-9fbb-9ea3dd487e7f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:17.669534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a02ef-32ba-4484-8c1e-ebd9b1b95486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:17.670357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a02ef-32ba-4484-8c1e-ebd9b1b95486 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:17.670646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a02ef-32ba-4484-8c1e-ebd9b1b95486 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:17.670927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a02ef-32ba-4484-8c1e-ebd9b1b95486 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:17.672174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a02ef-32ba-4484-8c1e-ebd9b1b95486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:17.673758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a02ef-32ba-4484-8c1e-ebd9b1b95486 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:17.675696 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 118/243] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:17.683344 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a02ef-32ba-4484-8c1e-ebd9b1b95486 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:17.734641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:17.781687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:17.799409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4d60a-35ed-4294-9fbb-9ea3dd487e7f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:17.836879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82fb7f-3424-4fdf-8286-e4ca7631b5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:17.837764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82fb7f-3424-4fdf-8286-e4ca7631b5fe None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:17.838049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82fb7f-3424-4fdf-8286-e4ca7631b5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:17.838329 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb82fb7f-3424-4fdf-8286-e4ca7631b5fe None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:17.839608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82fb7f-3424-4fdf-8286-e4ca7631b5fe None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:17.841187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb82fb7f-3424-4fdf-8286-e4ca7631b5fe None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:17.844028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 126/244] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:17 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:17.850407 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82fb7f-3424-4fdf-8286-e4ca7631b5fe None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:17.894724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a02ef-32ba-4484-8c1e-ebd9b1b95486 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:17.970319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1aa895-0f99-45d7-b0b1-87cd5c6191dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:17.971570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1aa895-0f99-45d7-b0b1-87cd5c6191dc None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:17.972397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1aa895-0f99-45d7-b0b1-87cd5c6191dc None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:17.973196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1aa895-0f99-45d7-b0b1-87cd5c6191dc None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:17.974266 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1aa895-0f99-45d7-b0b1-87cd5c6191dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:17.976491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1aa895-0f99-45d7-b0b1-87cd5c6191dc None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:17.977607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb82fb7f-3424-4fdf-8286-e4ca7631b5fe None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:18.013852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce9492-24da-4b75-b370-76cd802f0bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:18.014575 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce9492-24da-4b75-b370-76cd802f0bbd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:18.014866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce9492-24da-4b75-b370-76cd802f0bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:18.015141 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce9492-24da-4b75-b370-76cd802f0bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:18.016237 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce9492-24da-4b75-b370-76cd802f0bbd None admin] RBAC: Adding query filter params (role.id=4817c412bd3c4291b6a5523de64b2729, scope.project.id=2343001f1c2e4e549eea7d3fa97e5303, user.id=c7e95600a923489b8b273f34bde88475) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:18.016553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce9492-24da-4b75-b370-76cd802f0bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:18.018660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce9492-24da-4b75-b370-76cd802f0bbd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:18.024548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 127/245] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:17 2022] GET /identity/v3/role_assignments?user.id=c7e95600a923489b8b273f34bde88475&scope.project.id=2343001f1c2e4e549eea7d3fa97e5303&role.id=4817c412bd3c4291b6a5523de64b2729 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:18.030825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604803-1a76-4c3b-a1df-4f5e1ac396ce None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:18.030825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604803-1a76-4c3b-a1df-4f5e1ac396ce None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:18.030825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604803-1a76-4c3b-a1df-4f5e1ac396ce None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:18.030825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 128/246] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:18.040502 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe311e-d738-47ae-8ba0-44b3faa189dc None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:18.040502 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe311e-d738-47ae-8ba0-44b3faa189dc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:18.040502 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe311e-d738-47ae-8ba0-44b3faa189dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:18.061942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-06fe311e-d738-47ae-8ba0-44b3faa189dc None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:18.063535 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-06fe311e-d738-47ae-8ba0-44b3faa189dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:18.081821 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:18.092062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 119/247] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:51:17 2022] POST /identity/v3/users => generated 293 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:51:18.153835 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 129/248] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:18.175654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1aa895-0f99-45d7-b0b1-87cd5c6191dc None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:18.310957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:18.318669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1aa895-0f99-45d7-b0b1-87cd5c6191dc None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:18.356736 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac49585-84fc-4bbc-9027-3c08645cb718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:18.357591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49585-84fc-4bbc-9027-3c08645cb718 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:18.358069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49585-84fc-4bbc-9027-3c08645cb718 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:18.358355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac49585-84fc-4bbc-9027-3c08645cb718 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:18.370475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac49585-84fc-4bbc-9027-3c08645cb718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-7ac49585-84fc-4bbc-9027-3c08645cb718 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:18.378879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:18.379761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:18.380543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 120/249] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:18.388882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe311e-d738-47ae-8ba0-44b3faa189dc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:18.497962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe311e-d738-47ae-8ba0-44b3faa189dc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:18.539240 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2817a-1a37-4f25-b04c-fe09ef49e207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:18.539928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2817a-1a37-4f25-b04c-fe09ef49e207 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:18.540214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2817a-1a37-4f25-b04c-fe09ef49e207 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:18.540492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2817a-1a37-4f25-b04c-fe09ef49e207 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:18.541310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2817a-1a37-4f25-b04c-fe09ef49e207 None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:18.541621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2817a-1a37-4f25-b04c-fe09ef49e207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:18.543008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2817a-1a37-4f25-b04c-fe09ef49e207 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:18.553122 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 130/250] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:18.560052 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac49585-84fc-4bbc-9027-3c08645cb718 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:18.604990 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56892-9f5a-46e6-b826-547f01637aa1 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:18.605269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56892-9f5a-46e6-b826-547f01637aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:18.605483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa56892-9f5a-46e6-b826-547f01637aa1 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:18.607100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 131/251] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:18.613002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be651e2a-63ce-49ec-a575-87d673db4831 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:18.613294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be651e2a-63ce-49ec-a575-87d673db4831 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:18.613576 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be651e2a-63ce-49ec-a575-87d673db4831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:18.630583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-be651e2a-63ce-49ec-a575-87d673db4831 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:18.631875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-be651e2a-63ce-49ec-a575-87d673db4831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:18.635151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:18.702248 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac49585-84fc-4bbc-9027-3c08645cb718 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:18.742855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 132/252] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:18.753697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0e5be-1cdb-487b-b1b6-1345c4c53cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:18.754637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0e5be-1cdb-487b-b1b6-1345c4c53cca None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:18.754922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0e5be-1cdb-487b-b1b6-1345c4c53cca None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:18.755203 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0e5be-1cdb-487b-b1b6-1345c4c53cca None admin] PATH_INFO: `/v3/users/db978b51f56b4630a32b5a21fd6f02d2` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:18.756468 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0e5be-1cdb-487b-b1b6-1345c4c53cca None admin] RBAC: Authorizing `identity:get_user(user_id=db978b51f56b4630a32b5a21fd6f02d2)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:18.758030 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0e5be-1cdb-487b-b1b6-1345c4c53cca None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:18.759734 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 121/253] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:18 2022] GET /identity/v3/users/db978b51f56b4630a32b5a21fd6f02d2 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:18.765758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be651e2a-63ce-49ec-a575-87d673db4831 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:18.778583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0e5be-1cdb-487b-b1b6-1345c4c53cca None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:18.810659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:18.879563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be651e2a-63ce-49ec-a575-87d673db4831 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:18.891007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0e5be-1cdb-487b-b1b6-1345c4c53cca None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:18.922537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4568b7c-c383-457e-beaa-acf3f23550ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:18.924057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568b7c-c383-457e-beaa-acf3f23550ee None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:18.924339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568b7c-c383-457e-beaa-acf3f23550ee None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:18.924626 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568b7c-c383-457e-beaa-acf3f23550ee None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:18.926945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568b7c-c383-457e-beaa-acf3f23550ee None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:18.927156 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc6677-c620-4faa-b6af-4720d824c5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:18.927923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc6677-c620-4faa-b6af-4720d824c5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:18.928219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc6677-c620-4faa-b6af-4720d824c5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:18.928505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc6677-c620-4faa-b6af-4720d824c5e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:18.928604 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568b7c-c383-457e-beaa-acf3f23550ee None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:18.935016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 133/254] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:18 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:18.936309 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4568b7c-c383-457e-beaa-acf3f23550ee None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:18.942038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc6677-c620-4faa-b6af-4720d824c5e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:18.949836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-08bc6677-c620-4faa-b6af-4720d824c5e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:18.955361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:18.956274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:18.957128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:18.957128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:18.957128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:18.957128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:18.957128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:18.957128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:18.957128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:18.957128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:18.957128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:18.957128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:18.957128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:18.957128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:18.958880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 122/255] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:51:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:18.964111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc6677-c620-4faa-b6af-4720d824c5e7 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:19.045448 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4568b7c-c383-457e-beaa-acf3f23550ee None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:19.097132 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4ff4b9-f867-4a6e-8b2a-2fc57660978b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:19.098037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff4b9-f867-4a6e-8b2a-2fc57660978b None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:19.098317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff4b9-f867-4a6e-8b2a-2fc57660978b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:19.098594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4ff4b9-f867-4a6e-8b2a-2fc57660978b None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303/users/db978b51f56b4630a32b5a21fd6f02d2/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:19.101994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ff4b9-f867-4a6e-8b2a-2fc57660978b None admin] RBAC: Authorizing `identity:create_grant(project_id=2343001f1c2e4e549eea7d3fa97e5303, user_id=db978b51f56b4630a32b5a21fd6f02d2, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:19.103466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4ff4b9-f867-4a6e-8b2a-2fc57660978b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:19.121264 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:19.139154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc6677-c620-4faa-b6af-4720d824c5e7 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:19.180347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 134/256] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:51:18 2022] PUT /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303/users/db978b51f56b4630a32b5a21fd6f02d2/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:19.181922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1ca3-38ac-4a20-b670-e543a26158a8 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:19.182215 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1ca3-38ac-4a20-b670-e543a26158a8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:19.182586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1ca3-38ac-4a20-b670-e543a26158a8 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:19.183908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 135/257] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:19.186295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cce12-aa72-4895-8230-6c0bf8b9bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:19.187051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cce12-aa72-4895-8230-6c0bf8b9bcbd None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:19.187340 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cce12-aa72-4895-8230-6c0bf8b9bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:19.187628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cce12-aa72-4895-8230-6c0bf8b9bcbd None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:19.190197 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff9106-77f3-4c7b-87c7-b318b5adf363 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:19.190527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff9106-77f3-4c7b-87c7-b318b5adf363 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:19.190807 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff9106-77f3-4c7b-87c7-b318b5adf363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:19.192779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cce12-aa72-4895-8230-6c0bf8b9bcbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:19.193756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cce12-aa72-4895-8230-6c0bf8b9bcbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:19.195215 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cce12-aa72-4895-8230-6c0bf8b9bcbd None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:19.215041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 123/258] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:19.218990 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-49ff9106-77f3-4c7b-87c7-b318b5adf363 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:19.221141 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cce12-aa72-4895-8230-6c0bf8b9bcbd None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:19.222380 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-49ff9106-77f3-4c7b-87c7-b318b5adf363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:19.341480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:19.349745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 136/259] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:19.370370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cce12-aa72-4895-8230-6c0bf8b9bcbd None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:19.394325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff9106-77f3-4c7b-87c7-b318b5adf363 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:19.433363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50444a-05df-4452-b11c-8c994a6d6576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:19.435694 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50444a-05df-4452-b11c-8c994a6d6576 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:19.436332 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50444a-05df-4452-b11c-8c994a6d6576 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:19.437968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50444a-05df-4452-b11c-8c994a6d6576 None admin] PATH_INFO: `/v3/users/ff9f02c9476842aa8f0ebdb4b5310974` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:19.440287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50444a-05df-4452-b11c-8c994a6d6576 None admin] RBAC: Authorizing `identity:get_user(user_id=ff9f02c9476842aa8f0ebdb4b5310974)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:19.442862 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50444a-05df-4452-b11c-8c994a6d6576 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:19.445543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 124/260] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:19 2022] GET /identity/v3/users/ff9f02c9476842aa8f0ebdb4b5310974 => generated 283 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:19.452598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50444a-05df-4452-b11c-8c994a6d6576 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:19.493228 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:19.585209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff9106-77f3-4c7b-87c7-b318b5adf363 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:19.620623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50444a-05df-4452-b11c-8c994a6d6576 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:19.632630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f22b-6006-4410-ab8b-43264306e4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:19.633884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f22b-6006-4410-ab8b-43264306e4dd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:19.634370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f22b-6006-4410-ab8b-43264306e4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:19.634865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701f22b-6006-4410-ab8b-43264306e4dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:19.653546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701f22b-6006-4410-ab8b-43264306e4dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-7701f22b-6006-4410-ab8b-43264306e4dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:19.662403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:19.663283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:19.664076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:19.664076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:19.664076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:19.664076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:19.664076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:19.664076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:19.664076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:19.664076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:19.664076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:19.664076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:19.664076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:19.664076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:19.666955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2c8c-3188-40a7-a868-35de5dbc4e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:19.667218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 137/261] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:51:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:19.671941 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2c8c-3188-40a7-a868-35de5dbc4e39 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:19.671941 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2c8c-3188-40a7-a868-35de5dbc4e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:19.671941 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e2c8c-3188-40a7-a868-35de5dbc4e39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:19.673728 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f22b-6006-4410-ab8b-43264306e4dd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:19.740839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:19.771182 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e2c8c-3188-40a7-a868-35de5dbc4e39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:19.778147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e2c8c-3188-40a7-a868-35de5dbc4e39 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:19.795067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:19.798724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701f22b-6006-4410-ab8b-43264306e4dd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:19.840268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccf7d0-ead1-4b18-b457-76a37754ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:19.841574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccf7d0-ead1-4b18-b457-76a37754ce06 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:19.842092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccf7d0-ead1-4b18-b457-76a37754ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:19.842592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ccf7d0-ead1-4b18-b457-76a37754ce06 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:19.843569 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccf7d0-ead1-4b18-b457-76a37754ce06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:19.844081 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccf7d0-ead1-4b18-b457-76a37754ce06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:19.845777 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ccf7d0-ead1-4b18-b457-76a37754ce06 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:19.854593 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 138/262] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:19.860214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccf7d0-ead1-4b18-b457-76a37754ce06 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:19.936729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 125/263] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:19.938152 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2c8c-3188-40a7-a868-35de5dbc4e39 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:20.056398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ccf7d0-ead1-4b18-b457-76a37754ce06 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:20.100494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e2c8c-3188-40a7-a868-35de5dbc4e39 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:20.105030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:20.117151 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:20.150900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c39fa1-1641-4f1c-8e8d-708b1c32a30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:20.151514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aacbb0-55d8-445e-bdd3-294048c27b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:20.151773 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c39fa1-1641-4f1c-8e8d-708b1c32a30b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:20.151899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aacbb0-55d8-445e-bdd3-294048c27b20 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:20.152055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c39fa1-1641-4f1c-8e8d-708b1c32a30b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:20.152147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aacbb0-55d8-445e-bdd3-294048c27b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:20.152916 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aacbb0-55d8-445e-bdd3-294048c27b20 None admin] PATH_INFO: `/v3/users/ff9f02c9476842aa8f0ebdb4b5310974` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:20.153019 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c39fa1-1641-4f1c-8e8d-708b1c32a30b None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:20.154968 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aacbb0-55d8-445e-bdd3-294048c27b20 None admin] RBAC: Authorizing `identity:get_user(user_id=ff9f02c9476842aa8f0ebdb4b5310974)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:20.156427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aacbb0-55d8-445e-bdd3-294048c27b20 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:20.158195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c39fa1-1641-4f1c-8e8d-708b1c32a30b None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:20.159689 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c39fa1-1641-4f1c-8e8d-708b1c32a30b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:20.161824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 139/265] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:19 2022] GET /identity/v3/users/ff9f02c9476842aa8f0ebdb4b5310974 => generated 283 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:20.169350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 126/265] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:19 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:20.169466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aacbb0-55d8-445e-bdd3-294048c27b20 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:20.169540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c39fa1-1641-4f1c-8e8d-708b1c32a30b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:20.289335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c39fa1-1641-4f1c-8e8d-708b1c32a30b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:20.340161 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821832e-e235-4534-93ed-4bfd6ebdcc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:20.341498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821832e-e235-4534-93ed-4bfd6ebdcc62 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:20.341985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821832e-e235-4534-93ed-4bfd6ebdcc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:20.342525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821832e-e235-4534-93ed-4bfd6ebdcc62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:20.349226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aacbb0-55d8-445e-bdd3-294048c27b20 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:20.401446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842ddc5-bd5c-40e8-b5fd-ecfaac783f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:20.402123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842ddc5-bd5c-40e8-b5fd-ecfaac783f81 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:20.402411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842ddc5-bd5c-40e8-b5fd-ecfaac783f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:20.402692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842ddc5-bd5c-40e8-b5fd-ecfaac783f81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:20.403543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842ddc5-bd5c-40e8-b5fd-ecfaac783f81 None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=2343001f1c2e4e549eea7d3fa97e5303, user.id=ff9f02c9476842aa8f0ebdb4b5310974) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:20.403860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842ddc5-bd5c-40e8-b5fd-ecfaac783f81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:20.406165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842ddc5-bd5c-40e8-b5fd-ecfaac783f81 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:20.425258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 140/266] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:20 2022] GET /identity/v3/role_assignments?user.id=ff9f02c9476842aa8f0ebdb4b5310974&scope.project.id=2343001f1c2e4e549eea7d3fa97e5303&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:20.465255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:20.470738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821832e-e235-4534-93ed-4bfd6ebdcc62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:20.472260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821832e-e235-4534-93ed-4bfd6ebdcc62 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:20.619911 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 127/267] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:20.625110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842ddc5-bd5c-40e8-b5fd-ecfaac783f81 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:20.711335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:20.777796 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842ddc5-bd5c-40e8-b5fd-ecfaac783f81 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:20.821339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6bfb3-3d32-452c-ae08-ceb9e69e43c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:20.822265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6bfb3-3d32-452c-ae08-ceb9e69e43c4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:20.822559 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6bfb3-3d32-452c-ae08-ceb9e69e43c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:20.822841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6bfb3-3d32-452c-ae08-ceb9e69e43c4 None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:20.824104 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6bfb3-3d32-452c-ae08-ceb9e69e43c4 None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:20.825615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6bfb3-3d32-452c-ae08-ceb9e69e43c4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:20.827632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 141/268] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:20 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:20.837912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821832e-e235-4534-93ed-4bfd6ebdcc62 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:20.992195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:21.021003 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821832e-e235-4534-93ed-4bfd6ebdcc62 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:21.031400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6a76-47e8-47cb-8ad4-8abc84bfa5f6 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:21.031702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6a76-47e8-47cb-8ad4-8abc84bfa5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:21.031972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee6a76-47e8-47cb-8ad4-8abc84bfa5f6 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:21.034028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 142/269] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:21.040093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b8b1-ef07-477f-8ff8-0f36eb07d9db None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:21.040637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b8b1-ef07-477f-8ff8-0f36eb07d9db None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:21.041163 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9b8b1-ef07-477f-8ff8-0f36eb07d9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:21.077270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc68f8-be5d-47e9-b00e-4606f26e7cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:21.077937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc68f8-be5d-47e9-b00e-4606f26e7cdf None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:21.078220 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc68f8-be5d-47e9-b00e-4606f26e7cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:21.078505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc68f8-be5d-47e9-b00e-4606f26e7cdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:21.079349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc68f8-be5d-47e9-b00e-4606f26e7cdf None admin] RBAC: Adding query filter params (role.id=d773dfde38e5426799f6b947044767bb, scope.project.id=2343001f1c2e4e549eea7d3fa97e5303, user.id=ff9f02c9476842aa8f0ebdb4b5310974) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:21.079834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc68f8-be5d-47e9-b00e-4606f26e7cdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:21.081335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc68f8-be5d-47e9-b00e-4606f26e7cdf None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:21.083938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d8e9b8b1-ef07-477f-8ff8-0f36eb07d9db None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:21.085194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d8e9b8b1-ef07-477f-8ff8-0f36eb07d9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:21.093146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 128/270] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:20 2022] GET /identity/v3/role_assignments?user.id=ff9f02c9476842aa8f0ebdb4b5310974&scope.project.id=2343001f1c2e4e549eea7d3fa97e5303&role.id=d773dfde38e5426799f6b947044767bb => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:21.172014 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 143/271] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:21.197175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc68f8-be5d-47e9-b00e-4606f26e7cdf None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:21.312201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc68f8-be5d-47e9-b00e-4606f26e7cdf None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:21.347663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24daf026-2cf4-4ac4-bc85-97c68400d697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:21.348476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf026-2cf4-4ac4-bc85-97c68400d697 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:21.348760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf026-2cf4-4ac4-bc85-97c68400d697 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:21.349064 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24daf026-2cf4-4ac4-bc85-97c68400d697 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:21.360131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24daf026-2cf4-4ac4-bc85-97c68400d697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-24daf026-2cf4-4ac4-bc85-97c68400d697 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:21.368630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:21.369565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:21.370959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 129/272] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:21.376048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9b8b1-ef07-477f-8ff8-0f36eb07d9db None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:21.433944 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:21.487004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9b8b1-ef07-477f-8ff8-0f36eb07d9db None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:21.518243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3ce8d-303b-4067-9b87-55cff35e10c2 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:21.518575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3ce8d-303b-4067-9b87-55cff35e10c2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:21.518790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f3ce8d-303b-4067-9b87-55cff35e10c2 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:21.520467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 130/273] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:51:21.526538 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee6afb-128a-4618-a009-dfc9bb743857 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:21.526883 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee6afb-128a-4618-a009-dfc9bb743857 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:21.527169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee6afb-128a-4618-a009-dfc9bb743857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:21.527440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060597a-7cd4-48f9-a921-6701e59a75e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:21.528117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060597a-7cd4-48f9-a921-6701e59a75e7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:21.528397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060597a-7cd4-48f9-a921-6701e59a75e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:21.528671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060597a-7cd4-48f9-a921-6701e59a75e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:21.529460 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060597a-7cd4-48f9-a921-6701e59a75e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:21.529765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060597a-7cd4-48f9-a921-6701e59a75e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:21.531151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060597a-7cd4-48f9-a921-6701e59a75e7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:21.534687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:21.541913 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 144/274] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:21.546980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060597a-7cd4-48f9-a921-6701e59a75e7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:21.553794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-4aee6afb-128a-4618-a009-dfc9bb743857 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:21.554986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4aee6afb-128a-4618-a009-dfc9bb743857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:21.661925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 131/275] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:21.669537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060597a-7cd4-48f9-a921-6701e59a75e7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:21.682940 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:21.687676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee6afb-128a-4618-a009-dfc9bb743857 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:21.707396 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777898fa-5200-4912-9276-724fa6e94e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:21.708298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777898fa-5200-4912-9276-724fa6e94e35 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:21.708608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777898fa-5200-4912-9276-724fa6e94e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:21.708868 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777898fa-5200-4912-9276-724fa6e94e35 None admin] PATH_INFO: `/v3/users/c7e95600a923489b8b273f34bde88475` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:21.710102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777898fa-5200-4912-9276-724fa6e94e35 None admin] RBAC: Authorizing `identity:get_user(user_id=c7e95600a923489b8b273f34bde88475)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:21.711746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777898fa-5200-4912-9276-724fa6e94e35 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:21.713710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 145/276] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:21 2022] GET /identity/v3/users/c7e95600a923489b8b273f34bde88475 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:21.719202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777898fa-5200-4912-9276-724fa6e94e35 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:21.801742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee6afb-128a-4618-a009-dfc9bb743857 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:21.831056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777898fa-5200-4912-9276-724fa6e94e35 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:21.838730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb8e30-7df8-479c-bde5-ec7ac3dc1845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:21.839542 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb8e30-7df8-479c-bde5-ec7ac3dc1845 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:21.839832 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb8e30-7df8-479c-bde5-ec7ac3dc1845 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:21.840112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb8e30-7df8-479c-bde5-ec7ac3dc1845 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:21.842424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:21.851706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb8e30-7df8-479c-bde5-ec7ac3dc1845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-b3fb8e30-7df8-479c-bde5-ec7ac3dc1845 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:21.860293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:21.861828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:21.862671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:21.862671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:21.862671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:21.862671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:21.862671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:21.862671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:21.862671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:21.862671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:21.862671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:21.862671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:21.862671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:21.862671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:21.868854 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 132/277] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:21.870171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567d400-fb51-4606-af5a-9eb6eea1ca38 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:21.870465 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567d400-fb51-4606-af5a-9eb6eea1ca38 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:21.870754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567d400-fb51-4606-af5a-9eb6eea1ca38 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:21.872093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 133/278] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:21.872785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567d400-fb51-4606-af5a-9eb6eea1ca38 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:21.878502 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4939a4c-0480-45ee-9215-f22305d93204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:21.879605 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4939a4c-0480-45ee-9215-f22305d93204 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:21.879889 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4939a4c-0480-45ee-9215-f22305d93204 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:21.880168 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4939a4c-0480-45ee-9215-f22305d93204 None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:21.881393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4939a4c-0480-45ee-9215-f22305d93204 None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:21.882839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4939a4c-0480-45ee-9215-f22305d93204 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:21.884520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 146/279] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:21 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:21.885668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73179a50-844e-41e7-934b-eba37c5aa363 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:21.885951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73179a50-844e-41e7-934b-eba37c5aa363 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:21.886230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73179a50-844e-41e7-934b-eba37c5aa363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:21.902735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-73179a50-844e-41e7-934b-eba37c5aa363 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:21.903901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-73179a50-844e-41e7-934b-eba37c5aa363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:21.950320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:21.983038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 147/280] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:21.983038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73179a50-844e-41e7-934b-eba37c5aa363 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:21.992078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567d400-fb51-4606-af5a-9eb6eea1ca38 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:22.030534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3bf02-f1bb-46bc-9d6b-a370b4e56ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:22.031203 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3bf02-f1bb-46bc-9d6b-a370b4e56ebb None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:22.031484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3bf02-f1bb-46bc-9d6b-a370b4e56ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:22.031759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3bf02-f1bb-46bc-9d6b-a370b4e56ebb None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:22.033080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3bf02-f1bb-46bc-9d6b-a370b4e56ebb None admin] RBAC: Adding query filter params (name=member) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:22.033699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3bf02-f1bb-46bc-9d6b-a370b4e56ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:22.034782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3bf02-f1bb-46bc-9d6b-a370b4e56ebb None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:22.043065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 134/281] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:22.043689 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3bf02-f1bb-46bc-9d6b-a370b4e56ebb None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:22.089352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73179a50-844e-41e7-934b-eba37c5aa363 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:22.099317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:22.123557 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f335fd-4551-4639-8008-b938dbc01c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:22.124563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f335fd-4551-4639-8008-b938dbc01c54 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:22.124876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f335fd-4551-4639-8008-b938dbc01c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:22.125150 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f335fd-4551-4639-8008-b938dbc01c54 None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303/users/c7e95600a923489b8b273f34bde88475/roles/4817c412bd3c4291b6a5523de64b2729` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:22.127622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f335fd-4551-4639-8008-b938dbc01c54 None admin] RBAC: Authorizing `identity:create_grant(project_id=2343001f1c2e4e549eea7d3fa97e5303, user_id=c7e95600a923489b8b273f34bde88475, role_id=4817c412bd3c4291b6a5523de64b2729)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:22.129131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f335fd-4551-4639-8008-b938dbc01c54 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:22.143239 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3bf02-f1bb-46bc-9d6b-a370b4e56ebb None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:22.175475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70381332-ceb7-474c-8108-92518bae1be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:22.176250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70381332-ceb7-474c-8108-92518bae1be6 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:22.176536 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70381332-ceb7-474c-8108-92518bae1be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:22.176892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70381332-ceb7-474c-8108-92518bae1be6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:22.178006 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70381332-ceb7-474c-8108-92518bae1be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:22.179467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70381332-ceb7-474c-8108-92518bae1be6 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:22.181122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 135/282] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:22.182271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea3187-ec58-4f50-a3aa-c61312add596 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:22.182558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea3187-ec58-4f50-a3aa-c61312add596 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:22.182840 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea3187-ec58-4f50-a3aa-c61312add596 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:22.184194 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 136/283] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:22.184754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea3187-ec58-4f50-a3aa-c61312add596 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:22.222101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 148/284] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:51:21 2022] PUT /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303/users/c7e95600a923489b8b273f34bde88475/roles/4817c412bd3c4291b6a5523de64b2729 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:22.223096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f335fd-4551-4639-8008-b938dbc01c54 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:22.291077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:22.292741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea3187-ec58-4f50-a3aa-c61312add596 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:22.322518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:22.335028 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896700a-9341-4eba-a814-8023a02f9962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:22.335967 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896700a-9341-4eba-a814-8023a02f9962 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:22.336262 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896700a-9341-4eba-a814-8023a02f9962 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:22.336542 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896700a-9341-4eba-a814-8023a02f9962 None admin] PATH_INFO: `/v3/users/1cf7614b336a4c45b317dc03c308e337` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:22.352161 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896700a-9341-4eba-a814-8023a02f9962 None admin] RBAC: Authorizing `identity:get_user(user_id=1cf7614b336a4c45b317dc03c308e337)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:22.353687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896700a-9341-4eba-a814-8023a02f9962 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:22.360651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 137/285] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:22 2022] GET /identity/v3/users/1cf7614b336a4c45b317dc03c308e337 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:22.360651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58e18-4d36-45ea-ba39-532a308ad84e None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:22.360651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58e18-4d36-45ea-ba39-532a308ad84e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:22.360651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b58e18-4d36-45ea-ba39-532a308ad84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:22.366534 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f335fd-4551-4639-8008-b938dbc01c54 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:22.379929 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-c1b58e18-4d36-45ea-ba39-532a308ad84e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:22.381171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c1b58e18-4d36-45ea-ba39-532a308ad84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:22.409545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69662eab-21f5-430a-8218-8c5c1cb028d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:22.410230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69662eab-21f5-430a-8218-8c5c1cb028d4 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:22.410517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69662eab-21f5-430a-8218-8c5c1cb028d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:22.410801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69662eab-21f5-430a-8218-8c5c1cb028d4 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:22.411523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69662eab-21f5-430a-8218-8c5c1cb028d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:22.413961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69662eab-21f5-430a-8218-8c5c1cb028d4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:22.456533 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 138/286] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:22.457403 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b58e18-4d36-45ea-ba39-532a308ad84e None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:22.496941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 149/287] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:51:22 2022] POST /identity/v3/users => generated 293 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:51:22.496941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69662eab-21f5-430a-8218-8c5c1cb028d4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:22.592867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b58e18-4d36-45ea-ba39-532a308ad84e None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:22.606365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:22.614153 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69662eab-21f5-430a-8218-8c5c1cb028d4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:22.614378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:22.643626 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01254862-e803-4251-b191-9a287aad4d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:22.644300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01254862-e803-4251-b191-9a287aad4d14 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:22.644583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01254862-e803-4251-b191-9a287aad4d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:22.645038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01254862-e803-4251-b191-9a287aad4d14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:22.645933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01254862-e803-4251-b191-9a287aad4d14 None admin] RBAC: Adding query filter params (role.id=3d2f155e5f1f4acbaff64a9c464d9d92, user.id=1cf7614b336a4c45b317dc03c308e337, scope.system=all) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:22.646299 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01254862-e803-4251-b191-9a287aad4d14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:22.648144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01254862-e803-4251-b191-9a287aad4d14 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:22.658140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b7b63-d6e1-450e-b538-ca09860ec6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:22.659373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7b63-d6e1-450e-b538-ca09860ec6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:22.659837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7b63-d6e1-450e-b538-ca09860ec6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:22.660269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b7b63-d6e1-450e-b538-ca09860ec6f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:22.660459 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 139/288] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Jun 23 12:51:22 2022] GET /identity/v3/role_assignments?user.id=1cf7614b336a4c45b317dc03c308e337&scope.system=all&role.id=3d2f155e5f1f4acbaff64a9c464d9d92 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:22.673928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3b7b63-d6e1-450e-b538-ca09860ec6f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6e3b7b63-d6e1-450e-b538-ca09860ec6f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:22.683440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:22.684358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:22.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:22.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:22.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:22.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:22.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:22.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:22.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:22.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:22.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:22.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:22.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:22.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:22.690215 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 150/289] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:22.693147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01254862-e803-4251-b191-9a287aad4d14 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:22.817257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01254862-e803-4251-b191-9a287aad4d14 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:22.854685 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dae3a3-8cdd-4fa4-af97-12cf9534d639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:22.855365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dae3a3-8cdd-4fa4-af97-12cf9534d639 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:22.855648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dae3a3-8cdd-4fa4-af97-12cf9534d639 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:22.855926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dae3a3-8cdd-4fa4-af97-12cf9534d639 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:22.856686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dae3a3-8cdd-4fa4-af97-12cf9534d639 None admin] RBAC: Adding query filter params (name=member) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:22.857027 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dae3a3-8cdd-4fa4-af97-12cf9534d639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:22.858413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dae3a3-8cdd-4fa4-af97-12cf9534d639 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:22.877377 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 140/290] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:22.882420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b7b63-d6e1-450e-b538-ca09860ec6f1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:22.991930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3b7b63-d6e1-450e-b538-ca09860ec6f1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:23.027610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db29ad0-62f4-40ce-8347-ebfaa5c721ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:23.028552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db29ad0-62f4-40ce-8347-ebfaa5c721ec None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:23.028858 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db29ad0-62f4-40ce-8347-ebfaa5c721ec None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:23.029137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db29ad0-62f4-40ce-8347-ebfaa5c721ec None admin] PATH_INFO: `/v3/users/db978b51f56b4630a32b5a21fd6f02d2` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:23.030362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db29ad0-62f4-40ce-8347-ebfaa5c721ec None admin] RBAC: Authorizing `identity:get_user(user_id=db978b51f56b4630a32b5a21fd6f02d2)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:23.031909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db29ad0-62f4-40ce-8347-ebfaa5c721ec None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:23.034451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 151/291] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:22 2022] GET /identity/v3/users/db978b51f56b4630a32b5a21fd6f02d2 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:23.041956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dae3a3-8cdd-4fa4-af97-12cf9534d639 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:23.095297 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:23.162323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dae3a3-8cdd-4fa4-af97-12cf9534d639 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:23.211847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e47f8-d90a-4908-bbc1-6313de8ec3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:23.212509 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e47f8-d90a-4908-bbc1-6313de8ec3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:23.212791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e47f8-d90a-4908-bbc1-6313de8ec3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:23.213089 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e47f8-d90a-4908-bbc1-6313de8ec3f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:23.294213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e47f8-d90a-4908-bbc1-6313de8ec3f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:23.295700 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e47f8-d90a-4908-bbc1-6313de8ec3f7 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:23.335979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:23.401837 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 141/292] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:23.408943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db29ad0-62f4-40ce-8347-ebfaa5c721ec None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:23.435790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:23.517267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db29ad0-62f4-40ce-8347-ebfaa5c721ec None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:23.554063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55833a7-b164-4535-8730-ab6ac7d25af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:23.554943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55833a7-b164-4535-8730-ab6ac7d25af7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:23.555227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55833a7-b164-4535-8730-ab6ac7d25af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:23.555544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55833a7-b164-4535-8730-ab6ac7d25af7 None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:23.556873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55833a7-b164-4535-8730-ab6ac7d25af7 None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:23.558406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55833a7-b164-4535-8730-ab6ac7d25af7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:23.560122 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 152/293] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:23 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:23.566386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e47f8-d90a-4908-bbc1-6313de8ec3f7 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:23.684009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e47f8-d90a-4908-bbc1-6313de8ec3f7 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:23.723686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1826552-cf52-4ef7-afc8-3260611183ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:23.724690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1826552-cf52-4ef7-afc8-3260611183ad None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:23.725010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1826552-cf52-4ef7-afc8-3260611183ad None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:23.725291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1826552-cf52-4ef7-afc8-3260611183ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:23.726184 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1826552-cf52-4ef7-afc8-3260611183ad None admin] RBAC: Adding query filter params (role.id=3d2f155e5f1f4acbaff64a9c464d9d92, scope.project.id=2343001f1c2e4e549eea7d3fa97e5303, user.id=db978b51f56b4630a32b5a21fd6f02d2) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:23.726502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1826552-cf52-4ef7-afc8-3260611183ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:23.728014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1826552-cf52-4ef7-afc8-3260611183ad None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:23.734351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 142/294] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:23 2022] GET /identity/v3/role_assignments?user.id=db978b51f56b4630a32b5a21fd6f02d2&scope.project.id=2343001f1c2e4e549eea7d3fa97e5303&role.id=3d2f155e5f1f4acbaff64a9c464d9d92 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:24.485005 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a9d8d-fb46-41a8-9839-f9a5586a7c94 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:24.486176 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a9d8d-fb46-41a8-9839-f9a5586a7c94 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:24.486263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a9d8d-fb46-41a8-9839-f9a5586a7c94 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:24.487629 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 153/295] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:24.493536 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c5fca-c36a-4f96-8cff-445446cd72cc None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:24.494052 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c5fca-c36a-4f96-8cff-445446cd72cc None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:24.494222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643c5fca-c36a-4f96-8cff-445446cd72cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:24.499301 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:24.511687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-643c5fca-c36a-4f96-8cff-445446cd72cc None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:24.512968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-643c5fca-c36a-4f96-8cff-445446cd72cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:24.616477 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 143/296] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:24.639632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a9d8d-fb46-41a8-9839-f9a5586a7c94 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:24.734999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:24.746726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a9d8d-fb46-41a8-9839-f9a5586a7c94 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:24.785621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f21ad3-b29e-433a-b4ef-3332be6b6f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:24.786431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f21ad3-b29e-433a-b4ef-3332be6b6f2c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:24.786716 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f21ad3-b29e-433a-b4ef-3332be6b6f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:24.787063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f21ad3-b29e-433a-b4ef-3332be6b6f2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:24.797235 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f21ad3-b29e-433a-b4ef-3332be6b6f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-10f21ad3-b29e-433a-b4ef-3332be6b6f2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:24.805848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:24.807975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:24.809292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 154/297] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:24.814718 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c5fca-c36a-4f96-8cff-445446cd72cc None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:24.919074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643c5fca-c36a-4f96-8cff-445446cd72cc None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:24.949901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:24.955309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a48309-c745-4dc9-9437-0555f4744909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:24.955982 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a48309-c745-4dc9-9437-0555f4744909 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:24.956261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a48309-c745-4dc9-9437-0555f4744909 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:24.956529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a48309-c745-4dc9-9437-0555f4744909 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:24.957599 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a48309-c745-4dc9-9437-0555f4744909 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:24.957915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a48309-c745-4dc9-9437-0555f4744909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:24.959311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a48309-c745-4dc9-9437-0555f4744909 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:24.968373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 144/298] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:24.973908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f21ad3-b29e-433a-b4ef-3332be6b6f2c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:24.991632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b5544-7c73-491d-9b66-5f6d75ff9ed7 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:24.991940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b5544-7c73-491d-9b66-5f6d75ff9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:24.992203 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b5544-7c73-491d-9b66-5f6d75ff9ed7 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:24.993776 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 145/299] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:51:24.994692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007826-d6c9-4199-b6f8-bd022182220f None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:24.994982 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007826-d6c9-4199-b6f8-bd022182220f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:24.995261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a007826-d6c9-4199-b6f8-bd022182220f None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:24.996611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 146/300] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:25.002246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09f474-d837-4b3e-869b-e3a485648ae8 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.002439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09f474-d837-4b3e-869b-e3a485648ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.002757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09f474-d837-4b3e-869b-e3a485648ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.024623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-8f09f474-d837-4b3e-869b-e3a485648ae8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:25.025848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-8f09f474-d837-4b3e-869b-e3a485648ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:25.080013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f21ad3-b29e-433a-b4ef-3332be6b6f2c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:25.100880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 147/301] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:25.100880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04b9d-aca8-418e-8118-a7878b8ca054 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.100880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04b9d-aca8-418e-8118-a7878b8ca054 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.100880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04b9d-aca8-418e-8118-a7878b8ca054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.119032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046670d-9eb6-4a60-b44d-46f684655958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:25.120193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046670d-9eb6-4a60-b44d-46f684655958 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.120614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046670d-9eb6-4a60-b44d-46f684655958 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.121058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046670d-9eb6-4a60-b44d-46f684655958 None admin] PATH_INFO: `/v3/users/c7e95600a923489b8b273f34bde88475` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.121363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-79c04b9d-aca8-418e-8118-a7878b8ca054 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:25.122592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046670d-9eb6-4a60-b44d-46f684655958 None admin] RBAC: Authorizing `identity:get_user(user_id=c7e95600a923489b8b273f34bde88475)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:25.122793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-79c04b9d-aca8-418e-8118-a7878b8ca054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:25.124043 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046670d-9eb6-4a60-b44d-46f684655958 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:25.125710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 155/302] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:24 2022] GET /identity/v3/users/c7e95600a923489b8b273f34bde88475 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:25.130074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046670d-9eb6-4a60-b44d-46f684655958 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:25.150925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:25.202384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 148/303] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:25.203601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04b9d-aca8-418e-8118-a7878b8ca054 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:25.246034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046670d-9eb6-4a60-b44d-46f684655958 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:25.266789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:25.281431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f8a6c-6b62-4d4f-b00d-59c1f3526740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:25.284091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f8a6c-6b62-4d4f-b00d-59c1f3526740 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.284091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f8a6c-6b62-4d4f-b00d-59c1f3526740 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.284091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f8a6c-6b62-4d4f-b00d-59c1f3526740 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.294335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f8a6c-6b62-4d4f-b00d-59c1f3526740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-5d7f8a6c-6b62-4d4f-b00d-59c1f3526740 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:25.303078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:25.304209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 156/304] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:25.305231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f8a6c-6b62-4d4f-b00d-59c1f3526740 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:25.318359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04b9d-aca8-418e-8118-a7878b8ca054 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:25.352137 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26bcaa4-db05-46c8-9c5e-df372621b025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:25.352792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bcaa4-db05-46c8-9c5e-df372621b025 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.353106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bcaa4-db05-46c8-9c5e-df372621b025 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.353383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26bcaa4-db05-46c8-9c5e-df372621b025 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.392519 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:25.414886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f8a6c-6b62-4d4f-b00d-59c1f3526740 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:25.421428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bcaa4-db05-46c8-9c5e-df372621b025 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:25.422971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26bcaa4-db05-46c8-9c5e-df372621b025 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:25.451219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ef11-0ad2-4db8-ab82-b04bb7c9d6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:25.452360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ef11-0ad2-4db8-ab82-b04bb7c9d6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.452915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ef11-0ad2-4db8-ab82-b04bb7c9d6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.453367 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ef11-0ad2-4db8-ab82-b04bb7c9d6e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.463939 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ef11-0ad2-4db8-ab82-b04bb7c9d6e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-13b2ef11-0ad2-4db8-ab82-b04bb7c9d6e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:25.472243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:25.473159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:25.473972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 157/305] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:25.474629 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ef11-0ad2-4db8-ab82-b04bb7c9d6e1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:25.478268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:25.529210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 149/306] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:25.529210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494e70-a847-4ba5-99de-415d98074ea3 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.529210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494e70-a847-4ba5-99de-415d98074ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.529210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca494e70-a847-4ba5-99de-415d98074ea3 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.529210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 150/307] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:25.529210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca494e70-a847-4ba5-99de-415d98074ea3 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:25.577645 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ef11-0ad2-4db8-ab82-b04bb7c9d6e1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:25.613504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa4d9e-e62a-49ca-9cce-a382d849c70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:25.614178 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa4d9e-e62a-49ca-9cce-a382d849c70d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.614461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa4d9e-e62a-49ca-9cce-a382d849c70d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.614746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa4d9e-e62a-49ca-9cce-a382d849c70d None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.615494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa4d9e-e62a-49ca-9cce-a382d849c70d None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:25.615803 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa4d9e-e62a-49ca-9cce-a382d849c70d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:25.617207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa4d9e-e62a-49ca-9cce-a382d849c70d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:25.622469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:25.626902 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 158/308] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:25.627679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa4d9e-e62a-49ca-9cce-a382d849c70d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:25.635302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca494e70-a847-4ba5-99de-415d98074ea3 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:25.669418 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a23e7a-7a14-43bc-92ae-590ae82c5619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:25.670074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23e7a-7a14-43bc-92ae-590ae82c5619 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.670355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23e7a-7a14-43bc-92ae-590ae82c5619 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.670641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a23e7a-7a14-43bc-92ae-590ae82c5619 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.671391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a23e7a-7a14-43bc-92ae-590ae82c5619 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:25.671698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a23e7a-7a14-43bc-92ae-590ae82c5619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:25.673631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a23e7a-7a14-43bc-92ae-590ae82c5619 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:25.682067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 151/309] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:25.683320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb00102-92aa-4ebc-a80e-7075dc0d0476 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.683609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb00102-92aa-4ebc-a80e-7075dc0d0476 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.683891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb00102-92aa-4ebc-a80e-7075dc0d0476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.699663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-3eb00102-92aa-4ebc-a80e-7075dc0d0476 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:25.700885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-3eb00102-92aa-4ebc-a80e-7075dc0d0476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:25.712274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:25.727653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa4d9e-e62a-49ca-9cce-a382d849c70d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:25.762132 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cae77b-cc01-4685-9889-85aae6b6e68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:25.763300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cae77b-cc01-4685-9889-85aae6b6e68d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.763584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cae77b-cc01-4685-9889-85aae6b6e68d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.763859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cae77b-cc01-4685-9889-85aae6b6e68d None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.765062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cae77b-cc01-4685-9889-85aae6b6e68d None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:25.767256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cae77b-cc01-4685-9889-85aae6b6e68d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:25.767581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 152/310] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:25.768485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb00102-92aa-4ebc-a80e-7075dc0d0476 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:25.773503 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 159/311] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:25 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:25.773503 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cae77b-cc01-4685-9889-85aae6b6e68d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:25.842637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:25.875314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cae77b-cc01-4685-9889-85aae6b6e68d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:25.884990 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb00102-92aa-4ebc-a80e-7075dc0d0476 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:25.910003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e1bfc-2f84-451f-b7f4-92a2c1f7761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:25.910878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e1bfc-2f84-451f-b7f4-92a2c1f7761e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.911162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e1bfc-2f84-451f-b7f4-92a2c1f7761e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.911437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e1bfc-2f84-451f-b7f4-92a2c1f7761e None admin] PATH_INFO: `/v3/users/daac0f8fd43247ec80cbc6ef16f9aac7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.919525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c265f-14a5-460b-94f1-154772fd8960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:25.920398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c265f-14a5-460b-94f1-154772fd8960 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:25.920681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c265f-14a5-460b-94f1-154772fd8960 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:25.920989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c265f-14a5-460b-94f1-154772fd8960 None admin] PATH_INFO: `/v3/users/1cf7614b336a4c45b317dc03c308e337` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:25.922212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c265f-14a5-460b-94f1-154772fd8960 None admin] RBAC: Authorizing `identity:get_user(user_id=1cf7614b336a4c45b317dc03c308e337)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:25.924049 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c265f-14a5-460b-94f1-154772fd8960 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:25.924873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e1bfc-2f84-451f-b7f4-92a2c1f7761e None admin] RBAC: Authorizing `identity:get_user(user_id=daac0f8fd43247ec80cbc6ef16f9aac7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:25.925724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 153/312] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:25 2022] GET /identity/v3/users/1cf7614b336a4c45b317dc03c308e337 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:25.926335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e1bfc-2f84-451f-b7f4-92a2c1f7761e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:25.926518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c265f-14a5-460b-94f1-154772fd8960 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:25.932738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 160/313] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:25 2022] GET /identity/v3/users/daac0f8fd43247ec80cbc6ef16f9aac7 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:25.932738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e1bfc-2f84-451f-b7f4-92a2c1f7761e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:25.944202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:26.026112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e1bfc-2f84-451f-b7f4-92a2c1f7761e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:26.027231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c265f-14a5-460b-94f1-154772fd8960 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:26.051096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:26.059131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d9394-a913-4ca4-987f-296c9b89d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:26.059931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d9394-a913-4ca4-987f-296c9b89d37f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:26.060214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d9394-a913-4ca4-987f-296c9b89d37f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:26.060491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d9394-a913-4ca4-987f-296c9b89d37f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:26.060595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faf577-5cde-4b4d-8ff4-b703093b243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:26.061189 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faf577-5cde-4b4d-8ff4-b703093b243a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:26.061473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faf577-5cde-4b4d-8ff4-b703093b243a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:26.061695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d9394-a913-4ca4-987f-296c9b89d37f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:26.061783 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00faf577-5cde-4b4d-8ff4-b703093b243a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:26.062560 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faf577-5cde-4b4d-8ff4-b703093b243a None admin] RBAC: Adding query filter params (role.id=4817c412bd3c4291b6a5523de64b2729, scope.project.id=2343001f1c2e4e549eea7d3fa97e5303, user.id=c7e95600a923489b8b273f34bde88475) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:26.062867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faf577-5cde-4b4d-8ff4-b703093b243a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:26.063134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d9394-a913-4ca4-987f-296c9b89d37f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:26.065045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00faf577-5cde-4b4d-8ff4-b703093b243a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:26.065403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 161/314] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:26.066138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d9394-a913-4ca4-987f-296c9b89d37f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:26.071932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 154/315] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:25 2022] GET /identity/v3/role_assignments?user.id=c7e95600a923489b8b273f34bde88475&scope.project.id=2343001f1c2e4e549eea7d3fa97e5303&role.id=4817c412bd3c4291b6a5523de64b2729 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:26.072711 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faf577-5cde-4b4d-8ff4-b703093b243a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:26.165127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:26.182417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d9394-a913-4ca4-987f-296c9b89d37f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:26.187994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00faf577-5cde-4b4d-8ff4-b703093b243a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:26.221310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b0405-51fa-44f1-bd14-439727982d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:26.222201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b0405-51fa-44f1-bd14-439727982d05 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:26.222475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b0405-51fa-44f1-bd14-439727982d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:26.222756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b0405-51fa-44f1-bd14-439727982d05 None admin] PATH_INFO: `/v3/system/users/1cf7614b336a4c45b317dc03c308e337/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:26.224251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b0405-51fa-44f1-bd14-439727982d05 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1cf7614b336a4c45b317dc03c308e337, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:26.225660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b0405-51fa-44f1-bd14-439727982d05 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:26.227517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126e5f2-c221-4606-8fac-45c41e9bb070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:26.228182 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126e5f2-c221-4606-8fac-45c41e9bb070 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:26.228471 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126e5f2-c221-4606-8fac-45c41e9bb070 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:26.228753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126e5f2-c221-4606-8fac-45c41e9bb070 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:26.229641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126e5f2-c221-4606-8fac-45c41e9bb070 None admin] RBAC: Adding query filter params (role.id=4817c412bd3c4291b6a5523de64b2729, user.id=daac0f8fd43247ec80cbc6ef16f9aac7, scope.system=all) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:26.229962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126e5f2-c221-4606-8fac-45c41e9bb070 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:26.231413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126e5f2-c221-4606-8fac-45c41e9bb070 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:26.237840 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 155/316] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Jun 23 12:51:26 2022] GET /identity/v3/role_assignments?user.id=daac0f8fd43247ec80cbc6ef16f9aac7&scope.system=all&role.id=4817c412bd3c4291b6a5523de64b2729 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:26.238986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126e5f2-c221-4606-8fac-45c41e9bb070 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:26.356913 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 162/317] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Jun 23 12:51:26 2022] PUT /identity/v3/system/users/1cf7614b336a4c45b317dc03c308e337/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:26.361586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126e5f2-c221-4606-8fac-45c41e9bb070 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:26.401944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd629959-2a28-4560-9fdd-f1e5bcc15c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:26.402645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd629959-2a28-4560-9fdd-f1e5bcc15c3d None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:26.403022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd629959-2a28-4560-9fdd-f1e5bcc15c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:26.403201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd629959-2a28-4560-9fdd-f1e5bcc15c3d None admin] PATH_INFO: `/v3/groups` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:26.403918 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd629959-2a28-4560-9fdd-f1e5bcc15c3d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:26.405451 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd629959-2a28-4560-9fdd-f1e5bcc15c3d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:26.504116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 156/318] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Jun 23 12:51:26 2022] POST /identity/v3/groups => generated 229 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:51:28.286757 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c8111-2860-4bbb-8b3d-7f100528f400 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:28.287270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c8111-2860-4bbb-8b3d-7f100528f400 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:28.287345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c8111-2860-4bbb-8b3d-7f100528f400 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:28.288782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 163/319] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:28.294102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f3d57-b639-45ba-b2dc-5aacfc5ea7d4 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:28.294496 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f3d57-b639-45ba-b2dc-5aacfc5ea7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:28.294659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f3d57-b639-45ba-b2dc-5aacfc5ea7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:28.299848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:28.311898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-bc8f3d57-b639-45ba-b2dc-5aacfc5ea7d4 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:28.313137 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-bc8f3d57-b639-45ba-b2dc-5aacfc5ea7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:28.380745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 157/320] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:28.403587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c8111-2860-4bbb-8b3d-7f100528f400 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:28.439251 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5a271-ec2d-4dc1-916d-50faee503216 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:28.439793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5a271-ec2d-4dc1-916d-50faee503216 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:28.440111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5a271-ec2d-4dc1-916d-50faee503216 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:28.441768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 158/321] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:51:28.447347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295eaec-4bf8-4774-a0d5-bb85505898b2 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:28.447654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295eaec-4bf8-4774-a0d5-bb85505898b2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:28.447911 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295eaec-4bf8-4774-a0d5-bb85505898b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:28.466570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-1295eaec-4bf8-4774-a0d5-bb85505898b2 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:28.467888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1295eaec-4bf8-4774-a0d5-bb85505898b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:28.470683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:28.514220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c8111-2860-4bbb-8b3d-7f100528f400 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:28.539820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 159/322] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:28.551513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac604d21-54e8-4a89-a1ca-7bc5d9ed5593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:28.552480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac604d21-54e8-4a89-a1ca-7bc5d9ed5593 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:28.552584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac604d21-54e8-4a89-a1ca-7bc5d9ed5593 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:28.552886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac604d21-54e8-4a89-a1ca-7bc5d9ed5593 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:28.553977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a95cea-1432-44a3-aae0-ff3baef20a45 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:28.554270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a95cea-1432-44a3-aae0-ff3baef20a45 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:28.554537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a95cea-1432-44a3-aae0-ff3baef20a45 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:28.556020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 160/323] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:51:28.561030 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28bb86-3749-4c85-90fd-f653b56bd4c7 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:28.561315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28bb86-3749-4c85-90fd-f653b56bd4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:28.561608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28bb86-3749-4c85-90fd-f653b56bd4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:28.564088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac604d21-54e8-4a89-a1ca-7bc5d9ed5593 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-ac604d21-54e8-4a89-a1ca-7bc5d9ed5593 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:28.573023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:28.574092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 164/324] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:28.575540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac604d21-54e8-4a89-a1ca-7bc5d9ed5593 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:28.581074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-6e28bb86-3749-4c85-90fd-f653b56bd4c7 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:28.582281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6e28bb86-3749-4c85-90fd-f653b56bd4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:28.638713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:28.649821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 161/325] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:28.650619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28bb86-3749-4c85-90fd-f653b56bd4c7 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:28.678617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac604d21-54e8-4a89-a1ca-7bc5d9ed5593 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:28.695348 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:28.712514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9950-6375-47be-858e-059704149165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:28.713339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9950-6375-47be-858e-059704149165 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:28.713617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9950-6375-47be-858e-059704149165 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:28.713897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e9950-6375-47be-858e-059704149165 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:28.724338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e9950-6375-47be-858e-059704149165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-519e9950-6375-47be-858e-059704149165 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:28.732328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:28.733249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:28.734032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 165/326] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:28.734748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9950-6375-47be-858e-059704149165 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:28.757940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28bb86-3749-4c85-90fd-f653b56bd4c7 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:28.793428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb267b76-b150-4a76-9cc1-b960e113391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:28.794022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb267b76-b150-4a76-9cc1-b960e113391e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:28.794304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb267b76-b150-4a76-9cc1-b960e113391e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:28.794579 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb267b76-b150-4a76-9cc1-b960e113391e None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:28.795333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb267b76-b150-4a76-9cc1-b960e113391e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:28.795629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb267b76-b150-4a76-9cc1-b960e113391e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:28.797056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb267b76-b150-4a76-9cc1-b960e113391e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:28.805446 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 162/327] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:28.806234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb267b76-b150-4a76-9cc1-b960e113391e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:28.840973 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e9950-6375-47be-858e-059704149165 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:28.860966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:28.875316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d42262-4e3b-47e5-8a21-1acb45622e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:28.876628 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d42262-4e3b-47e5-8a21-1acb45622e69 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:28.876947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d42262-4e3b-47e5-8a21-1acb45622e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:28.877225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d42262-4e3b-47e5-8a21-1acb45622e69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:28.878403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d42262-4e3b-47e5-8a21-1acb45622e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:28.879861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d42262-4e3b-47e5-8a21-1acb45622e69 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:28.881534 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 166/328] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:28.882301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d42262-4e3b-47e5-8a21-1acb45622e69 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:28.909557 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb267b76-b150-4a76-9cc1-b960e113391e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:28.928643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:28.943054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93062434-3209-43d3-bd1f-5891bd47c35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:28.943717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93062434-3209-43d3-bd1f-5891bd47c35c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:28.943994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93062434-3209-43d3-bd1f-5891bd47c35c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:28.945380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93062434-3209-43d3-bd1f-5891bd47c35c None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:28.945380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93062434-3209-43d3-bd1f-5891bd47c35c None admin] RBAC: Adding query filter params (name=member) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:28.945380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93062434-3209-43d3-bd1f-5891bd47c35c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:28.946751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93062434-3209-43d3-bd1f-5891bd47c35c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:28.955229 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 163/329] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:28.955985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93062434-3209-43d3-bd1f-5891bd47c35c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:28.981990 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d42262-4e3b-47e5-8a21-1acb45622e69 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:29.014763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6f524-3f91-40d8-8903-947a891f1c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:29.015889 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6f524-3f91-40d8-8903-947a891f1c17 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:29.016179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6f524-3f91-40d8-8903-947a891f1c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:29.017120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6f524-3f91-40d8-8903-947a891f1c17 None admin] PATH_INFO: `/v3/users/daac0f8fd43247ec80cbc6ef16f9aac7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:29.018321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6f524-3f91-40d8-8903-947a891f1c17 None admin] RBAC: Authorizing `identity:get_user(user_id=daac0f8fd43247ec80cbc6ef16f9aac7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:29.019765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6f524-3f91-40d8-8903-947a891f1c17 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:29.021420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 167/330] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:28 2022] GET /identity/v3/users/daac0f8fd43247ec80cbc6ef16f9aac7 => generated 293 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:29.022183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6f524-3f91-40d8-8903-947a891f1c17 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:29.058148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93062434-3209-43d3-bd1f-5891bd47c35c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:29.074256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:29.098395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516100d5-7132-42ed-adc7-2166fee96c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:29.099063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516100d5-7132-42ed-adc7-2166fee96c48 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:29.099348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516100d5-7132-42ed-adc7-2166fee96c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:29.099625 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516100d5-7132-42ed-adc7-2166fee96c48 None admin] PATH_INFO: `/v3/groups` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:29.100347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516100d5-7132-42ed-adc7-2166fee96c48 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:29.101831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516100d5-7132-42ed-adc7-2166fee96c48 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:29.128262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6f524-3f91-40d8-8903-947a891f1c17 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:29.142581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:29.161260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7b611-6b3e-42f3-a5ba-c1dde7bf43f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:29.162129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7b611-6b3e-42f3-a5ba-c1dde7bf43f7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:29.162413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7b611-6b3e-42f3-a5ba-c1dde7bf43f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:29.162688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7b611-6b3e-42f3-a5ba-c1dde7bf43f7 None admin] PATH_INFO: `/v3/users/1cf7614b336a4c45b317dc03c308e337` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:29.163876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7b611-6b3e-42f3-a5ba-c1dde7bf43f7 None admin] RBAC: Authorizing `identity:get_user(user_id=1cf7614b336a4c45b317dc03c308e337)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:29.165476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7b611-6b3e-42f3-a5ba-c1dde7bf43f7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:29.167098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 168/331] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:29 2022] GET /identity/v3/users/1cf7614b336a4c45b317dc03c308e337 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:29.167833 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7b611-6b3e-42f3-a5ba-c1dde7bf43f7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:29.229576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 164/332] 10.222.0.16 () {60 vars in 1134 bytes} [Thu Jun 23 12:51:28 2022] POST /identity/v3/groups => generated 226 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:51:29.230678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516100d5-7132-42ed-adc7-2166fee96c48 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:29.272213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7b611-6b3e-42f3-a5ba-c1dde7bf43f7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:29.311420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402a055-36a4-49b8-8598-697f5d1d2527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:29.312285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402a055-36a4-49b8-8598-697f5d1d2527 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:29.312587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402a055-36a4-49b8-8598-697f5d1d2527 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:29.312881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402a055-36a4-49b8-8598-697f5d1d2527 None admin] PATH_INFO: `/v3/system/users/daac0f8fd43247ec80cbc6ef16f9aac7/roles/4817c412bd3c4291b6a5523de64b2729` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:29.315312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402a055-36a4-49b8-8598-697f5d1d2527 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=daac0f8fd43247ec80cbc6ef16f9aac7, role_id=4817c412bd3c4291b6a5523de64b2729)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:29.316737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402a055-36a4-49b8-8598-697f5d1d2527 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:29.353978 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516100d5-7132-42ed-adc7-2166fee96c48 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:29.378351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 169/333] 10.222.0.16 () {58 vars in 1334 bytes} [Thu Jun 23 12:51:29 2022] PUT /identity/v3/system/users/daac0f8fd43247ec80cbc6ef16f9aac7/roles/4817c412bd3c4291b6a5523de64b2729 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:29.394113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ba4c3-4b01-477d-b6c5-55fd8925d3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:29.394799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba4c3-4b01-477d-b6c5-55fd8925d3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:29.395084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba4c3-4b01-477d-b6c5-55fd8925d3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:29.395368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ba4c3-4b01-477d-b6c5-55fd8925d3c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:29.396232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba4c3-4b01-477d-b6c5-55fd8925d3c8 None admin] RBAC: Adding query filter params (role.id=3d2f155e5f1f4acbaff64a9c464d9d92, user.id=1cf7614b336a4c45b317dc03c308e337, scope.system=all) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:29.396546 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba4c3-4b01-477d-b6c5-55fd8925d3c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:29.398331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ba4c3-4b01-477d-b6c5-55fd8925d3c8 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:29.414204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 165/334] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Jun 23 12:51:29 2022] GET /identity/v3/role_assignments?user.id=1cf7614b336a4c45b317dc03c308e337&scope.system=all&role.id=3d2f155e5f1f4acbaff64a9c464d9d92 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:31.748610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b0d85-6bfe-4c0f-9202-99577f595d2d None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:31.749170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b0d85-6bfe-4c0f-9202-99577f595d2d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:31.749170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b0d85-6bfe-4c0f-9202-99577f595d2d None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:31.750897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 170/335] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:31.756861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98831345-9598-4455-acfe-07f9e2d464c3 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:31.757297 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98831345-9598-4455-acfe-07f9e2d464c3 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:31.757495 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98831345-9598-4455-acfe-07f9e2d464c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:31.783812 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-98831345-9598-4455-acfe-07f9e2d464c3 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:31.785571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-98831345-9598-4455-acfe-07f9e2d464c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:31.818271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:31.828187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d6cbb-7754-47ad-94b1-292b217b9f41 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:31.828529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d6cbb-7754-47ad-94b1-292b217b9f41 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:31.829379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19d6cbb-7754-47ad-94b1-292b217b9f41 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:31.832568 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 171/336] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:31.836978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf0778-39e7-4795-ac25-f635ab4cca58 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:31.837208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf0778-39e7-4795-ac25-f635ab4cca58 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:31.837490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf0778-39e7-4795-ac25-f635ab4cca58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:31.862769 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-44bf0778-39e7-4795-ac25-f635ab4cca58 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:31.864006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-44bf0778-39e7-4795-ac25-f635ab4cca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:31.899060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 166/337] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:31.935185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:31.943925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98831345-9598-4455-acfe-07f9e2d464c3 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:31.971793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 172/338] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:32.014317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf0778-39e7-4795-ac25-f635ab4cca58 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:32.158983 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98831345-9598-4455-acfe-07f9e2d464c3 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:32.160609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf0778-39e7-4795-ac25-f635ab4cca58 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:32.218057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2726f0-9463-4292-b937-ad601f9f0e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:32.219137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2726f0-9463-4292-b937-ad601f9f0e1e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:32.219643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2726f0-9463-4292-b937-ad601f9f0e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:32.220096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2726f0-9463-4292-b937-ad601f9f0e1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:32.231211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2726f0-9463-4292-b937-ad601f9f0e1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:32.238119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf00cd-d7fb-4d7b-932f-c54537a33ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:32.239142 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf00cd-d7fb-4d7b-932f-c54537a33ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:32.239585 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf00cd-d7fb-4d7b-932f-c54537a33ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:32.240007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf00cd-d7fb-4d7b-932f-c54537a33ba6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6e2726f0-9463-4292-b937-ad601f9f0e1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:32.243385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:32.244481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:32.245462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:32.245462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:32.245462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:32.245462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:32.245462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:32.245462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:32.245462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:32.245462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:32.245462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:32.245462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:32.245462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 12:51:32.245462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:32.247423 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 173/339] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:32.257955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2726f0-9463-4292-b937-ad601f9f0e1e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:32.276010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf00cd-d7fb-4d7b-932f-c54537a33ba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-27bf00cd-d7fb-4d7b-932f-c54537a33ba6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:32.289732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:32.290687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:32.291698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 167/340] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:32.298290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf00cd-d7fb-4d7b-932f-c54537a33ba6 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:32.313756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:32.353541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:32.427297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2726f0-9463-4292-b937-ad601f9f0e1e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:32.496783 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524ccf4-ce95-42bf-a414-71a7c6d8df05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:32.497486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524ccf4-ce95-42bf-a414-71a7c6d8df05 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:32.497770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524ccf4-ce95-42bf-a414-71a7c6d8df05 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:32.498045 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524ccf4-ce95-42bf-a414-71a7c6d8df05 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:32.499409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524ccf4-ce95-42bf-a414-71a7c6d8df05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:32.499720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524ccf4-ce95-42bf-a414-71a7c6d8df05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:32.501839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524ccf4-ce95-42bf-a414-71a7c6d8df05 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:32.505370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf00cd-d7fb-4d7b-932f-c54537a33ba6 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:32.526002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 174/341] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:32.527487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9170-1c41-4403-bf45-1aa155038920 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:32.527722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9170-1c41-4403-bf45-1aa155038920 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:32.528007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b9170-1c41-4403-bf45-1aa155038920 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:32.529332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 175/342] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:32.530488 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b9170-1c41-4403-bf45-1aa155038920 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:32.587950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9eb194-ae56-45c4-92c9-7ab1241e6457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:32.589022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eb194-ae56-45c4-92c9-7ab1241e6457 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:32.589534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eb194-ae56-45c4-92c9-7ab1241e6457 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:32.590020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9eb194-ae56-45c4-92c9-7ab1241e6457 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:32.591135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9eb194-ae56-45c4-92c9-7ab1241e6457 None admin] RBAC: Adding query filter params (name=member) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:32.591658 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9eb194-ae56-45c4-92c9-7ab1241e6457 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:32.593443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9eb194-ae56-45c4-92c9-7ab1241e6457 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:32.603913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 168/343] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:32.605590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d9b68-b06a-4caa-be0a-5bc7fc09042b None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:32.606045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d9b68-b06a-4caa-be0a-5bc7fc09042b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:32.606485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d9b68-b06a-4caa-be0a-5bc7fc09042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:32.627159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-dd8d9b68-b06a-4caa-be0a-5bc7fc09042b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:32.629831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-dd8d9b68-b06a-4caa-be0a-5bc7fc09042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:32.651427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:32.657887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b9170-1c41-4403-bf45-1aa155038920 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:32.703908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d425ddc-56e1-4a81-b230-04259ccd44d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:32.705460 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d425ddc-56e1-4a81-b230-04259ccd44d8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:32.705922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d425ddc-56e1-4a81-b230-04259ccd44d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:32.706349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d425ddc-56e1-4a81-b230-04259ccd44d8 None admin] PATH_INFO: `/v3/users/daac0f8fd43247ec80cbc6ef16f9aac7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:32.707854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d425ddc-56e1-4a81-b230-04259ccd44d8 None admin] RBAC: Authorizing `identity:get_user(user_id=daac0f8fd43247ec80cbc6ef16f9aac7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:32.709536 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d425ddc-56e1-4a81-b230-04259ccd44d8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:32.711706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 176/344] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:51:32 2022] GET /identity/v3/users/daac0f8fd43247ec80cbc6ef16f9aac7 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:32.713257 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca2cd5-88bf-4392-b4e7-c56cad9129b0 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:32.713753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca2cd5-88bf-4392-b4e7-c56cad9129b0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:32.714249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca2cd5-88bf-4392-b4e7-c56cad9129b0 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:32.715701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 177/345] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:32.721028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca2cd5-88bf-4392-b4e7-c56cad9129b0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:32.748753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 169/346] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:32.750287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d9b68-b06a-4caa-be0a-5bc7fc09042b None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:32.774685 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:32.858153 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca2cd5-88bf-4392-b4e7-c56cad9129b0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:32.893371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d9b68-b06a-4caa-be0a-5bc7fc09042b None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:32.909184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f58dba-78d2-4474-8cf5-3d63600cbcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:32.910218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f58dba-78d2-4474-8cf5-3d63600cbcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:32.910763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f58dba-78d2-4474-8cf5-3d63600cbcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:32.911241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f58dba-78d2-4474-8cf5-3d63600cbcb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:32.929899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82cd43-ecb4-4829-a07b-ad03617875a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:32.931033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82cd43-ecb4-4829-a07b-ad03617875a5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:32.931556 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82cd43-ecb4-4829-a07b-ad03617875a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:32.932020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82cd43-ecb4-4829-a07b-ad03617875a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:32.933028 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82cd43-ecb4-4829-a07b-ad03617875a5 None admin] RBAC: Adding query filter params (role.id=4817c412bd3c4291b6a5523de64b2729, user.id=daac0f8fd43247ec80cbc6ef16f9aac7, scope.system=all) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:32.933530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82cd43-ecb4-4829-a07b-ad03617875a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:32.935234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82cd43-ecb4-4829-a07b-ad03617875a5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:32.950013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:32.950261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 170/347] 10.222.0.16 () {56 vars in 1308 bytes} [Thu Jun 23 12:51:32 2022] GET /identity/v3/role_assignments?user.id=daac0f8fd43247ec80cbc6ef16f9aac7&scope.system=all&role.id=4817c412bd3c4291b6a5523de64b2729 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:32.952550 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c187f26-f331-4950-bb2a-5aa5cf257974 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:32.953096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c187f26-f331-4950-bb2a-5aa5cf257974 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:32.953622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c187f26-f331-4950-bb2a-5aa5cf257974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:32.978398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-7c187f26-f331-4950-bb2a-5aa5cf257974 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:32.980250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7c187f26-f331-4950-bb2a-5aa5cf257974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:33.001821 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f58dba-78d2-4474-8cf5-3d63600cbcb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:33.003633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f58dba-78d2-4474-8cf5-3d63600cbcb5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:33.088154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 171/348] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:33.089370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c187f26-f331-4950-bb2a-5aa5cf257974 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:33.095048 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:33.122403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 178/349] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:33.128148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f58dba-78d2-4474-8cf5-3d63600cbcb5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:33.205182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:33.242230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f58dba-78d2-4474-8cf5-3d63600cbcb5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:33.283532 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4c07c-3e86-42f5-8cdc-777e6fadbb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:33.284798 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4c07c-3e86-42f5-8cdc-777e6fadbb27 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:33.285307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4c07c-3e86-42f5-8cdc-777e6fadbb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:33.285783 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4c07c-3e86-42f5-8cdc-777e6fadbb27 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:33.287241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4c07c-3e86-42f5-8cdc-777e6fadbb27 None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:33.289078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4c07c-3e86-42f5-8cdc-777e6fadbb27 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:33.291327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 179/350] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:33 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:33.292298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4c07c-3e86-42f5-8cdc-777e6fadbb27 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:33.319760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c187f26-f331-4950-bb2a-5aa5cf257974 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:33.368089 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1aa77-89b0-4c5a-b219-274faa07e5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:33.369422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1aa77-89b0-4c5a-b219-274faa07e5df None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:33.369707 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1aa77-89b0-4c5a-b219-274faa07e5df None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:33.369984 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1aa77-89b0-4c5a-b219-274faa07e5df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:33.391102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1aa77-89b0-4c5a-b219-274faa07e5df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-51e1aa77-89b0-4c5a-b219-274faa07e5df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:33.399054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:33.399975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:33.400886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 172/351] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:33.405664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1aa77-89b0-4c5a-b219-274faa07e5df None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:33.419653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4c07c-3e86-42f5-8cdc-777e6fadbb27 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:33.463333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ac565-3413-4636-9a6a-a85ce1906211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:33.464464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ac565-3413-4636-9a6a-a85ce1906211 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:33.464753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ac565-3413-4636-9a6a-a85ce1906211 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:33.465077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ac565-3413-4636-9a6a-a85ce1906211 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:33.467821 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:33.479440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ac565-3413-4636-9a6a-a85ce1906211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-0a5ac565-3413-4636-9a6a-a85ce1906211 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:33.489261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:33.502676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:33.503623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:33.503623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:33.503623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:33.503623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:33.503623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:33.503623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:33.503623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:33.503623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:33.503623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:33.503623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:33.503623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:33.503623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:33.504232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:33.504304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 180/352] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:51:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:33.504304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db06bf8-a2fd-43df-a7ee-0d23f28f1f79 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:33.504304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db06bf8-a2fd-43df-a7ee-0d23f28f1f79 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:33.504304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db06bf8-a2fd-43df-a7ee-0d23f28f1f79 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:33.504304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 181/353] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:33.504304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db06bf8-a2fd-43df-a7ee-0d23f28f1f79 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:33.551595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1aa77-89b0-4c5a-b219-274faa07e5df None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:33.595410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab612f7-3bce-494a-8b5b-60671f93bf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:33.597386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab612f7-3bce-494a-8b5b-60671f93bf08 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:33.597836 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab612f7-3bce-494a-8b5b-60671f93bf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:33.598122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab612f7-3bce-494a-8b5b-60671f93bf08 None admin] PATH_INFO: `/v3/groups/8e45e9096d724588904d9826d19b1320` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:33.605749 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab612f7-3bce-494a-8b5b-60671f93bf08 None admin] RBAC: Authorizing `identity:get_group(group_id=8e45e9096d724588904d9826d19b1320)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:33.607239 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab612f7-3bce-494a-8b5b-60671f93bf08 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:33.609225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 173/354] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:33 2022] GET /identity/v3/groups/8e45e9096d724588904d9826d19b1320 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:33.610807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab612f7-3bce-494a-8b5b-60671f93bf08 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:33.638893 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db06bf8-a2fd-43df-a7ee-0d23f28f1f79 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:33.686025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510e98a-7279-4786-98c3-75f9ba9c34fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:33.686904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510e98a-7279-4786-98c3-75f9ba9c34fb None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:33.687229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510e98a-7279-4786-98c3-75f9ba9c34fb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:33.687508 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510e98a-7279-4786-98c3-75f9ba9c34fb None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:33.688471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510e98a-7279-4786-98c3-75f9ba9c34fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:33.689141 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510e98a-7279-4786-98c3-75f9ba9c34fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:33.691143 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510e98a-7279-4786-98c3-75f9ba9c34fb None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:33.702640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 182/355] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:33.703941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713aafc-fddf-49f2-8a69-0212b3a5abbe None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:33.704229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713aafc-fddf-49f2-8a69-0212b3a5abbe None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:33.704659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713aafc-fddf-49f2-8a69-0212b3a5abbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:33.726537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2713aafc-fddf-49f2-8a69-0212b3a5abbe None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:33.727856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2713aafc-fddf-49f2-8a69-0212b3a5abbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:33.746128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab612f7-3bce-494a-8b5b-60671f93bf08 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:33.786036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:33.793130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:33.795254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e79892-cdcb-4a2f-b7b6-dc7988bae95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:33.796738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e79892-cdcb-4a2f-b7b6-dc7988bae95c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:33.812078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e79892-cdcb-4a2f-b7b6-dc7988bae95c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:33.812078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e79892-cdcb-4a2f-b7b6-dc7988bae95c None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:33.812078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e79892-cdcb-4a2f-b7b6-dc7988bae95c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:33.812078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e79892-cdcb-4a2f-b7b6-dc7988bae95c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:33.812078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e79892-cdcb-4a2f-b7b6-dc7988bae95c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:33.812478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 174/356] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:33.816368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e79892-cdcb-4a2f-b7b6-dc7988bae95c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:33.818366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 183/357] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:33.819793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713aafc-fddf-49f2-8a69-0212b3a5abbe None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:33.935583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713aafc-fddf-49f2-8a69-0212b3a5abbe None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:33.942219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e79892-cdcb-4a2f-b7b6-dc7988bae95c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:33.979545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775ab64-bb7e-4f1f-a10a-971ad4ec660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:33.981316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ab64-bb7e-4f1f-a10a-971ad4ec660c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:33.981596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ab64-bb7e-4f1f-a10a-971ad4ec660c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:33.982581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ab64-bb7e-4f1f-a10a-971ad4ec660c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:33.984630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be7d16-74d4-45a0-822a-c5803a9c3c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:33.986201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be7d16-74d4-45a0-822a-c5803a9c3c4e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:33.986713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be7d16-74d4-45a0-822a-c5803a9c3c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:33.987226 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be7d16-74d4-45a0-822a-c5803a9c3c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:33.988854 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be7d16-74d4-45a0-822a-c5803a9c3c4e None admin] RBAC: Adding query filter params (group.id=8e45e9096d724588904d9826d19b1320, role.id=3d2f155e5f1f4acbaff64a9c464d9d92, scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:33.989450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be7d16-74d4-45a0-822a-c5803a9c3c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:33.991293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be7d16-74d4-45a0-822a-c5803a9c3c4e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:33.999438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 175/358] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 23 12:51:33 2022] GET /identity/v3/role_assignments?group.id=8e45e9096d724588904d9826d19b1320&scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0&role.id=3d2f155e5f1f4acbaff64a9c464d9d92 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:34.001670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be7d16-74d4-45a0-822a-c5803a9c3c4e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:34.061756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:34.072914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:34.074146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775ab64-bb7e-4f1f-a10a-971ad4ec660c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:34.080048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775ab64-bb7e-4f1f-a10a-971ad4ec660c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:34.142035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be7d16-74d4-45a0-822a-c5803a9c3c4e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:34.193325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949195a-e1c6-4cc5-9ce5-603c5b4b1ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:34.194831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949195a-e1c6-4cc5-9ce5-603c5b4b1ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:34.195130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949195a-e1c6-4cc5-9ce5-603c5b4b1ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:34.195413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949195a-e1c6-4cc5-9ce5-603c5b4b1ae7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:34.202358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 184/359] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:34.204379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadda1e-f3b0-4791-831e-71441ce06d8f None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:34.205041 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadda1e-f3b0-4791-831e-71441ce06d8f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:34.205041 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faadda1e-f3b0-4791-831e-71441ce06d8f None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:34.206212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 185/360] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:34.206907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadda1e-f3b0-4791-831e-71441ce06d8f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:34.286325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949195a-e1c6-4cc5-9ce5-603c5b4b1ae7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:34.287824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949195a-e1c6-4cc5-9ce5-603c5b4b1ae7 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:34.323217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:34.343008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faadda1e-f3b0-4791-831e-71441ce06d8f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:34.368161 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:34.388394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a73056-7f3b-44f5-a1cf-df5bfc807f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:34.389258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a73056-7f3b-44f5-a1cf-df5bfc807f74 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:34.389546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a73056-7f3b-44f5-a1cf-df5bfc807f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:34.389824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a73056-7f3b-44f5-a1cf-df5bfc807f74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:34.403111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a73056-7f3b-44f5-a1cf-df5bfc807f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-19a73056-7f3b-44f5-a1cf-df5bfc807f74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:34.412069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:34.413093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:34.413922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 186/361] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:51:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:34.415044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ac1e8-bc6b-4a81-bf46-0607111bd07f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:34.415044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ac1e8-bc6b-4a81-bf46-0607111bd07f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:34.415345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ac1e8-bc6b-4a81-bf46-0607111bd07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:34.431973 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 176/362] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:34.432504 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949195a-e1c6-4cc5-9ce5-603c5b4b1ae7 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:34.440340 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a54ac1e8-bc6b-4a81-bf46-0607111bd07f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:34.441689 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a54ac1e8-bc6b-4a81-bf46-0607111bd07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:34.534276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 187/363] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:34.535607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ac1e8-bc6b-4a81-bf46-0607111bd07f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:34.568920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949195a-e1c6-4cc5-9ce5-603c5b4b1ae7 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:34.623904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d389cfe-b1ce-4702-9f66-389658a4fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:34.625255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d389cfe-b1ce-4702-9f66-389658a4fb2d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:34.626252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d389cfe-b1ce-4702-9f66-389658a4fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:34.626517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d389cfe-b1ce-4702-9f66-389658a4fb2d None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:34.627772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d389cfe-b1ce-4702-9f66-389658a4fb2d None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:34.629275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d389cfe-b1ce-4702-9f66-389658a4fb2d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:34.631121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 177/364] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:34 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:34.633944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d389cfe-b1ce-4702-9f66-389658a4fb2d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:34.647306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:34.669541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:34.675083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ac1e8-bc6b-4a81-bf46-0607111bd07f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:34.719713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bae80f-084a-4f76-b1a0-1415bbc0fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:34.720485 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bae80f-084a-4f76-b1a0-1415bbc0fea6 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:34.720782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bae80f-084a-4f76-b1a0-1415bbc0fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:34.725882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bae80f-084a-4f76-b1a0-1415bbc0fea6 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:34.725882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bae80f-084a-4f76-b1a0-1415bbc0fea6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:34.725882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bae80f-084a-4f76-b1a0-1415bbc0fea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:34.725882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bae80f-084a-4f76-b1a0-1415bbc0fea6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:34.732294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 188/365] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:34.733355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bae80f-084a-4f76-b1a0-1415bbc0fea6 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:34.763425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d389cfe-b1ce-4702-9f66-389658a4fb2d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:34.804120 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5afd8a-7e86-40d5-93f9-8e2eaa992536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:34.804993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5afd8a-7e86-40d5-93f9-8e2eaa992536 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:34.805273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5afd8a-7e86-40d5-93f9-8e2eaa992536 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:34.805542 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5afd8a-7e86-40d5-93f9-8e2eaa992536 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:34.806735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5afd8a-7e86-40d5-93f9-8e2eaa992536 None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:34.808172 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5afd8a-7e86-40d5-93f9-8e2eaa992536 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:34.811489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 178/366] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:34 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:34.811489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5afd8a-7e86-40d5-93f9-8e2eaa992536 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:34.886610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bae80f-084a-4f76-b1a0-1415bbc0fea6 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:34.933311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:34.937525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b7223-f046-4932-9835-2cbb121f73aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:34.938901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b7223-f046-4932-9835-2cbb121f73aa None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:34.939188 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b7223-f046-4932-9835-2cbb121f73aa None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:34.939470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b7223-f046-4932-9835-2cbb121f73aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:34.946345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5afd8a-7e86-40d5-93f9-8e2eaa992536 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:34.952474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:34.956286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b7223-f046-4932-9835-2cbb121f73aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-323b7223-f046-4932-9835-2cbb121f73aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:34.964225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:34.965271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:34.966073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:34.966073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:34.966073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:34.966073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:34.966073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:34.966073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:34.966073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:34.966073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:34.966073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:34.966073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:34.966073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:34.966073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:34.970903 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 189/367] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:51:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:34.971799 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b7223-f046-4932-9835-2cbb121f73aa None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:34.992730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc58291-8b5d-4b7b-a3af-6a19f0fdc0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:34.993626 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc58291-8b5d-4b7b-a3af-6a19f0fdc0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:34.993909 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc58291-8b5d-4b7b-a3af-6a19f0fdc0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:34.994183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc58291-8b5d-4b7b-a3af-6a19f0fdc0a8 None admin] PATH_INFO: `/v3/groups/8e45e9096d724588904d9826d19b1320` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:34.995586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc58291-8b5d-4b7b-a3af-6a19f0fdc0a8 None admin] RBAC: Authorizing `identity:get_group(group_id=8e45e9096d724588904d9826d19b1320)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:34.997082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc58291-8b5d-4b7b-a3af-6a19f0fdc0a8 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:34.999043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 179/368] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:34 2022] GET /identity/v3/groups/8e45e9096d724588904d9826d19b1320 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:34.999801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc58291-8b5d-4b7b-a3af-6a19f0fdc0a8 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:35.111264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b7223-f046-4932-9835-2cbb121f73aa None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:35.130540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc58291-8b5d-4b7b-a3af-6a19f0fdc0a8 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:35.153464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcf1a2-f5f7-4213-8d76-13b1d93577b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:35.154126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcf1a2-f5f7-4213-8d76-13b1d93577b8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:35.154409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcf1a2-f5f7-4213-8d76-13b1d93577b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:35.154686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcf1a2-f5f7-4213-8d76-13b1d93577b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:35.178291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ae267-75b6-464c-ad17-60fccc1ea576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:35.179539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ae267-75b6-464c-ad17-60fccc1ea576 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:35.180082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ae267-75b6-464c-ad17-60fccc1ea576 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:35.180511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ae267-75b6-464c-ad17-60fccc1ea576 None admin] PATH_INFO: `/v3/groups/8e45e9096d724588904d9826d19b1320` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:35.181937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ae267-75b6-464c-ad17-60fccc1ea576 None admin] RBAC: Authorizing `identity:get_group(group_id=8e45e9096d724588904d9826d19b1320)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:35.183614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ae267-75b6-464c-ad17-60fccc1ea576 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:35.189249 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 180/369] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:34 2022] GET /identity/v3/groups/8e45e9096d724588904d9826d19b1320 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:35.189249 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ae267-75b6-464c-ad17-60fccc1ea576 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:35.224459 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:35.233821 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:35.241079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcf1a2-f5f7-4213-8d76-13b1d93577b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:35.241397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcf1a2-f5f7-4213-8d76-13b1d93577b8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:35.320568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ae267-75b6-464c-ad17-60fccc1ea576 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:35.364134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b015750-9440-40d2-afe4-28ac91a1d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:35.366907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b015750-9440-40d2-afe4-28ac91a1d635 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:35.366907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b015750-9440-40d2-afe4-28ac91a1d635 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:35.366907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b015750-9440-40d2-afe4-28ac91a1d635 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:35.366907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b015750-9440-40d2-afe4-28ac91a1d635 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:35.366907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b015750-9440-40d2-afe4-28ac91a1d635 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:35.368769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b015750-9440-40d2-afe4-28ac91a1d635 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:35.380165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 181/370] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:35.381395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b015750-9440-40d2-afe4-28ac91a1d635 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:35.382873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 190/371] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:35.383638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcf1a2-f5f7-4213-8d76-13b1d93577b8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:35.494084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:35.510498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b015750-9440-40d2-afe4-28ac91a1d635 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:35.510668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcf1a2-f5f7-4213-8d76-13b1d93577b8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:35.513100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:35.552116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d237d7c-81cc-434c-8c6a-c0684b3697b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:35.552777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d237d7c-81cc-434c-8c6a-c0684b3697b4 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:35.553088 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d237d7c-81cc-434c-8c6a-c0684b3697b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:35.553361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d237d7c-81cc-434c-8c6a-c0684b3697b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:35.554239 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d237d7c-81cc-434c-8c6a-c0684b3697b4 None admin] RBAC: Adding query filter params (group.id=8e45e9096d724588904d9826d19b1320, role.id=3d2f155e5f1f4acbaff64a9c464d9d92, scope.project.id=2343001f1c2e4e549eea7d3fa97e5303) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:35.554552 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d237d7c-81cc-434c-8c6a-c0684b3697b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:35.555646 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34355eed-18e7-4c88-a097-c93470387952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:35.555988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d237d7c-81cc-434c-8c6a-c0684b3697b4 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:35.556613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34355eed-18e7-4c88-a097-c93470387952 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:35.557081 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34355eed-18e7-4c88-a097-c93470387952 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:35.557497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34355eed-18e7-4c88-a097-c93470387952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:35.558662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34355eed-18e7-4c88-a097-c93470387952 None admin] RBAC: Adding query filter params (group.id=8e45e9096d724588904d9826d19b1320, role.id=d773dfde38e5426799f6b947044767bb, scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:35.558985 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34355eed-18e7-4c88-a097-c93470387952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:35.561966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34355eed-18e7-4c88-a097-c93470387952 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:35.566999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 182/372] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 23 12:51:35 2022] GET /identity/v3/role_assignments?group.id=8e45e9096d724588904d9826d19b1320&scope.project.id=2343001f1c2e4e549eea7d3fa97e5303&role.id=3d2f155e5f1f4acbaff64a9c464d9d92 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:35.567772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d237d7c-81cc-434c-8c6a-c0684b3697b4 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:35.572372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 191/373] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 23 12:51:35 2022] GET /identity/v3/role_assignments?group.id=8e45e9096d724588904d9826d19b1320&scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0&role.id=d773dfde38e5426799f6b947044767bb => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:35.577584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34355eed-18e7-4c88-a097-c93470387952 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:35.748881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34355eed-18e7-4c88-a097-c93470387952 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:35.762934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d237d7c-81cc-434c-8c6a-c0684b3697b4 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:35.795165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f377562-153e-496c-8cd4-963909144b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:35.795844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f377562-153e-496c-8cd4-963909144b77 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:35.797176 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f377562-153e-496c-8cd4-963909144b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:35.798523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f377562-153e-496c-8cd4-963909144b77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:35.832514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19fbbc-4812-4e19-bc86-f3f990afa728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:35.833423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19fbbc-4812-4e19-bc86-f3f990afa728 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:35.833688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19fbbc-4812-4e19-bc86-f3f990afa728 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:35.833974 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19fbbc-4812-4e19-bc86-f3f990afa728 None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:35.835156 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19fbbc-4812-4e19-bc86-f3f990afa728 None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:35.836887 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19fbbc-4812-4e19-bc86-f3f990afa728 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:35.842085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 183/374] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:35 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:35.843836 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19fbbc-4812-4e19-bc86-f3f990afa728 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:35.847387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:35.887429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:35.888156 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f377562-153e-496c-8cd4-963909144b77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:35.889796 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f377562-153e-496c-8cd4-963909144b77 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:35.959592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19fbbc-4812-4e19-bc86-f3f990afa728 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:35.994659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517cfd2-d523-41d4-9c8f-131c49455e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:35.995855 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517cfd2-d523-41d4-9c8f-131c49455e16 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:35.996311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517cfd2-d523-41d4-9c8f-131c49455e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:35.996958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f517cfd2-d523-41d4-9c8f-131c49455e16 None admin] PATH_INFO: `/v3/groups/8e45e9096d724588904d9826d19b1320` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:35.998363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517cfd2-d523-41d4-9c8f-131c49455e16 None admin] RBAC: Authorizing `identity:get_group(group_id=8e45e9096d724588904d9826d19b1320)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:36.000091 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f517cfd2-d523-41d4-9c8f-131c49455e16 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:36.002848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 184/375] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:35 2022] GET /identity/v3/groups/8e45e9096d724588904d9826d19b1320 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:36.009888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517cfd2-d523-41d4-9c8f-131c49455e16 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:36.092000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 192/376] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:36.097411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f377562-153e-496c-8cd4-963909144b77 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:36.100915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:36.114916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f517cfd2-d523-41d4-9c8f-131c49455e16 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:36.151830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff77049-eade-415d-85a3-53b45f6efd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:36.152786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff77049-eade-415d-85a3-53b45f6efd52 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:36.153279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff77049-eade-415d-85a3-53b45f6efd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:36.153752 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff77049-eade-415d-85a3-53b45f6efd52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:36.154766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff77049-eade-415d-85a3-53b45f6efd52 None admin] RBAC: Adding query filter params (group.id=8e45e9096d724588904d9826d19b1320, role.id=d773dfde38e5426799f6b947044767bb, scope.project.id=2343001f1c2e4e549eea7d3fa97e5303) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:36.155270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff77049-eade-415d-85a3-53b45f6efd52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:36.157017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff77049-eade-415d-85a3-53b45f6efd52 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:36.163310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 185/377] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 23 12:51:36 2022] GET /identity/v3/role_assignments?group.id=8e45e9096d724588904d9826d19b1320&scope.project.id=2343001f1c2e4e549eea7d3fa97e5303&role.id=d773dfde38e5426799f6b947044767bb => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:36.223562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:36.294027 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19abc-da8d-471b-9282-062b7f2934bf None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:36.294219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19abc-da8d-471b-9282-062b7f2934bf None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:36.294511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f19abc-da8d-471b-9282-062b7f2934bf None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:36.296161 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 186/378] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:51:36.302307 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91fe02-d07c-40bf-b617-fa8f1227f3d6 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:36.302596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91fe02-d07c-40bf-b617-fa8f1227f3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:36.302879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91fe02-d07c-40bf-b617-fa8f1227f3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:36.310194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f377562-153e-496c-8cd4-963909144b77 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:36.333966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-1f91fe02-d07c-40bf-b617-fa8f1227f3d6 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:36.335202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1f91fe02-d07c-40bf-b617-fa8f1227f3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:36.353023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21a502-b59b-4174-b46c-aac7aeba7a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:36.353898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21a502-b59b-4174-b46c-aac7aeba7a06 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:36.354180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21a502-b59b-4174-b46c-aac7aeba7a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:36.354456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21a502-b59b-4174-b46c-aac7aeba7a06 None admin] PATH_INFO: `/v3/projects/1fdf0ec9cffa45efa95f679088c42ed8` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:36.355663 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21a502-b59b-4174-b46c-aac7aeba7a06 None admin] RBAC: Authorizing `identity:get_project(project_id=1fdf0ec9cffa45efa95f679088c42ed8)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:36.357384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21a502-b59b-4174-b46c-aac7aeba7a06 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:36.364054 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 193/379] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:36 2022] GET /identity/v3/projects/1fdf0ec9cffa45efa95f679088c42ed8 => generated 344 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:36.365581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21a502-b59b-4174-b46c-aac7aeba7a06 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:36.424647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 187/380] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:36.460378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91fe02-d07c-40bf-b617-fa8f1227f3d6 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:36.475579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21a502-b59b-4174-b46c-aac7aeba7a06 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:36.506219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:36.512859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435aeee-878b-4a1b-aff4-a781ec062b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:36.513736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435aeee-878b-4a1b-aff4-a781ec062b70 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:36.514022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435aeee-878b-4a1b-aff4-a781ec062b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:36.514302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a435aeee-878b-4a1b-aff4-a781ec062b70 None admin] PATH_INFO: `/v3/groups/2eef1c05aefb4fa0b89c612c2eb73dd2` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:36.521373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435aeee-878b-4a1b-aff4-a781ec062b70 None admin] RBAC: Authorizing `identity:get_group(group_id=2eef1c05aefb4fa0b89c612c2eb73dd2)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:36.525543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a435aeee-878b-4a1b-aff4-a781ec062b70 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:36.525543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 194/381] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:36 2022] GET /identity/v3/groups/2eef1c05aefb4fa0b89c612c2eb73dd2 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:36.530554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435aeee-878b-4a1b-aff4-a781ec062b70 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:36.594618 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:36.627003 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91fe02-d07c-40bf-b617-fa8f1227f3d6 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:36.686714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a435aeee-878b-4a1b-aff4-a781ec062b70 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:36.699046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee4102-d6b7-44ba-bb9b-8b4d8a21e8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:36.699853 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee4102-d6b7-44ba-bb9b-8b4d8a21e8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:36.700135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee4102-d6b7-44ba-bb9b-8b4d8a21e8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:36.700409 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee4102-d6b7-44ba-bb9b-8b4d8a21e8a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:36.726354 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee4102-d6b7-44ba-bb9b-8b4d8a21e8a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-e1ee4102-d6b7-44ba-bb9b-8b4d8a21e8a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:36.739268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:36.740224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:36.741408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 188/382] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:36.746348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee4102-d6b7-44ba-bb9b-8b4d8a21e8a0 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:36.762118 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd86815-5d25-48e2-af7c-334f5ea8d424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:36.763107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd86815-5d25-48e2-af7c-334f5ea8d424 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:36.763602 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd86815-5d25-48e2-af7c-334f5ea8d424 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:36.764067 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd86815-5d25-48e2-af7c-334f5ea8d424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:36.765421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd86815-5d25-48e2-af7c-334f5ea8d424 None admin] RBAC: Adding query filter params (group.id=2eef1c05aefb4fa0b89c612c2eb73dd2, role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=1fdf0ec9cffa45efa95f679088c42ed8) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:36.766578 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd86815-5d25-48e2-af7c-334f5ea8d424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:36.768785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd86815-5d25-48e2-af7c-334f5ea8d424 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:36.780911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 195/383] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 23 12:51:36 2022] GET /identity/v3/role_assignments?group.id=2eef1c05aefb4fa0b89c612c2eb73dd2&scope.project.id=1fdf0ec9cffa45efa95f679088c42ed8&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:36.899939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee4102-d6b7-44ba-bb9b-8b4d8a21e8a0 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:36.950108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522edb-43c5-4850-8415-53d7f1784e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:36.951144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522edb-43c5-4850-8415-53d7f1784e7e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:36.951678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522edb-43c5-4850-8415-53d7f1784e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:36.952150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522edb-43c5-4850-8415-53d7f1784e7e None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:36.953253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9522edb-43c5-4850-8415-53d7f1784e7e None admin] RBAC: Adding query filter params (name=member) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:36.953838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9522edb-43c5-4850-8415-53d7f1784e7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:36.955438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9522edb-43c5-4850-8415-53d7f1784e7e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:36.965167 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 189/384] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:36.974139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd86815-5d25-48e2-af7c-334f5ea8d424 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:37.058600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:37.123471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd86815-5d25-48e2-af7c-334f5ea8d424 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:37.175349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3f67-19a6-430a-bb16-a7e3c2d28da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:37.176222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3f67-19a6-430a-bb16-a7e3c2d28da0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:37.176511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3f67-19a6-430a-bb16-a7e3c2d28da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:37.176791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f3f67-19a6-430a-bb16-a7e3c2d28da0 None admin] PATH_INFO: `/v3/groups/8e45e9096d724588904d9826d19b1320` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:37.178043 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f3f67-19a6-430a-bb16-a7e3c2d28da0 None admin] RBAC: Authorizing `identity:get_group(group_id=8e45e9096d724588904d9826d19b1320)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:37.179458 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f3f67-19a6-430a-bb16-a7e3c2d28da0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:37.181415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 196/385] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:36 2022] GET /identity/v3/groups/8e45e9096d724588904d9826d19b1320 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:37.186924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522edb-43c5-4850-8415-53d7f1784e7e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:37.197147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:37.325102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522edb-43c5-4850-8415-53d7f1784e7e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:37.376609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21087696-58b2-463e-b4f5-1284d9d1d136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:37.377428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21087696-58b2-463e-b4f5-1284d9d1d136 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:37.377712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21087696-58b2-463e-b4f5-1284d9d1d136 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:37.377991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21087696-58b2-463e-b4f5-1284d9d1d136 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:37.381525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21087696-58b2-463e-b4f5-1284d9d1d136 None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:37.382981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21087696-58b2-463e-b4f5-1284d9d1d136 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:37.385045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 190/386] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:37 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:37.390582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3f67-19a6-430a-bb16-a7e3c2d28da0 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:37.540878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f3f67-19a6-430a-bb16-a7e3c2d28da0 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:37.578818 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:37.588117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb0d90-ab28-4956-a308-e2dde6206d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:37.589043 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb0d90-ab28-4956-a308-e2dde6206d6a None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:37.589332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb0d90-ab28-4956-a308-e2dde6206d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:37.589615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb0d90-ab28-4956-a308-e2dde6206d6a None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0/groups/8e45e9096d724588904d9826d19b1320/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:37.591599 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb0d90-ab28-4956-a308-e2dde6206d6a None admin] RBAC: Authorizing `identity:create_grant(project_id=4ff3c74fe05b404b94de5c9958d7f5d0, group_id=8e45e9096d724588904d9826d19b1320, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:37.594081 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb0d90-ab28-4956-a308-e2dde6206d6a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:37.721276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 197/387] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jun 23 12:51:37 2022] PUT /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0/groups/8e45e9096d724588904d9826d19b1320/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:38.081795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714d2c-60b3-4ed0-9156-eb4adc75a714 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:38.082308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714d2c-60b3-4ed0-9156-eb4adc75a714 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:38.082412 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2714d2c-60b3-4ed0-9156-eb4adc75a714 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:38.083704 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 191/388] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:38.090042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c6b0a-9dab-41d9-9ede-722f67cb4ea3 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:38.090335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c6b0a-9dab-41d9-9ede-722f67cb4ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:38.090614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c6b0a-9dab-41d9-9ede-722f67cb4ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:38.108676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ef5c6b0a-9dab-41d9-9ede-722f67cb4ea3 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:38.110172 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ef5c6b0a-9dab-41d9-9ede-722f67cb4ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:38.160313 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12b90-217d-413f-860a-62516d504ffd None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:38.160625 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12b90-217d-413f-860a-62516d504ffd None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:38.160887 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec12b90-217d-413f-860a-62516d504ffd None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:38.163016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 192/389] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:38.169294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f1c1-9ece-44f0-ae93-88ae2d484a44 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:38.169575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f1c1-9ece-44f0-ae93-88ae2d484a44 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:38.169852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46f1c1-9ece-44f0-ae93-88ae2d484a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:38.204896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-fb46f1c1-9ece-44f0-ae93-88ae2d484a44 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:38.207508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fb46f1c1-9ece-44f0-ae93-88ae2d484a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:38.214066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 198/390] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:38.237844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c6b0a-9dab-41d9-9ede-722f67cb4ea3 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:38.320958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 193/391] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:38.341823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c6b0a-9dab-41d9-9ede-722f67cb4ea3 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:38.360563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:38.362392 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46f1c1-9ece-44f0-ae93-88ae2d484a44 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:38.364730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:38.378933 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0821-16bc-45f4-9d80-314c4d6dac62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:38.393906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0821-16bc-45f4-9d80-314c4d6dac62 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:38.393906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0821-16bc-45f4-9d80-314c4d6dac62 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:38.393906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a0821-16bc-45f4-9d80-314c4d6dac62 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:38.393906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a0821-16bc-45f4-9d80-314c4d6dac62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-009a0821-16bc-45f4-9d80-314c4d6dac62 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:38.399976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:38.400877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:38.401653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:38.401653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:38.401653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:38.401653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:38.401653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:38.401653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:38.401653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:38.401653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:38.401653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:38.401653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:38.401653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:38.401653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:38.404909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 199/392] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:51:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:38.408096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0821-16bc-45f4-9d80-314c4d6dac62 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:38.509592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a0821-16bc-45f4-9d80-314c4d6dac62 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:38.555415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219bc79-74ec-4ed8-907d-51c3a3823be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:38.556095 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219bc79-74ec-4ed8-907d-51c3a3823be8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:38.556379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219bc79-74ec-4ed8-907d-51c3a3823be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:38.556654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219bc79-74ec-4ed8-907d-51c3a3823be8 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:38.557444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219bc79-74ec-4ed8-907d-51c3a3823be8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:38.557751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219bc79-74ec-4ed8-907d-51c3a3823be8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:38.559170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219bc79-74ec-4ed8-907d-51c3a3823be8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:38.566614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46f1c1-9ece-44f0-ae93-88ae2d484a44 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:38.586494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 200/393] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:38.589580 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219bc79-74ec-4ed8-907d-51c3a3823be8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:38.638529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d392b5f-42c5-4d05-a85e-641f7d1e93a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:38.639261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d392b5f-42c5-4d05-a85e-641f7d1e93a2 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:38.639545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d392b5f-42c5-4d05-a85e-641f7d1e93a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:38.640086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d392b5f-42c5-4d05-a85e-641f7d1e93a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:38.663530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:38.666809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d392b5f-42c5-4d05-a85e-641f7d1e93a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-7d392b5f-42c5-4d05-a85e-641f7d1e93a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:38.679279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:38.681430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:38.682212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:38.682212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:38.682212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:38.682212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:38.682212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:38.682212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:38.682212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:38.682212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:38.682212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:38.682212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:38.682212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:38.682212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:38.685387 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 194/394] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:38.690761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d392b5f-42c5-4d05-a85e-641f7d1e93a2 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:38.759435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219bc79-74ec-4ed8-907d-51c3a3823be8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:38.780850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:38.799705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca977d-9b78-47e5-9fe7-1324f64f1c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:38.800683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca977d-9b78-47e5-9fe7-1324f64f1c4c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:38.801068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca977d-9b78-47e5-9fe7-1324f64f1c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:38.801410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca977d-9b78-47e5-9fe7-1324f64f1c4c None admin] PATH_INFO: `/v3/groups/8e45e9096d724588904d9826d19b1320` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:38.802791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca977d-9b78-47e5-9fe7-1324f64f1c4c None admin] RBAC: Authorizing `identity:get_group(group_id=8e45e9096d724588904d9826d19b1320)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:38.804454 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca977d-9b78-47e5-9fe7-1324f64f1c4c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:38.806543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 201/395] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:38 2022] GET /identity/v3/groups/8e45e9096d724588904d9826d19b1320 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:38.807871 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cb8f5-b673-454f-905f-2772f8153fc0 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:38.808229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cb8f5-b673-454f-905f-2772f8153fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:38.808573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cb8f5-b673-454f-905f-2772f8153fc0 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:38.813113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 202/396] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:38.817495 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905fb84-303f-4919-b649-19f75edb6c19 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:38.817883 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905fb84-303f-4919-b649-19f75edb6c19 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:38.818230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905fb84-303f-4919-b649-19f75edb6c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:38.834244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d392b5f-42c5-4d05-a85e-641f7d1e93a2 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:38.837636 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6905fb84-303f-4919-b649-19f75edb6c19 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:38.838956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6905fb84-303f-4919-b649-19f75edb6c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:38.874206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e32332-734d-46a7-841f-b80d091cb452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:38.874908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32332-734d-46a7-841f-b80d091cb452 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:38.875461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32332-734d-46a7-841f-b80d091cb452 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:38.875781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e32332-734d-46a7-841f-b80d091cb452 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:38.876514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e32332-734d-46a7-841f-b80d091cb452 None admin] RBAC: Adding query filter params (name=member) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:38.876838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e32332-734d-46a7-841f-b80d091cb452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:38.879086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e32332-734d-46a7-841f-b80d091cb452 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:38.890783 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 195/397] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:38.892568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e32332-734d-46a7-841f-b80d091cb452 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:38.933019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 203/398] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:38.934267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905fb84-303f-4919-b649-19f75edb6c19 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:38.988227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:39.008930 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e32332-734d-46a7-841f-b80d091cb452 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:39.035055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:39.046144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22f658-5be9-408c-a5e7-708ffcbfcdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:39.047559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22f658-5be9-408c-a5e7-708ffcbfcdba None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:39.047991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22f658-5be9-408c-a5e7-708ffcbfcdba None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:39.048274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22f658-5be9-408c-a5e7-708ffcbfcdba None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:39.049611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22f658-5be9-408c-a5e7-708ffcbfcdba None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:39.051066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22f658-5be9-408c-a5e7-708ffcbfcdba None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:39.057659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 196/399] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:38 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:39.058612 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22f658-5be9-408c-a5e7-708ffcbfcdba None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:39.064199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905fb84-303f-4919-b649-19f75edb6c19 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:39.104479 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa44ef-7336-45ae-8939-f3df0ec910cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:39.105841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa44ef-7336-45ae-8939-f3df0ec910cf None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:39.106340 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa44ef-7336-45ae-8939-f3df0ec910cf None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:39.106895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa44ef-7336-45ae-8939-f3df0ec910cf None admin] PATH_INFO: `/v3/groups/8e45e9096d724588904d9826d19b1320` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:39.108369 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa44ef-7336-45ae-8939-f3df0ec910cf None admin] RBAC: Authorizing `identity:get_group(group_id=8e45e9096d724588904d9826d19b1320)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:39.110636 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa44ef-7336-45ae-8939-f3df0ec910cf None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:39.113016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 204/400] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:38 2022] GET /identity/v3/groups/8e45e9096d724588904d9826d19b1320 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:39.114034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa44ef-7336-45ae-8939-f3df0ec910cf None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:39.172892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22f658-5be9-408c-a5e7-708ffcbfcdba None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:39.209196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4005e-2aeb-4907-9f4e-14fa4fc266e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:39.210271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4005e-2aeb-4907-9f4e-14fa4fc266e9 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:39.210448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4005e-2aeb-4907-9f4e-14fa4fc266e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:39.210681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4005e-2aeb-4907-9f4e-14fa4fc266e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:39.223331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4005e-2aeb-4907-9f4e-14fa4fc266e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:39.228073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa44ef-7336-45ae-8939-f3df0ec910cf None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:39.231521 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-86d4005e-2aeb-4907-9f4e-14fa4fc266e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:39.232657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:39.233549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:39.234927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:39.234927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:39.234927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:39.234927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:39.234927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:39.234927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:39.234927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:39.234927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:39.234927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:39.234927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:39.234927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:39.234927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:39.239326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 197/401] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:51:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:39.240187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4005e-2aeb-4907-9f4e-14fa4fc266e9 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:39.272388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e02fb-77a8-4db2-905d-098eb32980a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:39.273686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e02fb-77a8-4db2-905d-098eb32980a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:39.274191 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e02fb-77a8-4db2-905d-098eb32980a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:39.274763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e02fb-77a8-4db2-905d-098eb32980a9 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0/groups/8e45e9096d724588904d9826d19b1320/roles/d773dfde38e5426799f6b947044767bb` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:39.277571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e02fb-77a8-4db2-905d-098eb32980a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4ff3c74fe05b404b94de5c9958d7f5d0, group_id=8e45e9096d724588904d9826d19b1320, role_id=d773dfde38e5426799f6b947044767bb)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:39.279260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e02fb-77a8-4db2-905d-098eb32980a9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:39.300995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:39.346952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4005e-2aeb-4907-9f4e-14fa4fc266e9 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:39.380448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616258-e60e-4547-ae79-3af2e5978efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:39.381333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616258-e60e-4547-ae79-3af2e5978efa None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:39.381619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616258-e60e-4547-ae79-3af2e5978efa None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:39.381895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616258-e60e-4547-ae79-3af2e5978efa None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:39.383121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96616258-e60e-4547-ae79-3af2e5978efa None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:39.384574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96616258-e60e-4547-ae79-3af2e5978efa None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:39.386920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 198/402] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:39 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:39.387761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616258-e60e-4547-ae79-3af2e5978efa None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:39.392743 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 205/403] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jun 23 12:51:39 2022] PUT /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0/groups/8e45e9096d724588904d9826d19b1320/roles/d773dfde38e5426799f6b947044767bb => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:39.399077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e02fb-77a8-4db2-905d-098eb32980a9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:39.519897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616258-e60e-4547-ae79-3af2e5978efa None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:39.542989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:39.558173 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1b8ac-1889-488d-85c8-11db3c2f6049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:39.558981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b8ac-1889-488d-85c8-11db3c2f6049 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:39.559270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b8ac-1889-488d-85c8-11db3c2f6049 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:39.559550 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1b8ac-1889-488d-85c8-11db3c2f6049 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:39.560316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1b8ac-1889-488d-85c8-11db3c2f6049 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:39.560628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1b8ac-1889-488d-85c8-11db3c2f6049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:39.562191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1b8ac-1889-488d-85c8-11db3c2f6049 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:39.566044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e02fb-77a8-4db2-905d-098eb32980a9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:39.580455 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 199/404] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:39.582089 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7c660-daaa-48b6-9c27-f17748e28c23 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:39.582381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7c660-daaa-48b6-9c27-f17748e28c23 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:39.582660 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7c660-daaa-48b6-9c27-f17748e28c23 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:39.584595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 200/405] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:39.585370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7c660-daaa-48b6-9c27-f17748e28c23 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:39.624156 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1d63d-d2f9-4406-9dff-9fe18b93dba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:39.625797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1d63d-d2f9-4406-9dff-9fe18b93dba6 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:39.626193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1d63d-d2f9-4406-9dff-9fe18b93dba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:39.626491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1d63d-d2f9-4406-9dff-9fe18b93dba6 None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303/groups/8e45e9096d724588904d9826d19b1320/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:39.628736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1d63d-d2f9-4406-9dff-9fe18b93dba6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2343001f1c2e4e549eea7d3fa97e5303, group_id=8e45e9096d724588904d9826d19b1320, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:39.630227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1d63d-d2f9-4406-9dff-9fe18b93dba6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:39.710647 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 206/406] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jun 23 12:51:39 2022] PUT /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303/groups/8e45e9096d724588904d9826d19b1320/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:39.712593 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7012427-0b0d-4298-a227-be56209f3d7a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:39.713139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7012427-0b0d-4298-a227-be56209f3d7a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:39.713721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7012427-0b0d-4298-a227-be56209f3d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:39.718603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7c660-daaa-48b6-9c27-f17748e28c23 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:39.751795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a7012427-0b0d-4298-a227-be56209f3d7a None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:39.754341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a7012427-0b0d-4298-a227-be56209f3d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:39.789301 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8935d-425b-443e-b436-f2764bd582a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:39.790586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8935d-425b-443e-b436-f2764bd582a2 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:39.791075 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8935d-425b-443e-b436-f2764bd582a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:39.791760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8935d-425b-443e-b436-f2764bd582a2 None admin] PATH_INFO: `/v3/groups/8e45e9096d724588904d9826d19b1320` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:39.794428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8935d-425b-443e-b436-f2764bd582a2 None admin] RBAC: Authorizing `identity:get_group(group_id=8e45e9096d724588904d9826d19b1320)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:39.797554 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8935d-425b-443e-b436-f2764bd582a2 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:39.801952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:39.811259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 201/407] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:39 2022] GET /identity/v3/groups/8e45e9096d724588904d9826d19b1320 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:39.814391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8935d-425b-443e-b436-f2764bd582a2 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:39.909126 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:39.926986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 207/408] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:39.951486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7012427-0b0d-4298-a227-be56209f3d7a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:39.976241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8935d-425b-443e-b436-f2764bd582a2 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:40.013562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b89c2a-4e3e-4100-b4c8-35f08fd9584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:40.014094 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b89c2a-4e3e-4100-b4c8-35f08fd9584b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:40.014379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b89c2a-4e3e-4100-b4c8-35f08fd9584b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:40.014659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b89c2a-4e3e-4100-b4c8-35f08fd9584b None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:40.016719 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b89c2a-4e3e-4100-b4c8-35f08fd9584b None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:40.018297 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b89c2a-4e3e-4100-b4c8-35f08fd9584b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:40.024757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 202/409] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:39 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:40.025995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b89c2a-4e3e-4100-b4c8-35f08fd9584b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:40.088368 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7012427-0b0d-4298-a227-be56209f3d7a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:40.134396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b89c2a-4e3e-4100-b4c8-35f08fd9584b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:40.143245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca67dd2-4a0a-4534-9591-cd773d973911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:40.144358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca67dd2-4a0a-4534-9591-cd773d973911 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:40.144918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca67dd2-4a0a-4534-9591-cd773d973911 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:40.145412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca67dd2-4a0a-4534-9591-cd773d973911 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:40.153213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:40.168287 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca67dd2-4a0a-4534-9591-cd773d973911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:40.172687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372bf2e-3b28-4a58-90e0-1b378c21901d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:40.173985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372bf2e-3b28-4a58-90e0-1b378c21901d None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:40.173985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372bf2e-3b28-4a58-90e0-1b378c21901d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:40.174613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372bf2e-3b28-4a58-90e0-1b378c21901d None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303/groups/8e45e9096d724588904d9826d19b1320/roles/d773dfde38e5426799f6b947044767bb` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:40.176652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372bf2e-3b28-4a58-90e0-1b378c21901d None admin] RBAC: Authorizing `identity:create_grant(project_id=2343001f1c2e4e549eea7d3fa97e5303, group_id=8e45e9096d724588904d9826d19b1320, role_id=d773dfde38e5426799f6b947044767bb)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:40.184836 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372bf2e-3b28-4a58-90e0-1b378c21901d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6ca67dd2-4a0a-4534-9591-cd773d973911 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:40.186679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:40.187806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:40.188688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 208/410] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:51:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:40.189937 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af4c6c-dfbe-4946-8492-590944a79e62 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:40.190162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af4c6c-dfbe-4946-8492-590944a79e62 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:40.190516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af4c6c-dfbe-4946-8492-590944a79e62 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:40.191957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 209/411] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:40.194062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af4c6c-dfbe-4946-8492-590944a79e62 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:40.210921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:40.273113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 203/412] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jun 23 12:51:40 2022] PUT /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303/groups/8e45e9096d724588904d9826d19b1320/roles/d773dfde38e5426799f6b947044767bb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:40.276372 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87181-9dca-4e5d-9e3f-23498f3a2366 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:40.277961 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87181-9dca-4e5d-9e3f-23498f3a2366 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:40.278397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a87181-9dca-4e5d-9e3f-23498f3a2366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:40.312298 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-45a87181-9dca-4e5d-9e3f-23498f3a2366 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:40.315428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-45a87181-9dca-4e5d-9e3f-23498f3a2366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:40.368364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af4c6c-dfbe-4946-8492-590944a79e62 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:40.417978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a0854-4c24-4929-826c-93e603229343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:40.418690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a0854-4c24-4929-826c-93e603229343 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:40.419008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a0854-4c24-4929-826c-93e603229343 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:40.419313 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061a0854-4c24-4929-826c-93e603229343 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:40.420112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a0854-4c24-4929-826c-93e603229343 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:40.420437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a0854-4c24-4929-826c-93e603229343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:40.422456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061a0854-4c24-4929-826c-93e603229343 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:40.431539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 204/413] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:40.440919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 210/414] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:40.449947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a87181-9dca-4e5d-9e3f-23498f3a2366 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:40.458909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a0854-4c24-4929-826c-93e603229343 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:40.573370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:40.580295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a87181-9dca-4e5d-9e3f-23498f3a2366 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:40.600317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061a0854-4c24-4929-826c-93e603229343 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:40.603222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:40.655953 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91623e-7f6a-4ad3-a447-7cec69c2fbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:40.656627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91623e-7f6a-4ad3-a447-7cec69c2fbad None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:40.656929 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91623e-7f6a-4ad3-a447-7cec69c2fbad None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:40.657205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91623e-7f6a-4ad3-a447-7cec69c2fbad None admin] PATH_INFO: `/v3/groups/2eef1c05aefb4fa0b89c612c2eb73dd2` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:40.659803 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91623e-7f6a-4ad3-a447-7cec69c2fbad None admin] RBAC: Authorizing `identity:get_group(group_id=2eef1c05aefb4fa0b89c612c2eb73dd2)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:40.661318 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91623e-7f6a-4ad3-a447-7cec69c2fbad None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:40.663219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 205/415] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:40 2022] GET /identity/v3/groups/2eef1c05aefb4fa0b89c612c2eb73dd2 => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:40.671481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91623e-7f6a-4ad3-a447-7cec69c2fbad None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:40.675203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f734812-ec91-4974-adbc-b89c4eb7101f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:40.676034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f734812-ec91-4974-adbc-b89c4eb7101f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:40.676359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f734812-ec91-4974-adbc-b89c4eb7101f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:40.676669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f734812-ec91-4974-adbc-b89c4eb7101f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:40.689504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f734812-ec91-4974-adbc-b89c4eb7101f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-0f734812-ec91-4974-adbc-b89c4eb7101f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:40.697710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:40.705735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 211/416] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:40.706527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f734812-ec91-4974-adbc-b89c4eb7101f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:40.861875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f734812-ec91-4974-adbc-b89c4eb7101f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:40.898488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91623e-7f6a-4ad3-a447-7cec69c2fbad None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:40.920996 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6a230-aadf-47fa-99e6-50c63a337af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:40.923155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a230-aadf-47fa-99e6-50c63a337af1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:40.923682 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a230-aadf-47fa-99e6-50c63a337af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:40.924196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6a230-aadf-47fa-99e6-50c63a337af1 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:40.925189 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6a230-aadf-47fa-99e6-50c63a337af1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:40.927365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6a230-aadf-47fa-99e6-50c63a337af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:40.930131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6a230-aadf-47fa-99e6-50c63a337af1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:40.938900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:40.951908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 212/417] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:40.956546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6a230-aadf-47fa-99e6-50c63a337af1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:40.972677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35ad33-1fba-4de5-8974-b4e14a7e2b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:40.973564 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35ad33-1fba-4de5-8974-b4e14a7e2b8b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:40.973840 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35ad33-1fba-4de5-8974-b4e14a7e2b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:40.974112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35ad33-1fba-4de5-8974-b4e14a7e2b8b None admin] PATH_INFO: `/v3/projects/1fdf0ec9cffa45efa95f679088c42ed8` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:40.976341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35ad33-1fba-4de5-8974-b4e14a7e2b8b None admin] RBAC: Authorizing `identity:get_project(project_id=1fdf0ec9cffa45efa95f679088c42ed8)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:40.977809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35ad33-1fba-4de5-8974-b4e14a7e2b8b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:40.980665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 206/418] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:40 2022] GET /identity/v3/projects/1fdf0ec9cffa45efa95f679088c42ed8 => generated 344 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:40.989243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35ad33-1fba-4de5-8974-b4e14a7e2b8b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:41.081205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:41.191778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6a230-aadf-47fa-99e6-50c63a337af1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:41.195808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35ad33-1fba-4de5-8974-b4e14a7e2b8b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:41.257559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50951-613c-4c10-9b0e-344d76fcff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:41.258461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50951-613c-4c10-9b0e-344d76fcff1f None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:41.258739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50951-613c-4c10-9b0e-344d76fcff1f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:41.258842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af21f7e-27f7-4848-81cb-34ad3bd97518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:41.259017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c50951-613c-4c10-9b0e-344d76fcff1f None admin] PATH_INFO: `/v3/projects/1fdf0ec9cffa45efa95f679088c42ed8/groups/2eef1c05aefb4fa0b89c612c2eb73dd2/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:41.259439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af21f7e-27f7-4848-81cb-34ad3bd97518 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:41.259805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af21f7e-27f7-4848-81cb-34ad3bd97518 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:41.260066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af21f7e-27f7-4848-81cb-34ad3bd97518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:41.261013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c50951-613c-4c10-9b0e-344d76fcff1f None admin] RBAC: Authorizing `identity:create_grant(project_id=1fdf0ec9cffa45efa95f679088c42ed8, group_id=2eef1c05aefb4fa0b89c612c2eb73dd2, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:41.262480 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c50951-613c-4c10-9b0e-344d76fcff1f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:41.336677 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af21f7e-27f7-4848-81cb-34ad3bd97518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:41.338240 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af21f7e-27f7-4848-81cb-34ad3bd97518 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:41.341130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:41.372231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 207/419] 10.222.0.16 () {58 vars in 1442 bytes} [Thu Jun 23 12:51:40 2022] PUT /identity/v3/projects/1fdf0ec9cffa45efa95f679088c42ed8/groups/2eef1c05aefb4fa0b89c612c2eb73dd2/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:51:41.454964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 213/420] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:41.466221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50951-613c-4c10-9b0e-344d76fcff1f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:41.629389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c50951-613c-4c10-9b0e-344d76fcff1f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:41.631757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:41.673546 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054573a9-ce0b-48ab-8669-8bda9b9829fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:41.674435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054573a9-ce0b-48ab-8669-8bda9b9829fd None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:41.674946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054573a9-ce0b-48ab-8669-8bda9b9829fd None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:41.675414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054573a9-ce0b-48ab-8669-8bda9b9829fd None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:41.677057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054573a9-ce0b-48ab-8669-8bda9b9829fd None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:41.678525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054573a9-ce0b-48ab-8669-8bda9b9829fd None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:41.680573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 208/421] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:41 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:41.685953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af21f7e-27f7-4848-81cb-34ad3bd97518 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:41.794353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:41.799747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af21f7e-27f7-4848-81cb-34ad3bd97518 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:41.835401 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a12139-d4c1-4ab2-b189-e54b461ba507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:41.836275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12139-d4c1-4ab2-b189-e54b461ba507 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:41.836555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12139-d4c1-4ab2-b189-e54b461ba507 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:41.836849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a12139-d4c1-4ab2-b189-e54b461ba507 None admin] PATH_INFO: `/v3/groups/8e45e9096d724588904d9826d19b1320` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:41.838044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a12139-d4c1-4ab2-b189-e54b461ba507 None admin] RBAC: Authorizing `identity:get_group(group_id=8e45e9096d724588904d9826d19b1320)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:41.839482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a12139-d4c1-4ab2-b189-e54b461ba507 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:41.841487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 214/422] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:41 2022] GET /identity/v3/groups/8e45e9096d724588904d9826d19b1320 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:41.849889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054573a9-ce0b-48ab-8669-8bda9b9829fd None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:41.927708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321735b7-c42c-4524-8cdf-d2aaa35f93f4 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:41.928014 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321735b7-c42c-4524-8cdf-d2aaa35f93f4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:41.928274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321735b7-c42c-4524-8cdf-d2aaa35f93f4 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:41.930894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 215/423] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:41.934806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79eb4c-d679-4f77-bc2b-909a00a1dd76 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:41.935093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79eb4c-d679-4f77-bc2b-909a00a1dd76 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:41.935368 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79eb4c-d679-4f77-bc2b-909a00a1dd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:41.977330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2e79eb4c-d679-4f77-bc2b-909a00a1dd76 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:41.978517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2e79eb4c-d679-4f77-bc2b-909a00a1dd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:41.989224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054573a9-ce0b-48ab-8669-8bda9b9829fd None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:42.037739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615dc0d-d62e-4307-a899-9586635a6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:42.038551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615dc0d-d62e-4307-a899-9586635a6adc None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:42.038839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615dc0d-d62e-4307-a899-9586635a6adc None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:42.039108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615dc0d-d62e-4307-a899-9586635a6adc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:42.039943 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615dc0d-d62e-4307-a899-9586635a6adc None admin] RBAC: Adding query filter params (group.id=8e45e9096d724588904d9826d19b1320, role.id=3d2f155e5f1f4acbaff64a9c464d9d92, scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:42.040249 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615dc0d-d62e-4307-a899-9586635a6adc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:42.042168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615dc0d-d62e-4307-a899-9586635a6adc None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:42.050842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 209/424] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 23 12:51:41 2022] GET /identity/v3/role_assignments?group.id=8e45e9096d724588904d9826d19b1320&scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0&role.id=3d2f155e5f1f4acbaff64a9c464d9d92 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:42.099213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 216/425] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:42.147795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615dc0d-d62e-4307-a899-9586635a6adc None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:42.200760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:42.286440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615dc0d-d62e-4307-a899-9586635a6adc None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:42.323493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f875a-8b52-4bea-b631-f130473c649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:42.324630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f875a-8b52-4bea-b631-f130473c649c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:42.325141 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f875a-8b52-4bea-b631-f130473c649c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:42.325662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f875a-8b52-4bea-b631-f130473c649c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:42.337249 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f875a-8b52-4bea-b631-f130473c649c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-2d7f875a-8b52-4bea-b631-f130473c649c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:42.345969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:42.346897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:42.347686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:42.347686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:42.347686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:42.347686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:42.347686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:42.347686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:42.347686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:42.347686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:42.347686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:42.347686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:42.347686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:42.347686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:42.350408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 210/426] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:51:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:42.356146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79eb4c-d679-4f77-bc2b-909a00a1dd76 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:42.429380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088e28e-3572-4be4-abf5-616edf63d41e None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:42.429992 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088e28e-3572-4be4-abf5-616edf63d41e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:42.430472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088e28e-3572-4be4-abf5-616edf63d41e None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:42.432412 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 211/427] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:51:42.439086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd12bd-b333-46eb-ac3f-b02008cca557 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:42.439664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd12bd-b333-46eb-ac3f-b02008cca557 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:42.440146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd12bd-b333-46eb-ac3f-b02008cca557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:42.459748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-6bbd12bd-b333-46eb-ac3f-b02008cca557 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:42.461301 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6bbd12bd-b333-46eb-ac3f-b02008cca557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:42.484622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:42.492603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79eb4c-d679-4f77-bc2b-909a00a1dd76 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:42.530309 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a429efe-0465-48f1-98bc-9e2ac441b110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:42.531082 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429efe-0465-48f1-98bc-9e2ac441b110 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:42.531415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429efe-0465-48f1-98bc-9e2ac441b110 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:42.531754 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a429efe-0465-48f1-98bc-9e2ac441b110 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:42.532515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a429efe-0465-48f1-98bc-9e2ac441b110 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:42.532840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a429efe-0465-48f1-98bc-9e2ac441b110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:42.536595 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a429efe-0465-48f1-98bc-9e2ac441b110 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:42.538398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 212/428] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:42.545956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 217/429] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:42.551772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd12bd-b333-46eb-ac3f-b02008cca557 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:42.569006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a429efe-0465-48f1-98bc-9e2ac441b110 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:42.589986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:42.696199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd12bd-b333-46eb-ac3f-b02008cca557 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:42.709753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a429efe-0465-48f1-98bc-9e2ac441b110 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:42.739853 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d19469-3620-4925-8629-fea3868e3d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:42.740510 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d19469-3620-4925-8629-fea3868e3d50 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:42.740794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d19469-3620-4925-8629-fea3868e3d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:42.741109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d19469-3620-4925-8629-fea3868e3d50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:42.753354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c477d5e-3e70-4c3f-92d1-669f1d8e2339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:42.754562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c477d5e-3e70-4c3f-92d1-669f1d8e2339 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:42.754562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c477d5e-3e70-4c3f-92d1-669f1d8e2339 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:42.755579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c477d5e-3e70-4c3f-92d1-669f1d8e2339 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:42.769157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c477d5e-3e70-4c3f-92d1-669f1d8e2339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-9c477d5e-3e70-4c3f-92d1-669f1d8e2339 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:42.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:42.778134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:42.778917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 218/430] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:42.780274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ef181-197e-4d82-a541-8b837a0d00fa None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:42.780274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ef181-197e-4d82-a541-8b837a0d00fa None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:42.780274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ef181-197e-4d82-a541-8b837a0d00fa None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:42.782294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 219/431] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:42.786769 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ef181-197e-4d82-a541-8b837a0d00fa None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:42.812879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:42.827521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d19469-3620-4925-8629-fea3868e3d50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:42.830262 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d19469-3620-4925-8629-fea3868e3d50 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:42.860257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:42.902429 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ef181-197e-4d82-a541-8b837a0d00fa None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:42.939861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699ca54-6189-497f-84fe-a69dbdb08d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:42.940641 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699ca54-6189-497f-84fe-a69dbdb08d8e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:42.940971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699ca54-6189-497f-84fe-a69dbdb08d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:42.941253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699ca54-6189-497f-84fe-a69dbdb08d8e None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:42.941993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699ca54-6189-497f-84fe-a69dbdb08d8e None admin] RBAC: Adding query filter params (name=member) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:42.942300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699ca54-6189-497f-84fe-a69dbdb08d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:42.943779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699ca54-6189-497f-84fe-a69dbdb08d8e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:42.944398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 213/432] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:42.945597 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb4fdc-3735-4b19-b74a-bc9f5f7301b3 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:42.945885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb4fdc-3735-4b19-b74a-bc9f5f7301b3 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:42.946157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb4fdc-3735-4b19-b74a-bc9f5f7301b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:42.956001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 220/433] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:51:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:42.957093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699ca54-6189-497f-84fe-a69dbdb08d8e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:42.965924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-68cb4fdc-3735-4b19-b74a-bc9f5f7301b3 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:42.967543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-68cb4fdc-3735-4b19-b74a-bc9f5f7301b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:43.037053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 214/434] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:43.038181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb4fdc-3735-4b19-b74a-bc9f5f7301b3 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:43.052048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:43.072389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699ca54-6189-497f-84fe-a69dbdb08d8e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:43.103513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:43.108068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fdbe8-837a-4ebd-bd6b-ea54b90ff205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:43.109672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fdbe8-837a-4ebd-bd6b-ea54b90ff205 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:43.110131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fdbe8-837a-4ebd-bd6b-ea54b90ff205 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:43.110607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fdbe8-837a-4ebd-bd6b-ea54b90ff205 None admin] PATH_INFO: `/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:43.112564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fdbe8-837a-4ebd-bd6b-ea54b90ff205 None admin] RBAC: Authorizing `identity:get_project(project_id=4ff3c74fe05b404b94de5c9958d7f5d0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:43.115155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0fdbe8-837a-4ebd-bd6b-ea54b90ff205 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:43.122921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 221/435] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:42 2022] GET /identity/v3/projects/4ff3c74fe05b404b94de5c9958d7f5d0 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:43.122921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fdbe8-837a-4ebd-bd6b-ea54b90ff205 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:43.155820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb4fdc-3735-4b19-b74a-bc9f5f7301b3 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:43.199957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30703500-13ae-47fe-9b46-69db9c314a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:43.201000 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30703500-13ae-47fe-9b46-69db9c314a44 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:43.202301 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30703500-13ae-47fe-9b46-69db9c314a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:43.202861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30703500-13ae-47fe-9b46-69db9c314a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:43.227227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fdbe8-837a-4ebd-bd6b-ea54b90ff205 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:43.262960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d321ea-1c15-4274-b9a9-b7f87244648e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:43.263765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d321ea-1c15-4274-b9a9-b7f87244648e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:43.264046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d321ea-1c15-4274-b9a9-b7f87244648e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:43.264320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d321ea-1c15-4274-b9a9-b7f87244648e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:43.275567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d321ea-1c15-4274-b9a9-b7f87244648e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:43.282358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30703500-13ae-47fe-9b46-69db9c314a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:43.283851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30703500-13ae-47fe-9b46-69db9c314a44 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-69d321ea-1c15-4274-b9a9-b7f87244648e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:43.284852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:43.285718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:43.286579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 222/436] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:51:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:43.287222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d321ea-1c15-4274-b9a9-b7f87244648e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:43.299001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:43.348935 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:43.393738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d321ea-1c15-4274-b9a9-b7f87244648e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:43.396504 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 215/437] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:43.397185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30703500-13ae-47fe-9b46-69db9c314a44 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:43.435707 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ab029-2466-4b71-9c20-1416270369f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:43.436657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab029-2466-4b71-9c20-1416270369f4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:43.437041 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab029-2466-4b71-9c20-1416270369f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:43.438160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ab029-2466-4b71-9c20-1416270369f4 None admin] PATH_INFO: `/v3/groups/8e45e9096d724588904d9826d19b1320` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:43.439514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ab029-2466-4b71-9c20-1416270369f4 None admin] RBAC: Authorizing `identity:get_group(group_id=8e45e9096d724588904d9826d19b1320)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:43.441010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ab029-2466-4b71-9c20-1416270369f4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:43.447607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 223/438] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:43 2022] GET /identity/v3/groups/8e45e9096d724588904d9826d19b1320 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:43.448450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ab029-2466-4b71-9c20-1416270369f4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:43.507797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30703500-13ae-47fe-9b46-69db9c314a44 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:43.529046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:43.545608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e722f6-0298-4078-84ab-c0a45db1dcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:43.546366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e722f6-0298-4078-84ab-c0a45db1dcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:43.547234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e722f6-0298-4078-84ab-c0a45db1dcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:43.547549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e722f6-0298-4078-84ab-c0a45db1dcf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:43.548309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e722f6-0298-4078-84ab-c0a45db1dcf8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:43.548618 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e722f6-0298-4078-84ab-c0a45db1dcf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:43.550077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e722f6-0298-4078-84ab-c0a45db1dcf8 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:43.553415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ab029-2466-4b71-9c20-1416270369f4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:43.563562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 216/439] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:43.563562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e722f6-0298-4078-84ab-c0a45db1dcf8 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:43.582176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:43.592893 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf4dc4-2def-4ecb-9143-5c632265237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:43.593790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf4dc4-2def-4ecb-9143-5c632265237e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:43.594072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf4dc4-2def-4ecb-9143-5c632265237e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:43.594349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf4dc4-2def-4ecb-9143-5c632265237e None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:43.595555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf4dc4-2def-4ecb-9143-5c632265237e None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:43.597253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf4dc4-2def-4ecb-9143-5c632265237e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:43.598884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 224/440] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:43 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:43.599562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf4dc4-2def-4ecb-9143-5c632265237e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:43.676386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e722f6-0298-4078-84ab-c0a45db1dcf8 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:43.716084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302db7c-8ce4-4cf9-bb0c-66195c0582d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:43.716319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf4dc4-2def-4ecb-9143-5c632265237e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:43.716744 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302db7c-8ce4-4cf9-bb0c-66195c0582d9 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:43.717057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302db7c-8ce4-4cf9-bb0c-66195c0582d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:43.717337 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302db7c-8ce4-4cf9-bb0c-66195c0582d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:43.718272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302db7c-8ce4-4cf9-bb0c-66195c0582d9 None admin] RBAC: Adding query filter params (group.id=8e45e9096d724588904d9826d19b1320, role.id=d773dfde38e5426799f6b947044767bb, scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:43.719350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302db7c-8ce4-4cf9-bb0c-66195c0582d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:43.720275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302db7c-8ce4-4cf9-bb0c-66195c0582d9 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:43.726369 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 217/441] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 23 12:51:43 2022] GET /identity/v3/role_assignments?group.id=8e45e9096d724588904d9826d19b1320&scope.project.id=4ff3c74fe05b404b94de5c9958d7f5d0&role.id=d773dfde38e5426799f6b947044767bb => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:43.727155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302db7c-8ce4-4cf9-bb0c-66195c0582d9 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:43.769459 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd0b69-4af4-4987-867c-3242b17f3774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:43.770130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd0b69-4af4-4987-867c-3242b17f3774 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:43.770428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd0b69-4af4-4987-867c-3242b17f3774 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:43.770710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd0b69-4af4-4987-867c-3242b17f3774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:43.787514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:43.824455 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:43.846279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302db7c-8ce4-4cf9-bb0c-66195c0582d9 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:43.847526 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd0b69-4af4-4987-867c-3242b17f3774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:43.849073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd0b69-4af4-4987-867c-3242b17f3774 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:43.893414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d71cb2-57f5-4fa1-8906-203939e308a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:43.894308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d71cb2-57f5-4fa1-8906-203939e308a1 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:43.894582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d71cb2-57f5-4fa1-8906-203939e308a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:43.894863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d71cb2-57f5-4fa1-8906-203939e308a1 None admin] PATH_INFO: `/v3/groups/8e45e9096d724588904d9826d19b1320` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:43.896106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d71cb2-57f5-4fa1-8906-203939e308a1 None admin] RBAC: Authorizing `identity:get_group(group_id=8e45e9096d724588904d9826d19b1320)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:43.898044 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d71cb2-57f5-4fa1-8906-203939e308a1 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:43.899293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 218/442] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:43 2022] GET /identity/v3/groups/8e45e9096d724588904d9826d19b1320 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:43.900474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987209c6-3631-4ee2-8d39-211258857cd3 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:43.900764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987209c6-3631-4ee2-8d39-211258857cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:43.902197 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987209c6-3631-4ee2-8d39-211258857cd3 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:43.902302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 219/443] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:43.910170 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170c12d-63a7-4f0e-bc96-9d7ac1dce6fb None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:43.910351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170c12d-63a7-4f0e-bc96-9d7ac1dce6fb None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:43.910499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170c12d-63a7-4f0e-bc96-9d7ac1dce6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:43.928159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-8170c12d-63a7-4f0e-bc96-9d7ac1dce6fb None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:43.929319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-8170c12d-63a7-4f0e-bc96-9d7ac1dce6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:43.975936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 225/444] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:43.976789 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd0b69-4af4-4987-867c-3242b17f3774 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:44.019981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 220/445] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:44.020956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170c12d-63a7-4f0e-bc96-9d7ac1dce6fb None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:44.040703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:44.120260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:44.122514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd0b69-4af4-4987-867c-3242b17f3774 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:44.145349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170c12d-63a7-4f0e-bc96-9d7ac1dce6fb None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:44.166105 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed3385-6e94-4d56-a6b2-8117fb66b42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:44.166899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed3385-6e94-4d56-a6b2-8117fb66b42c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:44.167218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed3385-6e94-4d56-a6b2-8117fb66b42c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:44.167494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed3385-6e94-4d56-a6b2-8117fb66b42c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:44.168325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed3385-6e94-4d56-a6b2-8117fb66b42c None admin] RBAC: Adding query filter params (group.id=8e45e9096d724588904d9826d19b1320, role.id=3d2f155e5f1f4acbaff64a9c464d9d92, scope.project.id=2343001f1c2e4e549eea7d3fa97e5303) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:44.168636 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed3385-6e94-4d56-a6b2-8117fb66b42c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:44.170084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed3385-6e94-4d56-a6b2-8117fb66b42c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:44.176262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 226/446] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 23 12:51:43 2022] GET /identity/v3/role_assignments?group.id=8e45e9096d724588904d9826d19b1320&scope.project.id=2343001f1c2e4e549eea7d3fa97e5303&role.id=3d2f155e5f1f4acbaff64a9c464d9d92 => generated 611 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:44.177057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed3385-6e94-4d56-a6b2-8117fb66b42c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:44.180084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f2f11-417d-4ce6-a8c5-995b7e1d05b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:44.181207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2f11-417d-4ce6-a8c5-995b7e1d05b4 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:44.181650 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2f11-417d-4ce6-a8c5-995b7e1d05b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:44.182067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6f2f11-417d-4ce6-a8c5-995b7e1d05b4 None admin] PATH_INFO: `/v3/projects/2343001f1c2e4e549eea7d3fa97e5303` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:44.183509 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f2f11-417d-4ce6-a8c5-995b7e1d05b4 None admin] RBAC: Authorizing `identity:get_project(project_id=2343001f1c2e4e549eea7d3fa97e5303)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:44.185188 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6f2f11-417d-4ce6-a8c5-995b7e1d05b4 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:44.192156 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 221/447] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:44 2022] GET /identity/v3/projects/2343001f1c2e4e549eea7d3fa97e5303 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:44.193442 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f2f11-417d-4ce6-a8c5-995b7e1d05b4 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:44.299374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed3385-6e94-4d56-a6b2-8117fb66b42c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:44.306135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6f2f11-417d-4ce6-a8c5-995b7e1d05b4 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:44.309639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:44.338109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391ad1e-3280-4a79-92fc-f7aaccec066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:44.339202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391ad1e-3280-4a79-92fc-f7aaccec066c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:44.339202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391ad1e-3280-4a79-92fc-f7aaccec066c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:44.339459 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391ad1e-3280-4a79-92fc-f7aaccec066c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:44.348104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1be4e-8b6e-468f-bf2c-56486eed42b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:44.348996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1be4e-8b6e-468f-bf2c-56486eed42b7 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:44.349275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1be4e-8b6e-468f-bf2c-56486eed42b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:44.349548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1be4e-8b6e-468f-bf2c-56486eed42b7 None admin] PATH_INFO: `/v3/groups/8e45e9096d724588904d9826d19b1320` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:44.352319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1be4e-8b6e-468f-bf2c-56486eed42b7 None admin] RBAC: Authorizing `identity:get_group(group_id=8e45e9096d724588904d9826d19b1320)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:44.352522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391ad1e-3280-4a79-92fc-f7aaccec066c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:44.353399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1be4e-8b6e-468f-bf2c-56486eed42b7 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:44.355318 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 222/448] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:44 2022] GET /identity/v3/groups/8e45e9096d724588904d9826d19b1320 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:44.361389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1be4e-8b6e-468f-bf2c-56486eed42b7 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-8391ad1e-3280-4a79-92fc-f7aaccec066c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:44.362217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:44.363124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:44.363914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 227/449] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:51:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:44.369382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391ad1e-3280-4a79-92fc-f7aaccec066c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:44.382709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:44.475644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1be4e-8b6e-468f-bf2c-56486eed42b7 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:44.501493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391ad1e-3280-4a79-92fc-f7aaccec066c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:44.518626 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a41dc3-328a-4770-a93c-0c7aa763228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:44.519365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a41dc3-328a-4770-a93c-0c7aa763228a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:44.519646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a41dc3-328a-4770-a93c-0c7aa763228a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:44.519922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a41dc3-328a-4770-a93c-0c7aa763228a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:44.520762 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a41dc3-328a-4770-a93c-0c7aa763228a None admin] RBAC: Adding query filter params (group.id=8e45e9096d724588904d9826d19b1320, role.id=d773dfde38e5426799f6b947044767bb, scope.project.id=2343001f1c2e4e549eea7d3fa97e5303) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:44.521119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a41dc3-328a-4770-a93c-0c7aa763228a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:44.522572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a41dc3-328a-4770-a93c-0c7aa763228a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:44.528743 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 223/450] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 23 12:51:44 2022] GET /identity/v3/role_assignments?group.id=8e45e9096d724588904d9826d19b1320&scope.project.id=2343001f1c2e4e549eea7d3fa97e5303&role.id=d773dfde38e5426799f6b947044767bb => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:44.548770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef135ecf-a588-4c16-b1d9-bc4143e33650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:44.549549 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef135ecf-a588-4c16-b1d9-bc4143e33650 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:44.549837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef135ecf-a588-4c16-b1d9-bc4143e33650 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:44.550115 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef135ecf-a588-4c16-b1d9-bc4143e33650 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:44.550904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef135ecf-a588-4c16-b1d9-bc4143e33650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:44.551273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef135ecf-a588-4c16-b1d9-bc4143e33650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:44.552793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef135ecf-a588-4c16-b1d9-bc4143e33650 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:44.563755 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 228/451] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:44.569577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a41dc3-328a-4770-a93c-0c7aa763228a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:44.654051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:44.674238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a41dc3-328a-4770-a93c-0c7aa763228a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:44.707310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9f0e9-f18b-4045-b9ac-11683cb4bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:44.707986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f0e9-f18b-4045-b9ac-11683cb4bd47 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:44.708491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f0e9-f18b-4045-b9ac-11683cb4bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:44.708890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9f0e9-f18b-4045-b9ac-11683cb4bd47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:44.776973 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9f0e9-f18b-4045-b9ac-11683cb4bd47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:44.778371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9f0e9-f18b-4045-b9ac-11683cb4bd47 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:44.860900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:44.880547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 224/452] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:44.886212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef135ecf-a588-4c16-b1d9-bc4143e33650 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:44.917318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:44.985451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef135ecf-a588-4c16-b1d9-bc4143e33650 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:45.018244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43d7e7-e0d8-4b94-9ed5-46572530ea04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:45.019091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43d7e7-e0d8-4b94-9ed5-46572530ea04 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:45.019377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43d7e7-e0d8-4b94-9ed5-46572530ea04 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:45.019654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43d7e7-e0d8-4b94-9ed5-46572530ea04 None admin] PATH_INFO: `/v3/projects/1fdf0ec9cffa45efa95f679088c42ed8` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:45.020852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43d7e7-e0d8-4b94-9ed5-46572530ea04 None admin] RBAC: Authorizing `identity:get_project(project_id=1fdf0ec9cffa45efa95f679088c42ed8)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:45.022299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43d7e7-e0d8-4b94-9ed5-46572530ea04 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:45.023963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 229/453] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:51:44 2022] GET /identity/v3/projects/1fdf0ec9cffa45efa95f679088c42ed8 => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:45.029423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9f0e9-f18b-4045-b9ac-11683cb4bd47 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:45.125208 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9f0e9-f18b-4045-b9ac-11683cb4bd47 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:45.161375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550adf3-aba6-4777-9888-2f34a346c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:45.162222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550adf3-aba6-4777-9888-2f34a346c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:45.162506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550adf3-aba6-4777-9888-2f34a346c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:45.162783 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550adf3-aba6-4777-9888-2f34a346c3a8 None admin] PATH_INFO: `/v3/groups/2eef1c05aefb4fa0b89c612c2eb73dd2` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:45.163950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550adf3-aba6-4777-9888-2f34a346c3a8 None admin] RBAC: Authorizing `identity:get_group(group_id=2eef1c05aefb4fa0b89c612c2eb73dd2)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:45.165430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550adf3-aba6-4777-9888-2f34a346c3a8 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:45.167056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 225/454] 10.222.0.16 () {56 vars in 1180 bytes} [Thu Jun 23 12:51:45 2022] GET /identity/v3/groups/2eef1c05aefb4fa0b89c612c2eb73dd2 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:45.173633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43d7e7-e0d8-4b94-9ed5-46572530ea04 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:45.268491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:45.272163 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43d7e7-e0d8-4b94-9ed5-46572530ea04 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:45.305131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355ef95-b584-4261-bf50-df90a261d61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:45.305714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ef95-b584-4261-bf50-df90a261d61b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:45.305994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ef95-b584-4261-bf50-df90a261d61b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:45.306270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355ef95-b584-4261-bf50-df90a261d61b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:45.307095 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355ef95-b584-4261-bf50-df90a261d61b None admin] RBAC: Adding query filter params (group.id=2eef1c05aefb4fa0b89c612c2eb73dd2, role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=1fdf0ec9cffa45efa95f679088c42ed8) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:45.307404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355ef95-b584-4261-bf50-df90a261d61b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:45.308990 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355ef95-b584-4261-bf50-df90a261d61b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:45.316973 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 230/455] 10.222.0.16 () {56 vars in 1376 bytes} [Thu Jun 23 12:51:45 2022] GET /identity/v3/role_assignments?group.id=2eef1c05aefb4fa0b89c612c2eb73dd2&scope.project.id=1fdf0ec9cffa45efa95f679088c42ed8&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:47.971062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fbdb1-4b56-419f-821c-3369ff5b90e2 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:47.972060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fbdb1-4b56-419f-821c-3369ff5b90e2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:47.972563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fbdb1-4b56-419f-821c-3369ff5b90e2 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:47.974558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 226/456] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:47.994727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f247844-69a7-4c68-b47f-e8d34542fa75 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:47.995598 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f247844-69a7-4c68-b47f-e8d34542fa75 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:47.996106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f247844-69a7-4c68-b47f-e8d34542fa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.014453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8059f3-9918-438d-b002-cd475ddec307 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.015824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8059f3-9918-438d-b002-cd475ddec307 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.016303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8059f3-9918-438d-b002-cd475ddec307 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.018147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 227/457] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:51:48.019450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1f247844-69a7-4c68-b47f-e8d34542fa75 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:48.020933 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1f247844-69a7-4c68-b47f-e8d34542fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:48.029736 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c6961-6896-4a77-b88e-5913872bacda None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.030269 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c6961-6896-4a77-b88e-5913872bacda None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.031371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c6961-6896-4a77-b88e-5913872bacda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.058413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-0e7c6961-6896-4a77-b88e-5913872bacda None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:48.060350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0e7c6961-6896-4a77-b88e-5913872bacda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:48.153245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:48.154441 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 231/458] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:48.156563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477b19-01bb-4abd-a5ae-45543c7bd536 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.157031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477b19-01bb-4abd-a5ae-45543c7bd536 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.157478 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2477b19-01bb-4abd-a5ae-45543c7bd536 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.159130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 232/459] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:48.164109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63d6fd-0091-453d-ba48-8a4ad8fba17d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.164554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63d6fd-0091-453d-ba48-8a4ad8fba17d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.164999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63d6fd-0091-453d-ba48-8a4ad8fba17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.188396 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8e63d6fd-0091-453d-ba48-8a4ad8fba17d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:48.189742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8e63d6fd-0091-453d-ba48-8a4ad8fba17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:48.198895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 228/460] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:48.200048 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c6961-6896-4a77-b88e-5913872bacda None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:48.260613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 233/461] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:48.261861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63d6fd-0091-453d-ba48-8a4ad8fba17d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:48.288894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:48.355460 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c6961-6896-4a77-b88e-5913872bacda None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:48.399198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63d6fd-0091-453d-ba48-8a4ad8fba17d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:48.401599 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e8e75-d24a-4e33-b1ca-555eadc57c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:48.402675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e8e75-d24a-4e33-b1ca-555eadc57c7e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.403174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e8e75-d24a-4e33-b1ca-555eadc57c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.403682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e8e75-d24a-4e33-b1ca-555eadc57c7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.415138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e8e75-d24a-4e33-b1ca-555eadc57c7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:48.416984 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278e8e75-d24a-4e33-b1ca-555eadc57c7e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:48.437409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc38b5a-d462-4f6f-bb4f-2746822f528b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-278e8e75-d24a-4e33-b1ca-555eadc57c7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:48.438693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:48.439705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:48.440752 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:48.440752 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:48.440752 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:48.440752 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:48.441462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc38b5a-d462-4f6f-bb4f-2746822f528b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.442101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc38b5a-d462-4f6f-bb4f-2746822f528b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.442831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc38b5a-d462-4f6f-bb4f-2746822f528b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.447341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 229/462] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:48.448350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e8e75-d24a-4e33-b1ca-555eadc57c7e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:48.456883 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc38b5a-d462-4f6f-bb4f-2746822f528b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:48.458717 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc38b5a-d462-4f6f-bb4f-2746822f528b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-fcc38b5a-d462-4f6f-bb4f-2746822f528b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:48.479836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:48.480788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:48.481644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:48.481644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:48.481644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:48.481644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:48.482739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:48.485418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 234/463] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:48.486461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc38b5a-d462-4f6f-bb4f-2746822f528b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:48.561421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e8e75-d24a-4e33-b1ca-555eadc57c7e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:48.569420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:48.597341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc38b5a-d462-4f6f-bb4f-2746822f528b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:48.600116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d50158-6b4b-49fa-bede-6ffa29244fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:48.601193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d50158-6b4b-49fa-bede-6ffa29244fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.601325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d50158-6b4b-49fa-bede-6ffa29244fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.601570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d50158-6b4b-49fa-bede-6ffa29244fb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.613813 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d50158-6b4b-49fa-bede-6ffa29244fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:48.615424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d50158-6b4b-49fa-bede-6ffa29244fb2 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-21d50158-6b4b-49fa-bede-6ffa29244fb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:48.634916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:48.635800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:48.636634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:48.636634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:48.636634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:48.636634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:48.639230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefaa39-5614-4146-8bce-08f44304aa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:48.641657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefaa39-5614-4146-8bce-08f44304aa97 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.641966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 230/464] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:48.642364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefaa39-5614-4146-8bce-08f44304aa97 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.642812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aefaa39-5614-4146-8bce-08f44304aa97 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.642959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d50158-6b4b-49fa-bede-6ffa29244fb2 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:48.643950 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefaa39-5614-4146-8bce-08f44304aa97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:48.644419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefaa39-5614-4146-8bce-08f44304aa97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:48.646876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aefaa39-5614-4146-8bce-08f44304aa97 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:48.664192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 235/465] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:48.664192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefaa39-5614-4146-8bce-08f44304aa97 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:48.739689 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:48.758353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d50158-6b4b-49fa-bede-6ffa29244fb2 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:48.779196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aefaa39-5614-4146-8bce-08f44304aa97 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:48.793582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999de725-3053-4b94-a3e2-e87872b6e315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:48.794345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999de725-3053-4b94-a3e2-e87872b6e315 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.794698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999de725-3053-4b94-a3e2-e87872b6e315 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.794982 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999de725-3053-4b94-a3e2-e87872b6e315 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.795709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999de725-3053-4b94-a3e2-e87872b6e315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:48.796016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999de725-3053-4b94-a3e2-e87872b6e315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:48.798090 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999de725-3053-4b94-a3e2-e87872b6e315 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:48.820366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791911e0-2a8b-424e-976a-2ca44654dcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:48.820584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 231/466] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:48.820676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791911e0-2a8b-424e-976a-2ca44654dcde None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.820747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999de725-3053-4b94-a3e2-e87872b6e315 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:48.820844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791911e0-2a8b-424e-976a-2ca44654dcde None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.820844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791911e0-2a8b-424e-976a-2ca44654dcde None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.820844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791911e0-2a8b-424e-976a-2ca44654dcde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:48.820844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791911e0-2a8b-424e-976a-2ca44654dcde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:48.820844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791911e0-2a8b-424e-976a-2ca44654dcde None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:48.821660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:48.837836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 236/467] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:48.837836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7c71-ead3-408e-a426-d5d1c78e4b29 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.837836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7c71-ead3-408e-a426-d5d1c78e4b29 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.837836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7c71-ead3-408e-a426-d5d1c78e4b29 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.841846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 237/468] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:48.843112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb7c71-ead3-408e-a426-d5d1c78e4b29 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:48.944295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999de725-3053-4b94-a3e2-e87872b6e315 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:48.956018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb7c71-ead3-408e-a426-d5d1c78e4b29 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:48.981121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a8e39-4a6a-4cb6-aee4-d3529f8b3f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:48.981818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a8e39-4a6a-4cb6-aee4-d3529f8b3f6d None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.982061 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a8e39-4a6a-4cb6-aee4-d3529f8b3f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.982336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87a8e39-4a6a-4cb6-aee4-d3529f8b3f6d None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.983118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a8e39-4a6a-4cb6-aee4-d3529f8b3f6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:48.985155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87a8e39-4a6a-4cb6-aee4-d3529f8b3f6d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:48.992826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afab3d-f9dd-412b-9b13-3ee987e26e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:48.993211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afab3d-f9dd-412b-9b13-3ee987e26e5c None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:48.993496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afab3d-f9dd-412b-9b13-3ee987e26e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:48.994062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afab3d-f9dd-412b-9b13-3ee987e26e5c None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:48.994476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afab3d-f9dd-412b-9b13-3ee987e26e5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:48.995908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afab3d-f9dd-412b-9b13-3ee987e26e5c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:49.080830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:49.086378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 232/469] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:51:48 2022] POST /identity/v3/users => generated 248 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:51:49.087194 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a8e39-4a6a-4cb6-aee4-d3529f8b3f6d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:49.141824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 238/470] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:51:48 2022] POST /identity/v3/users => generated 246 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:51:49.143439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41173cb-0a47-4938-b252-e79f3af55b0d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:49.143957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41173cb-0a47-4938-b252-e79f3af55b0d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:49.144237 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41173cb-0a47-4938-b252-e79f3af55b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:49.194985 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d41173cb-0a47-4938-b252-e79f3af55b0d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:49.196225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d41173cb-0a47-4938-b252-e79f3af55b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:49.285495 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87a8e39-4a6a-4cb6-aee4-d3529f8b3f6d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:49.308642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:49.339574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53771a1-5519-4970-bdf1-9ea3ffed7cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:49.341532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53771a1-5519-4970-bdf1-9ea3ffed7cf6 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:49.341532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53771a1-5519-4970-bdf1-9ea3ffed7cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:49.341532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53771a1-5519-4970-bdf1-9ea3ffed7cf6 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:49.341799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53771a1-5519-4970-bdf1-9ea3ffed7cf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:49.343899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53771a1-5519-4970-bdf1-9ea3ffed7cf6 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:49.349026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 239/471] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:49.350406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e25d8-ecba-4d74-97e9-5022653119a6 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:49.351874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e25d8-ecba-4d74-97e9-5022653119a6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:49.352161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e25d8-ecba-4d74-97e9-5022653119a6 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:49.354618 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 240/472] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:49.361442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee7072-855e-4c04-9c2f-863e6fe9319e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:49.366368 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee7072-855e-4c04-9c2f-863e6fe9319e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:49.366368 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee7072-855e-4c04-9c2f-863e6fe9319e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:49.379597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-08ee7072-855e-4c04-9c2f-863e6fe9319e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:49.380774 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-08ee7072-855e-4c04-9c2f-863e6fe9319e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:49.459306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 241/473] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:49.464179 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 233/474] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:51:49 2022] POST /identity/v3/users => generated 248 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:51:49.465748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee7072-855e-4c04-9c2f-863e6fe9319e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:49.483423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53771a1-5519-4970-bdf1-9ea3ffed7cf6 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:49.609512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:49.638016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee7072-855e-4c04-9c2f-863e6fe9319e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:49.656025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:49.676408 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954ab27-182f-4ebe-9fb7-83ff1c96a759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:49.677250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954ab27-182f-4ebe-9fb7-83ff1c96a759 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:49.677590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954ab27-182f-4ebe-9fb7-83ff1c96a759 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:49.677875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954ab27-182f-4ebe-9fb7-83ff1c96a759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:49.683176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53771a1-5519-4970-bdf1-9ea3ffed7cf6 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:49.692995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954ab27-182f-4ebe-9fb7-83ff1c96a759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:49.694508 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954ab27-182f-4ebe-9fb7-83ff1c96a759 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-4954ab27-182f-4ebe-9fb7-83ff1c96a759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:49.713061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:49.714170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:49.715206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:49.715206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:49.715206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:49.715206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:49.715206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 242/475] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:49.721487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954ab27-182f-4ebe-9fb7-83ff1c96a759 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:49.730339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dec24-3359-49d8-b836-c79f709bc5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:49.731140 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dec24-3359-49d8-b836-c79f709bc5f0 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:49.731526 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dec24-3359-49d8-b836-c79f709bc5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:49.731903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dec24-3359-49d8-b836-c79f709bc5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:49.732758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dec24-3359-49d8-b836-c79f709bc5f0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:49.735114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dec24-3359-49d8-b836-c79f709bc5f0 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:49.777777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.sql.core [None req-e24dec24-3359-49d8-b836-c79f709bc5f0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 12:51:49.777777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 12:51:49.777777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [parameters: {'id': '068ff4f5d3ab4b55a44903c68241debb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 12:51:49.777777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80298) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-e24dec24-3359-49d8-b836-c79f709bc5f0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application conn.query(q) Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application result.read() Jun 23 12:51:49.794236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 12:51:49.795366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application next(self.gen) Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application yield resource Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application next(self.gen) Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise self.value Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application session.commit() Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 12:51:49.797790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self.session.flush() Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application compat.raise_( Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 12:51:49.798848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 12:51:49.799945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application conn.query(q) Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application result.read() Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 12:51:49.800947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [parameters: {'id': '068ff4f5d3ab4b55a44903c68241debb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:49.801795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 12:51:49.802644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:49.803483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 234/476] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jun 23 12:51:49 2022] POST /identity/v3/roles => generated 144 bytes in 319 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:49.803483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dec24-3359-49d8-b836-c79f709bc5f0 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:49.870747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954ab27-182f-4ebe-9fb7-83ff1c96a759 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:49.944109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0de430-f5a6-4a2b-babf-0c3c9364f558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:49.945049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0de430-f5a6-4a2b-babf-0c3c9364f558 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:49.946181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0de430-f5a6-4a2b-babf-0c3c9364f558 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:49.946823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0de430-f5a6-4a2b-babf-0c3c9364f558 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:49.948835 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0de430-f5a6-4a2b-babf-0c3c9364f558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:49.950271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0de430-f5a6-4a2b-babf-0c3c9364f558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:49.951825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0de430-f5a6-4a2b-babf-0c3c9364f558 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:49.962136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dec24-3359-49d8-b836-c79f709bc5f0 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:49.980817 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 243/477] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:49.985941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0de430-f5a6-4a2b-babf-0c3c9364f558 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:50.002867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:50.026115 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:50.042873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9261-30df-4532-8374-ee22297e90b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:50.043695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9261-30df-4532-8374-ee22297e90b6 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:50.043980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9261-30df-4532-8374-ee22297e90b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:50.044256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9261-30df-4532-8374-ee22297e90b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:50.069405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc9261-30df-4532-8374-ee22297e90b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-ddfc9261-30df-4532-8374-ee22297e90b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:50.084575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:50.085807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:50.087506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:50.087506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:50.087506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:50.087506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:50.087506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:50.087506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:50.087506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:50.087506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:50.087506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:50.087506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:50.087506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 12:51:50.087506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:50.091625 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 235/478] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:51:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:50.111596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9261-30df-4532-8374-ee22297e90b6 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:50.189058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0de430-f5a6-4a2b-babf-0c3c9364f558 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:50.229079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179db94e-96c0-43b8-b2ef-9fac1abf25a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:50.229752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179db94e-96c0-43b8-b2ef-9fac1abf25a4 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:50.230035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179db94e-96c0-43b8-b2ef-9fac1abf25a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:50.230312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179db94e-96c0-43b8-b2ef-9fac1abf25a4 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:50.231075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179db94e-96c0-43b8-b2ef-9fac1abf25a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:50.232450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179db94e-96c0-43b8-b2ef-9fac1abf25a4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:50.268681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9261-30df-4532-8374-ee22297e90b6 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:50.305622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33217c-3368-4d44-a0e3-f43396a55244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:50.306289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33217c-3368-4d44-a0e3-f43396a55244 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:50.306573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33217c-3368-4d44-a0e3-f43396a55244 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:50.306853 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33217c-3368-4d44-a0e3-f43396a55244 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:50.307612 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33217c-3368-4d44-a0e3-f43396a55244 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:50.308128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33217c-3368-4d44-a0e3-f43396a55244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:50.309660 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33217c-3368-4d44-a0e3-f43396a55244 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:50.318993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 236/479] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:50.332995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 244/480] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:51:49 2022] POST /identity/v3/users => generated 249 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:51:51.503929 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa9b83-52ec-4dcc-b3c0-0e9455141d74 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:51.504884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa9b83-52ec-4dcc-b3c0-0e9455141d74 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:51.511162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa9b83-52ec-4dcc-b3c0-0e9455141d74 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:51.511162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 237/481] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:51.512742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1e89-d882-4e08-aa95-07160e9c4191 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:51.513574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1e89-d882-4e08-aa95-07160e9c4191 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:51.514084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1e89-d882-4e08-aa95-07160e9c4191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:51.532393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-590b1e89-d882-4e08-aa95-07160e9c4191 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:51.533914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-590b1e89-d882-4e08-aa95-07160e9c4191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:51.691123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 245/482] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:51.737346 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa9b83-52ec-4dcc-b3c0-0e9455141d74 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:51.806879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:51.822477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b2ce1-7338-4dd6-a221-5c84d47e8d5d None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:51.823079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b2ce1-7338-4dd6-a221-5c84d47e8d5d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:51.823356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b2ce1-7338-4dd6-a221-5c84d47e8d5d None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:51.824916 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 246/483] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:51:51.832982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd620c99-1554-4328-a026-ef87a23f5aae None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:51.833270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd620c99-1554-4328-a026-ef87a23f5aae None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:51.833556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd620c99-1554-4328-a026-ef87a23f5aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:51.870082 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fd620c99-1554-4328-a026-ef87a23f5aae None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:51.871564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fd620c99-1554-4328-a026-ef87a23f5aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:51.873979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:51.915823 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa9b83-52ec-4dcc-b3c0-0e9455141d74 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:51.977082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4e7c1-9a29-4527-b944-13854b4a03f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:51.978265 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4e7c1-9a29-4527-b944-13854b4a03f3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:51.978770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4e7c1-9a29-4527-b944-13854b4a03f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:51.979241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4e7c1-9a29-4527-b944-13854b4a03f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:51.998205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae4e7c1-9a29-4527-b944-13854b4a03f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:52.011505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 247/484] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-0ae4e7c1-9a29-4527-b944-13854b4a03f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:52.012402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:52.017640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:52.018489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:52.018489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:52.018489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:52.018489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:52.018489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:52.018489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:52.018489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:52.018489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:52.018489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:52.018489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:52.018489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:52.018489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:52.021184 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 238/485] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:51:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:52.027299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd620c99-1554-4328-a026-ef87a23f5aae None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:52.049574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4e7c1-9a29-4527-b944-13854b4a03f3 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:52.256263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:52.257719 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd620c99-1554-4328-a026-ef87a23f5aae None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:52.259125 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4e7c1-9a29-4527-b944-13854b4a03f3 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:52.304627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04abc2a7-d6ff-4974-aabe-efe2527b828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:52.304902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7aced0-10a1-4e93-b5c7-dff189830fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:52.305796 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abc2a7-d6ff-4974-aabe-efe2527b828d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:52.306285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aced0-10a1-4e93-b5c7-dff189830fcf None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:52.306398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abc2a7-d6ff-4974-aabe-efe2527b828d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:52.306843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abc2a7-d6ff-4974-aabe-efe2527b828d None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:52.307024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aced0-10a1-4e93-b5c7-dff189830fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:52.307600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7aced0-10a1-4e93-b5c7-dff189830fcf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:52.308149 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abc2a7-d6ff-4974-aabe-efe2527b828d None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:52.308735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abc2a7-d6ff-4974-aabe-efe2527b828d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:52.310533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04abc2a7-d6ff-4974-aabe-efe2527b828d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:52.317462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:52.321809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7aced0-10a1-4e93-b5c7-dff189830fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:52.322846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 248/486] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:51:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:52.329366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa06c90-2fa6-4d6e-be6e-5991a0933568 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:52.330107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa06c90-2fa6-4d6e-be6e-5991a0933568 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:52.330574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa06c90-2fa6-4d6e-be6e-5991a0933568 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:52.332331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 249/487] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-5d7aced0-10a1-4e93-b5c7-dff189830fcf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:52.333069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:52.334371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:52.335174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:52.335174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:52.335174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:52.335174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:52.335174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:52.335174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:52.335174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:52.335174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:52.335174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:52.335174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:52.335174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:52.335174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:52.336924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa06c90-2fa6-4d6e-be6e-5991a0933568 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:52.341161 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 239/488] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:51:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:52.342488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ebdbc-2b92-4a39-8d96-a9657462ada9 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:52.342839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ebdbc-2b92-4a39-8d96-a9657462ada9 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:52.343241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ebdbc-2b92-4a39-8d96-a9657462ada9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:52.365860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-890ebdbc-2b92-4a39-8d96-a9657462ada9 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:52.367082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-890ebdbc-2b92-4a39-8d96-a9657462ada9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:52.454584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 240/489] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:52.455526 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ebdbc-2b92-4a39-8d96-a9657462ada9 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:52.474362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa06c90-2fa6-4d6e-be6e-5991a0933568 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:52.520722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9149b62-2ed6-4b57-a3af-61396b66ef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:52.522547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9149b62-2ed6-4b57-a3af-61396b66ef8a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:52.523127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9149b62-2ed6-4b57-a3af-61396b66ef8a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:52.523603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9149b62-2ed6-4b57-a3af-61396b66ef8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:52.537681 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9149b62-2ed6-4b57-a3af-61396b66ef8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:52.539520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9149b62-2ed6-4b57-a3af-61396b66ef8a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-a9149b62-2ed6-4b57-a3af-61396b66ef8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:52.560320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:52.561244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:52.562630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:52.562630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:52.562630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:52.562630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:52.565870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 250/490] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:52.571382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9149b62-2ed6-4b57-a3af-61396b66ef8a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:52.583582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:52.586537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ebdbc-2b92-4a39-8d96-a9657462ada9 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:52.621675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4d033-b9ad-48eb-9013-e2c7f4ac1a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:52.622353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4d033-b9ad-48eb-9013-e2c7f4ac1a7f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:52.622658 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4d033-b9ad-48eb-9013-e2c7f4ac1a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:52.622919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4d033-b9ad-48eb-9013-e2c7f4ac1a7f None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:52.623685 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4d033-b9ad-48eb-9013-e2c7f4ac1a7f None admin] RBAC: Adding query filter params (name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:52.624063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4d033-b9ad-48eb-9013-e2c7f4ac1a7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:52.625538 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4d033-b9ad-48eb-9013-e2c7f4ac1a7f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:52.632919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:52.638447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 241/491] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:51:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:52.639340 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4d033-b9ad-48eb-9013-e2c7f4ac1a7f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:52.689602 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9149b62-2ed6-4b57-a3af-61396b66ef8a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:52.728745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bd975-469f-4a0a-b3da-4b43a51902d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:52.729858 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bd975-469f-4a0a-b3da-4b43a51902d2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:52.730284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bd975-469f-4a0a-b3da-4b43a51902d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:52.730723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480bd975-469f-4a0a-b3da-4b43a51902d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:52.744486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480bd975-469f-4a0a-b3da-4b43a51902d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:52.749898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4d033-b9ad-48eb-9013-e2c7f4ac1a7f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-480bd975-469f-4a0a-b3da-4b43a51902d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:52.754415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:52.755490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:52.756527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:52.756527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:52.756527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:52.756527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:52.756527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:52.756527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:52.756527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:52.756527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:52.756527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:52.756527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:52.756527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:52.756527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:52.758922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 251/492] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:51:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:52.759954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bd975-469f-4a0a-b3da-4b43a51902d2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:52.786964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208c508-b903-48ab-8a82-2389e6d4930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:52.787560 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208c508-b903-48ab-8a82-2389e6d4930d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:52.787848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208c508-b903-48ab-8a82-2389e6d4930d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:52.788127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208c508-b903-48ab-8a82-2389e6d4930d None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:52.788980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208c508-b903-48ab-8a82-2389e6d4930d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:52.789196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208c508-b903-48ab-8a82-2389e6d4930d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:52.790599 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208c508-b903-48ab-8a82-2389e6d4930d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:52.807866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 242/493] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:52.807866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208c508-b903-48ab-8a82-2389e6d4930d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:52.822771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:52.894377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480bd975-469f-4a0a-b3da-4b43a51902d2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:52.907941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:52.913687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208c508-b903-48ab-8a82-2389e6d4930d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:52.929665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d35f29-70f1-404f-bf66-c9c09fab9260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:52.930472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d35f29-70f1-404f-bf66-c9c09fab9260 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:52.930764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d35f29-70f1-404f-bf66-c9c09fab9260 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:52.931040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d35f29-70f1-404f-bf66-c9c09fab9260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:52.943480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d35f29-70f1-404f-bf66-c9c09fab9260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:52.945084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d35f29-70f1-404f-bf66-c9c09fab9260 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:52.955415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb13409-c89a-4985-bd5e-4ad9dccb4e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:52.956118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb13409-c89a-4985-bd5e-4ad9dccb4e41 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:52.956405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb13409-c89a-4985-bd5e-4ad9dccb4e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:52.956745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb13409-c89a-4985-bd5e-4ad9dccb4e41 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:52.957750 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb13409-c89a-4985-bd5e-4ad9dccb4e41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:52.958013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb13409-c89a-4985-bd5e-4ad9dccb4e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:52.959399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb13409-c89a-4985-bd5e-4ad9dccb4e41 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-d2d35f29-70f1-404f-bf66-c9c09fab9260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:52.963714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:52.964529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:52.965445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:52.965445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:52.965445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:52.965445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:52.965445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 252/494] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:52.965713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d35f29-70f1-404f-bf66-c9c09fab9260 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:52.976240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 243/495] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:51:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:52.976240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcf6a6-5e8a-467c-b4fd-d09c173417b1 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:52.976240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcf6a6-5e8a-467c-b4fd-d09c173417b1 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:52.976240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcf6a6-5e8a-467c-b4fd-d09c173417b1 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:52.976240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 244/496] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:52.976240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcf6a6-5e8a-467c-b4fd-d09c173417b1 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:53.066635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:53.077924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d35f29-70f1-404f-bf66-c9c09fab9260 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:53.097397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcf6a6-5e8a-467c-b4fd-d09c173417b1 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:53.111191 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f24a96-a038-42a1-9cbe-de369cafb312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:53.111989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f24a96-a038-42a1-9cbe-de369cafb312 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.112271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f24a96-a038-42a1-9cbe-de369cafb312 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.112546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f24a96-a038-42a1-9cbe-de369cafb312 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.120027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f24a96-a038-42a1-9cbe-de369cafb312 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:53.121603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f24a96-a038-42a1-9cbe-de369cafb312 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:53.135075 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0b458-6155-4e54-9402-7415d70caad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:53.135732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0b458-6155-4e54-9402-7415d70caad5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.136017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0b458-6155-4e54-9402-7415d70caad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.136294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0b458-6155-4e54-9402-7415d70caad5 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.137051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0b458-6155-4e54-9402-7415d70caad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:53.137358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0b458-6155-4e54-9402-7415d70caad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-c2f24a96-a038-42a1-9cbe-de369cafb312 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:51:53.137461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:53.138314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:53.139673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:53.139673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:53.139673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:51:53.139673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:51:53.139673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:51:53.139673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:51:53.139673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:51:53.139673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:51:53.139673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:51:53.139673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:53.139673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 253/497] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 23 12:51:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:53.141424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081577f-f43c-49e1-9c78-b0e0cc6f1f02 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.141424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081577f-f43c-49e1-9c78-b0e0cc6f1f02 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.141424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081577f-f43c-49e1-9c78-b0e0cc6f1f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.144051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0b458-6155-4e54-9402-7415d70caad5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:53.156166 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 245/498] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:53.156999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0b458-6155-4e54-9402-7415d70caad5 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:53.158327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-5081577f-f43c-49e1-9c78-b0e0cc6f1f02 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:53.159529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5081577f-f43c-49e1-9c78-b0e0cc6f1f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:53.177159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:53.228822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 254/499] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:53.230211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f542e17-a97c-43cc-9c63-a3edce9ffcdc None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.230503 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f542e17-a97c-43cc-9c63-a3edce9ffcdc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.230776 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f542e17-a97c-43cc-9c63-a3edce9ffcdc None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.232015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 255/500] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:53.232697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f542e17-a97c-43cc-9c63-a3edce9ffcdc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:53.278607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0b458-6155-4e54-9402-7415d70caad5 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:53.313600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdcdad-985c-436f-972e-5c64298dfb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:53.314391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdcdad-985c-436f-972e-5c64298dfb6c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.314668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdcdad-985c-436f-972e-5c64298dfb6c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.314937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdcdad-985c-436f-972e-5c64298dfb6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.316915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:53.325254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdcdad-985c-436f-972e-5c64298dfb6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:53.326803 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdcdad-985c-436f-972e-5c64298dfb6c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:53.338293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f542e17-a97c-43cc-9c63-a3edce9ffcdc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-94fdcdad-985c-436f-972e-5c64298dfb6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:53.344353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:53.345267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:53.346102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:53.346102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:53.346102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:53.346102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:53.346102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 246/501] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:53.346697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdcdad-985c-436f-972e-5c64298dfb6c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:53.374834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44883a11-36c3-4643-ba20-ad1edd9af923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:53.375523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44883a11-36c3-4643-ba20-ad1edd9af923 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.376009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44883a11-36c3-4643-ba20-ad1edd9af923 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.376119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44883a11-36c3-4643-ba20-ad1edd9af923 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.376942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44883a11-36c3-4643-ba20-ad1edd9af923 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:53.377250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44883a11-36c3-4643-ba20-ad1edd9af923 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:53.378695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44883a11-36c3-4643-ba20-ad1edd9af923 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:53.417938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 256/502] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 23 12:51:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:53.419241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfb1fe-d47f-4c58-b514-81099539923b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.419537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfb1fe-d47f-4c58-b514-81099539923b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.419820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfb1fe-d47f-4c58-b514-81099539923b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.435731 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-08cfb1fe-d47f-4c58-b514-81099539923b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:53.437012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-08cfb1fe-d47f-4c58-b514-81099539923b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:53.444283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:53.456233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdcdad-985c-436f-972e-5c64298dfb6c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:53.490484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26067f57-91a4-4641-b0f0-aa32e32d2466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:53.491282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26067f57-91a4-4641-b0f0-aa32e32d2466 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.491567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26067f57-91a4-4641-b0f0-aa32e32d2466 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.491850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26067f57-91a4-4641-b0f0-aa32e32d2466 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.499276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26067f57-91a4-4641-b0f0-aa32e32d2466 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:53.500687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26067f57-91a4-4641-b0f0-aa32e32d2466 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:53.503729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 257/503] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:53.504587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfb1fe-d47f-4c58-b514-81099539923b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-26067f57-91a4-4641-b0f0-aa32e32d2466 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:51:53.517397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:53.518341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:53.524204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:53.524204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:53.524204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:51:53.524204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:51:53.524204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:51:53.524204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:51:53.524204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:51:53.524204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:51:53.524204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 12:51:53.524204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:53.524204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 247/504] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:53.524204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26067f57-91a4-4641-b0f0-aa32e32d2466 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:53.569475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:53.611259 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfb1fe-d47f-4c58-b514-81099539923b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:53.622719 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26067f57-91a4-4641-b0f0-aa32e32d2466 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:53.648125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0875025-738f-4bc0-9e12-e86ed4450371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:53.648938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0875025-738f-4bc0-9e12-e86ed4450371 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.649218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0875025-738f-4bc0-9e12-e86ed4450371 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.649490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0875025-738f-4bc0-9e12-e86ed4450371 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.658008 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0c3d5-5109-4607-a042-0f5994686b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:53.658663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0c3d5-5109-4607-a042-0f5994686b85 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.658948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0c3d5-5109-4607-a042-0f5994686b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.659228 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0c3d5-5109-4607-a042-0f5994686b85 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.659330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0875025-738f-4bc0-9e12-e86ed4450371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:53.659957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0c3d5-5109-4607-a042-0f5994686b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:53.660265 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0c3d5-5109-4607-a042-0f5994686b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:53.661692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0c3d5-5109-4607-a042-0f5994686b85 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e0875025-738f-4bc0-9e12-e86ed4450371 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:53.666900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:53.667823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:53.668615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:53.668615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:53.668615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:53.668615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:53.668615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:53.668615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:53.668615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:53.668615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:53.668615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:53.668615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:53.668615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:53.668615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:53.672918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 258/505] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:51:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:53.673617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0875025-738f-4bc0-9e12-e86ed4450371 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:53.674522 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 248/506] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:53.675315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0c3d5-5109-4607-a042-0f5994686b85 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:53.679679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:53.772653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0c3d5-5109-4607-a042-0f5994686b85 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:53.775673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0875025-738f-4bc0-9e12-e86ed4450371 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:53.779843 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:53.805989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381df0a-82d6-48b6-91d2-bab0361b3b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:53.806654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381df0a-82d6-48b6-91d2-bab0361b3b7b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.806935 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381df0a-82d6-48b6-91d2-bab0361b3b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.807214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381df0a-82d6-48b6-91d2-bab0361b3b7b None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.808047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381df0a-82d6-48b6-91d2-bab0361b3b7b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:53.808356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381df0a-82d6-48b6-91d2-bab0361b3b7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:53.809835 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381df0a-82d6-48b6-91d2-bab0361b3b7b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:53.809942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a248eb8-6e1e-4a00-bea7-3cf15665304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:53.810481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a248eb8-6e1e-4a00-bea7-3cf15665304b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.810761 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a248eb8-6e1e-4a00-bea7-3cf15665304b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.811033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a248eb8-6e1e-4a00-bea7-3cf15665304b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.846384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 249/507] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jun 23 12:51:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:53.847131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381df0a-82d6-48b6-91d2-bab0361b3b7b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:53.880450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a248eb8-6e1e-4a00-bea7-3cf15665304b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:53.882070 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a248eb8-6e1e-4a00-bea7-3cf15665304b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:53.883962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:53.947935 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381df0a-82d6-48b6-91d2-bab0361b3b7b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:53.981567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 259/508] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:53.982393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a248eb8-6e1e-4a00-bea7-3cf15665304b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:53.986834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14703e-61c3-479b-9667-7f63d59ccf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:53.987622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14703e-61c3-479b-9667-7f63d59ccf3c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:53.987900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14703e-61c3-479b-9667-7f63d59ccf3c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:53.988173 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14703e-61c3-479b-9667-7f63d59ccf3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:53.998676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14703e-61c3-479b-9667-7f63d59ccf3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:54.001114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14703e-61c3-479b-9667-7f63d59ccf3c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-ff14703e-61c3-479b-9667-7f63d59ccf3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:54.019808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:54.020671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:54.021549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:54.021549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:54.021549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:54.021549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:54.021549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 250/509] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:54.022208 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14703e-61c3-479b-9667-7f63d59ccf3c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:54.039569 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:54.086497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a248eb8-6e1e-4a00-bea7-3cf15665304b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:54.088017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:54.119727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7730e-3f4c-4ae5-bdfb-212bf0ebd7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:54.120330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7730e-3f4c-4ae5-bdfb-212bf0ebd7cd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:54.120614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7730e-3f4c-4ae5-bdfb-212bf0ebd7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:54.120918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7730e-3f4c-4ae5-bdfb-212bf0ebd7cd None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:54.121195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14703e-61c3-479b-9667-7f63d59ccf3c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:54.121665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7730e-3f4c-4ae5-bdfb-212bf0ebd7cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:54.121973 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7730e-3f4c-4ae5-bdfb-212bf0ebd7cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:54.123335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7730e-3f4c-4ae5-bdfb-212bf0ebd7cd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:54.131935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 260/510] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:51:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:54.132756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7730e-3f4c-4ae5-bdfb-212bf0ebd7cd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:54.157566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4ec2-f5a0-49b3-aa5d-651a976632db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:54.158349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4ec2-f5a0-49b3-aa5d-651a976632db None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:54.158629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4ec2-f5a0-49b3-aa5d-651a976632db None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:54.158907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4ec2-f5a0-49b3-aa5d-651a976632db None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:54.165779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df4ec2-f5a0-49b3-aa5d-651a976632db None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:54.167258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df4ec2-f5a0-49b3-aa5d-651a976632db None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-17df4ec2-f5a0-49b3-aa5d-651a976632db None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:51:54.182486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:54.183413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:54.184296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:54.184296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:54.184296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:51:54.184296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:51:54.184296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:51:54.184296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:51:54.184296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:51:54.184296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:51:54.184296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:51:54.184296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:54.184296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 251/511] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:51:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:54.184901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4ec2-f5a0-49b3-aa5d-651a976632db None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:54.235289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7730e-3f4c-4ae5-bdfb-212bf0ebd7cd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:54.265043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:54.267833 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dd1d0-17f6-4af2-a42a-8debbe22d06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:54.268482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dd1d0-17f6-4af2-a42a-8debbe22d06f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:54.268765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dd1d0-17f6-4af2-a42a-8debbe22d06f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:54.269074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dd1d0-17f6-4af2-a42a-8debbe22d06f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:54.287004 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4ec2-f5a0-49b3-aa5d-651a976632db None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:54.299331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:54.322002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461bd43-95a0-4ef5-9732-29104beea3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:54.322782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461bd43-95a0-4ef5-9732-29104beea3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:54.323059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461bd43-95a0-4ef5-9732-29104beea3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:54.323333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461bd43-95a0-4ef5-9732-29104beea3a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:54.334105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461bd43-95a0-4ef5-9732-29104beea3a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:54.335548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461bd43-95a0-4ef5-9732-29104beea3a4 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:54.336670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103dd1d0-17f6-4af2-a42a-8debbe22d06f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:54.338190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103dd1d0-17f6-4af2-a42a-8debbe22d06f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-0461bd43-95a0-4ef5-9732-29104beea3a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:54.352484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:54.353530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:54.359692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:54.359692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:54.359692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:54.359692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:54.359692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 252/512] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:54.359692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461bd43-95a0-4ef5-9732-29104beea3a4 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:54.437074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 261/513] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:54.437698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dd1d0-17f6-4af2-a42a-8debbe22d06f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:54.460822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461bd43-95a0-4ef5-9732-29104beea3a4 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:54.486580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:54.494210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97d968-3c40-43c5-89fb-22df4d9cb321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:54.494987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97d968-3c40-43c5-89fb-22df4d9cb321 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:54.495272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97d968-3c40-43c5-89fb-22df4d9cb321 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:54.495549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97d968-3c40-43c5-89fb-22df4d9cb321 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:54.496266 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97d968-3c40-43c5-89fb-22df4d9cb321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:54.496572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97d968-3c40-43c5-89fb-22df4d9cb321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:54.497961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:54.498071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97d968-3c40-43c5-89fb-22df4d9cb321 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:54.510272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 253/514] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:54.511066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97d968-3c40-43c5-89fb-22df4d9cb321 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:54.536603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dd1d0-17f6-4af2-a42a-8debbe22d06f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:54.570214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4220092-16f3-4cf1-b8e2-d3499966dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:54.571008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220092-16f3-4cf1-b8e2-d3499966dbcc None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:54.571292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220092-16f3-4cf1-b8e2-d3499966dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:54.571574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4220092-16f3-4cf1-b8e2-d3499966dbcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:54.583311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4220092-16f3-4cf1-b8e2-d3499966dbcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:54.584786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4220092-16f3-4cf1-b8e2-d3499966dbcc None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-b4220092-16f3-4cf1-b8e2-d3499966dbcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:54.601750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:54.602673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:54.608094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:54.608094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:54.608094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:54.608094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:54.608094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 262/515] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:54.608094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4220092-16f3-4cf1-b8e2-d3499966dbcc None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:54.615219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97d968-3c40-43c5-89fb-22df4d9cb321 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:54.650957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c5e3e-d3d7-4c02-b0e9-dad4df38b7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:54.651622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c5e3e-d3d7-4c02-b0e9-dad4df38b7ba None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:54.651901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c5e3e-d3d7-4c02-b0e9-dad4df38b7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:54.652172 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c5e3e-d3d7-4c02-b0e9-dad4df38b7ba None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:54.653034 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c5e3e-d3d7-4c02-b0e9-dad4df38b7ba None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:54.653341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c5e3e-d3d7-4c02-b0e9-dad4df38b7ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:54.654787 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c5e3e-d3d7-4c02-b0e9-dad4df38b7ba None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:54.671578 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 254/516] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jun 23 12:51:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:54.672363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c5e3e-d3d7-4c02-b0e9-dad4df38b7ba None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:54.704001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4220092-16f3-4cf1-b8e2-d3499966dbcc None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:54.717168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:54.725228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:54.743643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc8716-2f71-4a28-a07e-59a8e4c8642e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:54.744306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8716-2f71-4a28-a07e-59a8e4c8642e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:54.744586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8716-2f71-4a28-a07e-59a8e4c8642e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:54.744892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc8716-2f71-4a28-a07e-59a8e4c8642e None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:54.745622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc8716-2f71-4a28-a07e-59a8e4c8642e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:54.745926 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc8716-2f71-4a28-a07e-59a8e4c8642e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:54.747298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc8716-2f71-4a28-a07e-59a8e4c8642e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:54.758728 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 263/517] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:54.759494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc8716-2f71-4a28-a07e-59a8e4c8642e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:54.775843 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c5e3e-d3d7-4c02-b0e9-dad4df38b7ba None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:54.809685 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17063b34-0711-46c2-bc4f-c506b84e9cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:54.810464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063b34-0711-46c2-bc4f-c506b84e9cbe None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:54.810738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063b34-0711-46c2-bc4f-c506b84e9cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:54.811010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17063b34-0711-46c2-bc4f-c506b84e9cbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:54.821801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17063b34-0711-46c2-bc4f-c506b84e9cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:54.823261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17063b34-0711-46c2-bc4f-c506b84e9cbe None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-17063b34-0711-46c2-bc4f-c506b84e9cbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:54.841157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:54.842014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:54.848551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:54.848551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:54.848551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:54.848551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:54.848551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 255/518] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:54.848551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17063b34-0711-46c2-bc4f-c506b84e9cbe None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:54.862183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc8716-2f71-4a28-a07e-59a8e4c8642e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:54.898475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887ba86-6888-483a-831a-fd9c1592b9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:54.899145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887ba86-6888-483a-831a-fd9c1592b9cf None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:54.899429 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887ba86-6888-483a-831a-fd9c1592b9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:54.899703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887ba86-6888-483a-831a-fd9c1592b9cf None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:54.900406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887ba86-6888-483a-831a-fd9c1592b9cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:54.901871 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887ba86-6888-483a-831a-fd9c1592b9cf None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:54.942949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:54.946618 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17063b34-0711-46c2-bc4f-c506b84e9cbe None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:54.979551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bb9d2-ece4-4e2c-a57e-2482aad4e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:54.980202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bb9d2-ece4-4e2c-a57e-2482aad4e0cf None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:54.980487 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bb9d2-ece4-4e2c-a57e-2482aad4e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:54.980764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bb9d2-ece4-4e2c-a57e-2482aad4e0cf None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:54.981647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bb9d2-ece4-4e2c-a57e-2482aad4e0cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:54.981953 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bb9d2-ece4-4e2c-a57e-2482aad4e0cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:54.983444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bb9d2-ece4-4e2c-a57e-2482aad4e0cf None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:54.994313 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 256/519] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:54.995213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bb9d2-ece4-4e2c-a57e-2482aad4e0cf None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:55.017584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 264/520] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:51:54 2022] POST /identity/v3/users => generated 247 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:51:55.018417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887ba86-6888-483a-831a-fd9c1592b9cf None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:55.058398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:55.113330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bb9d2-ece4-4e2c-a57e-2482aad4e0cf None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:55.144450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887ba86-6888-483a-831a-fd9c1592b9cf None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:55.153962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f80a31-e931-4090-99b9-6bbef5270cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:55.154801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f80a31-e931-4090-99b9-6bbef5270cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:55.155894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f80a31-e931-4090-99b9-6bbef5270cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:55.156734 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f80a31-e931-4090-99b9-6bbef5270cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:55.191207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e11850-d7e4-4294-a985-eb265e117487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:55.192465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11850-d7e4-4294-a985-eb265e117487 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:55.192951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11850-d7e4-4294-a985-eb265e117487 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:55.193399 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e11850-d7e4-4294-a985-eb265e117487 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:55.195183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:55.203974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e11850-d7e4-4294-a985-eb265e117487 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:55.205723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e11850-d7e4-4294-a985-eb265e117487 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-61e11850-d7e4-4294-a985-eb265e117487 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:51:55.221735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:55.222601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:55.223564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:51:55.223564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:51:55.223564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:51:55.223564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:51:55.223564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:51:55.223564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:51:55.223564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:51:55.223564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:55.223988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 265/521] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:55.227256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e11850-d7e4-4294-a985-eb265e117487 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:55.245484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f80a31-e931-4090-99b9-6bbef5270cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:55.246894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f80a31-e931-4090-99b9-6bbef5270cb2 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:55.322447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:55.331722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e11850-d7e4-4294-a985-eb265e117487 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:55.357185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 257/522] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:55.358315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f80a31-e931-4090-99b9-6bbef5270cb2 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:55.368864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1b24a-4c9a-417d-83b2-d856a45c3ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:55.369727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1b24a-4c9a-417d-83b2-d856a45c3ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:55.370213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1b24a-4c9a-417d-83b2-d856a45c3ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:55.370631 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1b24a-4c9a-417d-83b2-d856a45c3ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:55.371491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1b24a-4c9a-417d-83b2-d856a45c3ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:55.371957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1b24a-4c9a-417d-83b2-d856a45c3ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:55.373729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1b24a-4c9a-417d-83b2-d856a45c3ec7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:55.386752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 266/523] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:55.387758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1b24a-4c9a-417d-83b2-d856a45c3ec7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:55.423816 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:55.474019 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f80a31-e931-4090-99b9-6bbef5270cb2 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:55.495336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1b24a-4c9a-417d-83b2-d856a45c3ec7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:55.510036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13c9f3-debd-46cd-a604-aefd7c6c67fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:55.511180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c9f3-debd-46cd-a604-aefd7c6c67fd None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:55.511470 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c9f3-debd-46cd-a604-aefd7c6c67fd None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:55.511754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c9f3-debd-46cd-a604-aefd7c6c67fd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:55.521924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13c9f3-debd-46cd-a604-aefd7c6c67fd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:55.523405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13c9f3-debd-46cd-a604-aefd7c6c67fd None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:55.535145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25859f89-a25a-4a67-8699-11e45287bf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:55.536908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25859f89-a25a-4a67-8699-11e45287bf8c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:55.536908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25859f89-a25a-4a67-8699-11e45287bf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:55.536908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25859f89-a25a-4a67-8699-11e45287bf8c None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:55.537165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25859f89-a25a-4a67-8699-11e45287bf8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:55.539181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25859f89-a25a-4a67-8699-11e45287bf8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-ab13c9f3-debd-46cd-a604-aefd7c6c67fd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:51:55.539290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:55.540155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:55.541113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:55.541113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:55.541113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:51:55.541113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:51:55.541113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:51:55.541113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:51:55.541113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:51:55.541113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:51:55.541113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 12:51:55.541113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:55.542386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25859f89-a25a-4a67-8699-11e45287bf8c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:55.542457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 258/524] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:51:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:55.542457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13c9f3-debd-46cd-a604-aefd7c6c67fd None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:55.560450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 267/525] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:55.562038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25859f89-a25a-4a67-8699-11e45287bf8c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:55.579092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:55.661093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13c9f3-debd-46cd-a604-aefd7c6c67fd None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:55.668275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25859f89-a25a-4a67-8699-11e45287bf8c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:55.679625 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:55.697835 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ccbc3-0a39-4264-b36e-15c7387fd4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:55.698636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ccbc3-0a39-4264-b36e-15c7387fd4bb None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:55.698921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ccbc3-0a39-4264-b36e-15c7387fd4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:55.699279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ccbc3-0a39-4264-b36e-15c7387fd4bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:55.706795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9dc92-c1a1-4d4e-bffc-d61a335a8cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:55.707691 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9dc92-c1a1-4d4e-bffc-d61a335a8cfe None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:55.707953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9dc92-c1a1-4d4e-bffc-d61a335a8cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:55.708236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9dc92-c1a1-4d4e-bffc-d61a335a8cfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:55.711479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ccbc3-0a39-4264-b36e-15c7387fd4bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:55.716893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ccbc3-0a39-4264-b36e-15c7387fd4bb None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:55.717098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9dc92-c1a1-4d4e-bffc-d61a335a8cfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:55.717098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab9dc92-c1a1-4d4e-bffc-d61a335a8cfe None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6ab9dc92-c1a1-4d4e-bffc-d61a335a8cfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:51:55.730822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:55.731680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:55.732500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:51:55.732500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:51:55.732500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:51:55.732500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:51:55.732500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:51:55.732500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:51:55.732500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:51:55.732500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:55.737360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 268/526] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-6f0ccbc3-0a39-4264-b36e-15c7387fd4bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:55.738037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:55.738834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:55.739670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:55.739670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:55.739670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:55.739670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:55.739882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9dc92-c1a1-4d4e-bffc-d61a335a8cfe None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:55.739948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 259/527] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:55.740397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ccbc3-0a39-4264-b36e-15c7387fd4bb None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:55.820986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:55.846137 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ccbc3-0a39-4264-b36e-15c7387fd4bb None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:55.852089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9dc92-c1a1-4d4e-bffc-d61a335a8cfe None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:55.894119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b08cd-ca89-4104-baf6-72cde373ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:55.894778 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b08cd-ca89-4104-baf6-72cde373ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:55.895062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b08cd-ca89-4104-baf6-72cde373ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:55.895335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b08cd-ca89-4104-baf6-72cde373ebf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:55.896180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b08cd-ca89-4104-baf6-72cde373ebf6 None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=703c2c40fe434402817a8824c2756ee7) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:55.896445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf08f3-1fa1-4ed0-9788-96472159fb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:55.896564 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b08cd-ca89-4104-baf6-72cde373ebf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:55.897143 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf08f3-1fa1-4ed0-9788-96472159fb0a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:55.897428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf08f3-1fa1-4ed0-9788-96472159fb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:55.897704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf08f3-1fa1-4ed0-9788-96472159fb0a None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:55.897960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b08cd-ca89-4104-baf6-72cde373ebf6 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:55.898540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf08f3-1fa1-4ed0-9788-96472159fb0a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:55.898848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf08f3-1fa1-4ed0-9788-96472159fb0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:55.900440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf08f3-1fa1-4ed0-9788-96472159fb0a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:55.909892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 260/528] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:55 2022] GET /identity/v3/role_assignments?user.id=703c2c40fe434402817a8824c2756ee7&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:55.909892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b08cd-ca89-4104-baf6-72cde373ebf6 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:55.937856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 269/529] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Jun 23 12:51:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:55.938874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf08f3-1fa1-4ed0-9788-96472159fb0a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:55.955877 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:56.046077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b08cd-ca89-4104-baf6-72cde373ebf6 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:56.086159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf08f3-1fa1-4ed0-9788-96472159fb0a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:56.086922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db101de-c4c3-42ab-93d5-0426ff8e81ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:56.087777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db101de-c4c3-42ab-93d5-0426ff8e81ea None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:56.088129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db101de-c4c3-42ab-93d5-0426ff8e81ea None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:56.088592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db101de-c4c3-42ab-93d5-0426ff8e81ea None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:56.089489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db101de-c4c3-42ab-93d5-0426ff8e81ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:56.089863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db101de-c4c3-42ab-93d5-0426ff8e81ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:56.091407 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db101de-c4c3-42ab-93d5-0426ff8e81ea None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:56.119583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 261/530] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:51:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:56.119583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db101de-c4c3-42ab-93d5-0426ff8e81ea None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:56.128663 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:56.134546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2529ee-1b82-4321-a07d-ef0cb465f190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:56.135300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2529ee-1b82-4321-a07d-ef0cb465f190 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:56.135653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2529ee-1b82-4321-a07d-ef0cb465f190 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:56.136006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2529ee-1b82-4321-a07d-ef0cb465f190 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:56.136908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2529ee-1b82-4321-a07d-ef0cb465f190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:56.137393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2529ee-1b82-4321-a07d-ef0cb465f190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:56.138799 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2529ee-1b82-4321-a07d-ef0cb465f190 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:56.151709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 270/531] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:56.152645 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2529ee-1b82-4321-a07d-ef0cb465f190 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:56.258046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db101de-c4c3-42ab-93d5-0426ff8e81ea None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:56.261247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:56.277693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2529ee-1b82-4321-a07d-ef0cb465f190 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:56.301971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c7af-e702-4cf7-80c9-18b967791f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:56.303187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c7af-e702-4cf7-80c9-18b967791f1f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:56.303947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c7af-e702-4cf7-80c9-18b967791f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:56.304871 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1c7af-e702-4cf7-80c9-18b967791f1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:56.316739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16b8f-3860-41f7-be4e-64c0687c268d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:56.317698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16b8f-3860-41f7-be4e-64c0687c268d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:56.317698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16b8f-3860-41f7-be4e-64c0687c268d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:56.317989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca16b8f-3860-41f7-be4e-64c0687c268d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:56.318890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca16b8f-3860-41f7-be4e-64c0687c268d None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=fe6832291d504cff9e787c0d791c70ed) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:56.319249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca16b8f-3860-41f7-be4e-64c0687c268d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:56.321034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca16b8f-3860-41f7-be4e-64c0687c268d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:56.332843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 271/532] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:56 2022] GET /identity/v3/role_assignments?user.id=fe6832291d504cff9e787c0d791c70ed&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:56.332843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16b8f-3860-41f7-be4e-64c0687c268d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:56.433273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:56.458681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1c7af-e702-4cf7-80c9-18b967791f1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:56.461203 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1c7af-e702-4cf7-80c9-18b967791f1f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:56.511825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca16b8f-3860-41f7-be4e-64c0687c268d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:56.552910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5a249-471b-4889-a3e7-f8dbc5f52768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:56.553976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5a249-471b-4889-a3e7-f8dbc5f52768 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:56.554510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5a249-471b-4889-a3e7-f8dbc5f52768 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:56.554932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5a249-471b-4889-a3e7-f8dbc5f52768 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:56.565278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5a249-471b-4889-a3e7-f8dbc5f52768 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:56.566945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f5a249-471b-4889-a3e7-f8dbc5f52768 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-30f5a249-471b-4889-a3e7-f8dbc5f52768 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:51:56.583175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:56.584585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:56.585683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:51:56.585683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:51:56.585683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:51:56.585683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:51:56.585683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:51:56.585683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:51:56.585683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:51:56.585683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:56.588003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 272/533] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:56.593705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5a249-471b-4889-a3e7-f8dbc5f52768 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:56.629465 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:56.647937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 262/534] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:56.655482 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c7af-e702-4cf7-80c9-18b967791f1f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:56.714204 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f5a249-471b-4889-a3e7-f8dbc5f52768 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:56.730159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:56.751732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc14b2-9b02-4332-b70b-eb31b7334e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:56.752250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc14b2-9b02-4332-b70b-eb31b7334e91 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:56.752542 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc14b2-9b02-4332-b70b-eb31b7334e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:56.752835 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc14b2-9b02-4332-b70b-eb31b7334e91 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:56.753833 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc14b2-9b02-4332-b70b-eb31b7334e91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:56.754148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc14b2-9b02-4332-b70b-eb31b7334e91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:56.760844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc14b2-9b02-4332-b70b-eb31b7334e91 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:56.768537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 273/535] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:51:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:56.777087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc14b2-9b02-4332-b70b-eb31b7334e91 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:56.824931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1c7af-e702-4cf7-80c9-18b967791f1f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:56.877475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708ca17-3a3e-463f-90b5-91222317bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:56.878279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708ca17-3a3e-463f-90b5-91222317bf5f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:56.878562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708ca17-3a3e-463f-90b5-91222317bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:56.878840 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c708ca17-3a3e-463f-90b5-91222317bf5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:56.897499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708ca17-3a3e-463f-90b5-91222317bf5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:56.898985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c708ca17-3a3e-463f-90b5-91222317bf5f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-c708ca17-3a3e-463f-90b5-91222317bf5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:56.932223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:56.933247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:56.934068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:56.934068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:56.934068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:56.934068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:56.934068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 263/536] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:56.941755 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708ca17-3a3e-463f-90b5-91222317bf5f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:56.961103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc14b2-9b02-4332-b70b-eb31b7334e91 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:57.000433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fc6ec-a994-48bd-a784-67303ed7aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:57.001126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc6ec-a994-48bd-a784-67303ed7aeae None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:57.001412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc6ec-a994-48bd-a784-67303ed7aeae None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:57.001690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fc6ec-a994-48bd-a784-67303ed7aeae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:57.002588 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fc6ec-a994-48bd-a784-67303ed7aeae None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=75e6ac80e76b41e4976f5a10daad85d8) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:57.002952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fc6ec-a994-48bd-a784-67303ed7aeae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:57.004403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fc6ec-a994-48bd-a784-67303ed7aeae None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:57.010754 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 274/537] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:56 2022] GET /identity/v3/role_assignments?user.id=75e6ac80e76b41e4976f5a10daad85d8&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:57.026760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:57.121448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c708ca17-3a3e-463f-90b5-91222317bf5f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:57.174919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fce4cb-0827-4107-bcbb-af0a2fbb6533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:57.175607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fce4cb-0827-4107-bcbb-af0a2fbb6533 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:57.175896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fce4cb-0827-4107-bcbb-af0a2fbb6533 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:57.176177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fce4cb-0827-4107-bcbb-af0a2fbb6533 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:57.176957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fce4cb-0827-4107-bcbb-af0a2fbb6533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:57.177270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fce4cb-0827-4107-bcbb-af0a2fbb6533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:57.178705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fce4cb-0827-4107-bcbb-af0a2fbb6533 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:57.196992 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 264/538] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:57.202842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fc6ec-a994-48bd-a784-67303ed7aeae None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:57.215084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec2a47-8891-496e-b2cb-c08abb569400 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:57.215379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec2a47-8891-496e-b2cb-c08abb569400 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:57.215671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec2a47-8891-496e-b2cb-c08abb569400 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:57.217416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 265/539] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:51:57.222625 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71664f-5fa9-444a-8882-5f8eae6c3d29 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:57.222918 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71664f-5fa9-444a-8882-5f8eae6c3d29 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:57.223200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71664f-5fa9-444a-8882-5f8eae6c3d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:57.254668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-4d71664f-5fa9-444a-8882-5f8eae6c3d29 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:57.258421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4d71664f-5fa9-444a-8882-5f8eae6c3d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:57.287773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:57.391189 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 266/540] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:51:57.394588 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fc6ec-a994-48bd-a784-67303ed7aeae None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:57.429763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe625f-3cd5-47cf-a6b7-a776c620362c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:57.430564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe625f-3cd5-47cf-a6b7-a776c620362c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:57.430849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe625f-3cd5-47cf-a6b7-a776c620362c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:57.431126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe625f-3cd5-47cf-a6b7-a776c620362c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:57.431469 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71664f-5fa9-444a-8882-5f8eae6c3d29 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:57.438161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe625f-3cd5-47cf-a6b7-a776c620362c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:57.439627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe625f-3cd5-47cf-a6b7-a776c620362c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-07fe625f-3cd5-47cf-a6b7-a776c620362c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:51:57.454793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:57.455639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:57.456945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:51:57.456945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:51:57.456945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:51:57.456945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:51:57.456945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:51:57.456945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:51:57.456945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:51:57.456945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:57.456945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 275/541] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:51:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:57.461625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe625f-3cd5-47cf-a6b7-a776c620362c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:57.519452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:57.565883 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe625f-3cd5-47cf-a6b7-a776c620362c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:57.568547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:57.601389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46623a-05f3-4de2-84de-f9262231784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:57.602174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46623a-05f3-4de2-84de-f9262231784a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:57.602528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46623a-05f3-4de2-84de-f9262231784a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:57.602921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46623a-05f3-4de2-84de-f9262231784a None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:57.603798 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46623a-05f3-4de2-84de-f9262231784a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:57.604213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46623a-05f3-4de2-84de-f9262231784a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:57.606452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46623a-05f3-4de2-84de-f9262231784a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:57.619098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 276/542] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:51:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:57.624860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46623a-05f3-4de2-84de-f9262231784a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:57.698788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71664f-5fa9-444a-8882-5f8eae6c3d29 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:57.742593 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46623a-05f3-4de2-84de-f9262231784a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:57.777535 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01814e81-8858-4463-b3f7-436abe62998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:57.778261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01814e81-8858-4463-b3f7-436abe62998d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:57.778544 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01814e81-8858-4463-b3f7-436abe62998d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:57.778820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01814e81-8858-4463-b3f7-436abe62998d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:57.800193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01814e81-8858-4463-b3f7-436abe62998d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-01814e81-8858-4463-b3f7-436abe62998d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:57.813863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:57.814819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:57.815611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:57.815611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:57.815611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:57.815611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:57.815611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:57.815611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:57.815611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:57.815611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:57.815611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:57.815611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:57.815611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:57.815611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:57.816790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 267/543] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:51:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:51:57.817976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42c8b-6172-4499-a6d2-83037533d610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:57.818645 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42c8b-6172-4499-a6d2-83037533d610 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:57.818927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42c8b-6172-4499-a6d2-83037533d610 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:57.819203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42c8b-6172-4499-a6d2-83037533d610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:57.820044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea42c8b-6172-4499-a6d2-83037533d610 None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=83858713769b41af800bab317602bf2f) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:57.820356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea42c8b-6172-4499-a6d2-83037533d610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:57.821894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea42c8b-6172-4499-a6d2-83037533d610 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:57.824350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01814e81-8858-4463-b3f7-436abe62998d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:57.833578 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 277/544] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:51:57 2022] GET /identity/v3/role_assignments?user.id=83858713769b41af800bab317602bf2f&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:57.941215 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:57.949145 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01814e81-8858-4463-b3f7-436abe62998d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:58.006889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cce35f-8753-48a2-b628-0557768e2f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:58.007931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cce35f-8753-48a2-b628-0557768e2f55 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:58.008413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cce35f-8753-48a2-b628-0557768e2f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:58.008938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cce35f-8753-48a2-b628-0557768e2f55 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:58.009954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cce35f-8753-48a2-b628-0557768e2f55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:58.010464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cce35f-8753-48a2-b628-0557768e2f55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:58.012040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cce35f-8753-48a2-b628-0557768e2f55 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:58.024198 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 268/545] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:51:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:58.030748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42c8b-6172-4499-a6d2-83037533d610 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:58.071847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:58.180242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42c8b-6172-4499-a6d2-83037533d610 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:58.229592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da96895-3ea0-4c02-9d4f-dfd9e0b7a258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:58.230403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da96895-3ea0-4c02-9d4f-dfd9e0b7a258 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:58.230693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da96895-3ea0-4c02-9d4f-dfd9e0b7a258 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:58.230975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da96895-3ea0-4c02-9d4f-dfd9e0b7a258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:58.244517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da96895-3ea0-4c02-9d4f-dfd9e0b7a258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:58.246016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da96895-3ea0-4c02-9d4f-dfd9e0b7a258 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-1da96895-3ea0-4c02-9d4f-dfd9e0b7a258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:58.273409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:58.274323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:58.275642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:58.275642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:58.275642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:58.275642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:58.275642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 278/546] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:58.281134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cce35f-8753-48a2-b628-0557768e2f55 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:58.423659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbabdce-0e6e-4ec9-9eef-986c7be6ac2e None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:58.424001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbabdce-0e6e-4ec9-9eef-986c7be6ac2e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:58.424215 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbabdce-0e6e-4ec9-9eef-986c7be6ac2e None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:58.425935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 279/547] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:58.432529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d369e-74c4-4e68-bd9e-b72b89f7b613 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:58.432917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d369e-74c4-4e68-bd9e-b72b89f7b613 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:58.433267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d369e-74c4-4e68-bd9e-b72b89f7b613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:58.435999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cce35f-8753-48a2-b628-0557768e2f55 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:58.465848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c39d369e-74c4-4e68-bd9e-b72b89f7b613 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:58.467154 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c39d369e-74c4-4e68-bd9e-b72b89f7b613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:58.474188 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49dbd-e3fd-4797-a54c-9a076f278c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:58.475200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49dbd-e3fd-4797-a54c-9a076f278c18 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:58.475712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49dbd-e3fd-4797-a54c-9a076f278c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:58.476229 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49dbd-e3fd-4797-a54c-9a076f278c18 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:58.477189 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce49dbd-e3fd-4797-a54c-9a076f278c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:58.477775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce49dbd-e3fd-4797-a54c-9a076f278c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:58.479429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce49dbd-e3fd-4797-a54c-9a076f278c18 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:58.493624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 269/548] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:58.501611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49dbd-e3fd-4797-a54c-9a076f278c18 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:58.523563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:58.608484 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 280/549] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:58.645833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49dbd-e3fd-4797-a54c-9a076f278c18 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:58.649790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d369e-74c4-4e68-bd9e-b72b89f7b613 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:58.652866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:58.729565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1fefa-0f08-41bf-9139-8e42e894b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:58.730365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1fefa-0f08-41bf-9139-8e42e894b042 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:58.730648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1fefa-0f08-41bf-9139-8e42e894b042 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:58.730924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1fefa-0f08-41bf-9139-8e42e894b042 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:58.748289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1fefa-0f08-41bf-9139-8e42e894b042 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:58.750735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1fefa-0f08-41bf-9139-8e42e894b042 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-c0b1fefa-0f08-41bf-9139-8e42e894b042 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:51:58.781329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:58.782363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:58.783256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:58.783256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:58.783256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:51:58.783256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:51:58.783256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:51:58.783256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:51:58.783256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:51:58.783256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:51:58.783256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:51:58.783256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:58.789299 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 270/550] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:51:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:58.794751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1fefa-0f08-41bf-9139-8e42e894b042 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:58.804288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d369e-74c4-4e68-bd9e-b72b89f7b613 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:58.847657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fb8b8-c078-41d4-9161-96624bbe7e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:58.848675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fb8b8-c078-41d4-9161-96624bbe7e7b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:58.849212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fb8b8-c078-41d4-9161-96624bbe7e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:58.849493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fb8b8-c078-41d4-9161-96624bbe7e7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:58.864118 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fb8b8-c078-41d4-9161-96624bbe7e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-af4fb8b8-c078-41d4-9161-96624bbe7e7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:58.874108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:58.875199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:58.876258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 281/551] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:51:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:58.877340 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d30bdd-057c-4de4-b052-2811f20dbbde None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:58.877624 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d30bdd-057c-4de4-b052-2811f20dbbde None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:58.877899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d30bdd-057c-4de4-b052-2811f20dbbde None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:58.883189 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 282/552] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:58.883189 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d30bdd-057c-4de4-b052-2811f20dbbde None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:58.923741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:58.949321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1fefa-0f08-41bf-9139-8e42e894b042 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:58.968195 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:59.003545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac4d43-7711-4173-97bf-1be8bb9a73b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:59.004907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac4d43-7711-4173-97bf-1be8bb9a73b3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:59.005825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac4d43-7711-4173-97bf-1be8bb9a73b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:59.006559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac4d43-7711-4173-97bf-1be8bb9a73b3 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:59.007962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac4d43-7711-4173-97bf-1be8bb9a73b3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:59.008950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac4d43-7711-4173-97bf-1be8bb9a73b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:59.011050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ac4d43-7711-4173-97bf-1be8bb9a73b3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:59.012177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d30bdd-057c-4de4-b052-2811f20dbbde None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:59.035963 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 271/553] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jun 23 12:51:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:51:59.038124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c90f3-693e-45de-bdf8-1aee819ee9d4 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:59.039043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c90f3-693e-45de-bdf8-1aee819ee9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:59.039662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c90f3-693e-45de-bdf8-1aee819ee9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:59.050823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5a04e-a0ef-435c-ab0c-61258980b9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:59.051490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5a04e-a0ef-435c-ab0c-61258980b9db None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:59.051822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5a04e-a0ef-435c-ab0c-61258980b9db None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:59.052097 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5a04e-a0ef-435c-ab0c-61258980b9db None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:59.052918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5a04e-a0ef-435c-ab0c-61258980b9db None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:59.053228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5a04e-a0ef-435c-ab0c-61258980b9db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:59.054610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5a04e-a0ef-435c-ab0c-61258980b9db None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:59.063542 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-941c90f3-693e-45de-bdf8-1aee819ee9d4 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:59.063704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 283/554] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:51:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:59.064534 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5a04e-a0ef-435c-ab0c-61258980b9db None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:59.065556 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-941c90f3-693e-45de-bdf8-1aee819ee9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:59.159568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 272/555] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:59.160737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c90f3-693e-45de-bdf8-1aee819ee9d4 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:59.213425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5a04e-a0ef-435c-ab0c-61258980b9db None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:59.250705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:59.253788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:59.265889 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccadfc-dbaa-4958-af5e-8056b9fe6a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:59.267005 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccadfc-dbaa-4958-af5e-8056b9fe6a14 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:59.267453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccadfc-dbaa-4958-af5e-8056b9fe6a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:59.268479 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ccadfc-dbaa-4958-af5e-8056b9fe6a14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:59.286732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c90f3-693e-45de-bdf8-1aee819ee9d4 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:59.322529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29662bd3-53e0-4524-bc6d-8c341dc95ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:59.323323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29662bd3-53e0-4524-bc6d-8c341dc95ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:59.323814 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29662bd3-53e0-4524-bc6d-8c341dc95ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:59.323923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29662bd3-53e0-4524-bc6d-8c341dc95ac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:59.335177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29662bd3-53e0-4524-bc6d-8c341dc95ac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:59.336703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29662bd3-53e0-4524-bc6d-8c341dc95ac3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:59.354457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccadfc-dbaa-4958-af5e-8056b9fe6a14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-29662bd3-53e0-4524-bc6d-8c341dc95ac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:59.354766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:59.355690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:59.356723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:59.356723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:59.356723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:59.356723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:59.356723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 273/556] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:59.357436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29662bd3-53e0-4524-bc6d-8c341dc95ac3 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:59.360017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ccadfc-dbaa-4958-af5e-8056b9fe6a14 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:59.475466 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29662bd3-53e0-4524-bc6d-8c341dc95ac3 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:59.488478 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 284/557] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:51:59.488478 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccadfc-dbaa-4958-af5e-8056b9fe6a14 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:59.503972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:59.518005 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:59.521865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c95e38-ae77-4f3a-8088-f08dd760f00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:59.522664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c95e38-ae77-4f3a-8088-f08dd760f00a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:59.522946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c95e38-ae77-4f3a-8088-f08dd760f00a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:59.523231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c95e38-ae77-4f3a-8088-f08dd760f00a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:59.534772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c95e38-ae77-4f3a-8088-f08dd760f00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-d3c95e38-ae77-4f3a-8088-f08dd760f00a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:51:59.542422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:59.544467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 274/558] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:51:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:59.545910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81454a-82b9-4006-9486-babeef128ac3 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:59.548137 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81454a-82b9-4006-9486-babeef128ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:59.548137 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81454a-82b9-4006-9486-babeef128ac3 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:59.551129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 275/559] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:51:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:51:59.551917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81454a-82b9-4006-9486-babeef128ac3 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:59.617490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ccadfc-dbaa-4958-af5e-8056b9fe6a14 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:59.655217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a72d2d-08bf-4d31-a253-03ea9d309563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:59.655882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a72d2d-08bf-4d31-a253-03ea9d309563 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:59.656165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a72d2d-08bf-4d31-a253-03ea9d309563 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:59.656444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a72d2d-08bf-4d31-a253-03ea9d309563 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:59.657212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a72d2d-08bf-4d31-a253-03ea9d309563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:59.657516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a72d2d-08bf-4d31-a253-03ea9d309563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:59.658878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a72d2d-08bf-4d31-a253-03ea9d309563 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:59.670547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81454a-82b9-4006-9486-babeef128ac3 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:59.670735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 285/560] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:59.675478 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218912f-5b4d-4de8-8a8d-359969964e5e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:59.675478 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218912f-5b4d-4de8-8a8d-359969964e5e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:59.675478 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218912f-5b4d-4de8-8a8d-359969964e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:59.691578 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-4218912f-5b4d-4de8-8a8d-359969964e5e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:51:59.692774 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4218912f-5b4d-4de8-8a8d-359969964e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:51:59.712244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501fbaa-d8a7-464c-bbbd-5a2c10e09f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:59.713127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501fbaa-d8a7-464c-bbbd-5a2c10e09f45 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:59.713408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501fbaa-d8a7-464c-bbbd-5a2c10e09f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:59.713678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501fbaa-d8a7-464c-bbbd-5a2c10e09f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:59.724546 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501fbaa-d8a7-464c-bbbd-5a2c10e09f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:59.726100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501fbaa-d8a7-464c-bbbd-5a2c10e09f45 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-2501fbaa-d8a7-464c-bbbd-5a2c10e09f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:51:59.744824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:59.745777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:59.746665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:51:59.746665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:51:59.746665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:51:59.746665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:51:59.746665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 276/561] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:59.747903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501fbaa-d8a7-464c-bbbd-5a2c10e09f45 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:59.771510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 286/562] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:51:59.772751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218912f-5b4d-4de8-8a8d-359969964e5e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:59.790956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:59.797219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:51:59.870305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501fbaa-d8a7-464c-bbbd-5a2c10e09f45 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:59.884838 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218912f-5b4d-4de8-8a8d-359969964e5e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:51:59.911071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb0477-3f86-408a-98bc-4adc498c9666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:59.912018 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb0477-3f86-408a-98bc-4adc498c9666 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:59.912521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb0477-3f86-408a-98bc-4adc498c9666 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:59.912825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb0477-3f86-408a-98bc-4adc498c9666 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:59.913584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb0477-3f86-408a-98bc-4adc498c9666 None admin] RBAC: Adding query filter params (name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:51:59.913896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb0477-3f86-408a-98bc-4adc498c9666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:59.915277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb0477-3f86-408a-98bc-4adc498c9666 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:59.922700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245e255-c37b-4e4d-9f2f-f2f343b787fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:51:59.923495 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245e255-c37b-4e4d-9f2f-f2f343b787fe None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:51:59.923780 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245e255-c37b-4e4d-9f2f-f2f343b787fe None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:51:59.924059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245e255-c37b-4e4d-9f2f-f2f343b787fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:51:59.925083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 277/563] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:51:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:51:59.925986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb0477-3f86-408a-98bc-4adc498c9666 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:51:59.936552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245e255-c37b-4e4d-9f2f-f2f343b787fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:51:59.939063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245e255-c37b-4e4d-9f2f-f2f343b787fe None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-7245e255-c37b-4e4d-9f2f-f2f343b787fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:51:59.953680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:51:59.954831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:51:59.955974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:51:59.955974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:51:59.955974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:51:59.955974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:51:59.955974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:51:59.955974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:51:59.955974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:51:59.955974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:51:59.955974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:51:59.955974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:51:59.959592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 287/564] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 23 12:51:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:51:59.960427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245e255-c37b-4e4d-9f2f-f2f343b787fe None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:00.026187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:00.036165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb0477-3f86-408a-98bc-4adc498c9666 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:00.047901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:00.071034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245e255-c37b-4e4d-9f2f-f2f343b787fe None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:00.073320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda79293-c4c2-427a-bef3-f6993ccb3af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:00.074051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda79293-c4c2-427a-bef3-f6993ccb3af7 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.074338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda79293-c4c2-427a-bef3-f6993ccb3af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.074615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda79293-c4c2-427a-bef3-f6993ccb3af7 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.075345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda79293-c4c2-427a-bef3-f6993ccb3af7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:00.075650 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda79293-c4c2-427a-bef3-f6993ccb3af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:00.078185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda79293-c4c2-427a-bef3-f6993ccb3af7 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:00.090258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 278/565] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:00.091072 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda79293-c4c2-427a-bef3-f6993ccb3af7 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:00.109096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a925510-7c78-47c8-b2ff-0292833a2054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:00.110117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a925510-7c78-47c8-b2ff-0292833a2054 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.110553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a925510-7c78-47c8-b2ff-0292833a2054 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.110978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a925510-7c78-47c8-b2ff-0292833a2054 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.121594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a925510-7c78-47c8-b2ff-0292833a2054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6a925510-7c78-47c8-b2ff-0292833a2054 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:00.129722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:00.130852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:00.131834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:00.131834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:00.131834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:00.131834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:00.131834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:00.131834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:00.131834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:00.131834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:00.131834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:00.131834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:00.131834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:00.131834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:00.134116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 288/566] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:51:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:00.135114 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a925510-7c78-47c8-b2ff-0292833a2054 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:00.202634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda79293-c4c2-427a-bef3-f6993ccb3af7 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:00.236035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5495a4-8cd4-4af6-868b-e86b653070a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:00.236858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5495a4-8cd4-4af6-868b-e86b653070a5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.237142 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5495a4-8cd4-4af6-868b-e86b653070a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.237429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5495a4-8cd4-4af6-868b-e86b653070a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.240920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a925510-7c78-47c8-b2ff-0292833a2054 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:00.247729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5495a4-8cd4-4af6-868b-e86b653070a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:00.249270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5495a4-8cd4-4af6-868b-e86b653070a5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-6a5495a4-8cd4-4af6-868b-e86b653070a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:00.266745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:00.267725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:00.268614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:00.268614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:00.268614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:00.268614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:00.268614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 279/567] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:00.268940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5495a4-8cd4-4af6-868b-e86b653070a5 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:00.275461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:00.276797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4308bc3-b1be-42af-8595-0c30d93af089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:00.277442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308bc3-b1be-42af-8595-0c30d93af089 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.277727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308bc3-b1be-42af-8595-0c30d93af089 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.278004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4308bc3-b1be-42af-8595-0c30d93af089 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.278843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4308bc3-b1be-42af-8595-0c30d93af089 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:00.279153 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4308bc3-b1be-42af-8595-0c30d93af089 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:00.281182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4308bc3-b1be-42af-8595-0c30d93af089 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:00.283803 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:00.298573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 289/568] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 23 12:52:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:00.299366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4308bc3-b1be-42af-8595-0c30d93af089 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:00.370670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5495a4-8cd4-4af6-868b-e86b653070a5 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:00.398330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4308bc3-b1be-42af-8595-0c30d93af089 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:00.404235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7484bbf8-583f-4190-a82a-7400beb6ca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:00.405903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484bbf8-583f-4190-a82a-7400beb6ca57 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.406191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484bbf8-583f-4190-a82a-7400beb6ca57 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.406472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484bbf8-583f-4190-a82a-7400beb6ca57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.413582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484bbf8-583f-4190-a82a-7400beb6ca57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:00.415052 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7484bbf8-583f-4190-a82a-7400beb6ca57 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-7484bbf8-583f-4190-a82a-7400beb6ca57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:00.430273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:00.431153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:00.432047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:00.432047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:00.432047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:00.432047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:00.432047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:00.432047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:00.432047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:00.432047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:00.432047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 280/569] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:00.432689 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8515a-48bc-412b-beb9-b6a93e2be357 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.433052 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8515a-48bc-412b-beb9-b6a93e2be357 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.433315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb8515a-48bc-412b-beb9-b6a93e2be357 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.434490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 281/570] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:00.435183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8515a-48bc-412b-beb9-b6a93e2be357 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:00.437114 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c99dea-953b-4154-8c04-2db439a4e7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:00.437870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c99dea-953b-4154-8c04-2db439a4e7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.438221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c99dea-953b-4154-8c04-2db439a4e7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.438562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c99dea-953b-4154-8c04-2db439a4e7b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.439319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c99dea-953b-4154-8c04-2db439a4e7b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:00.440419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c99dea-953b-4154-8c04-2db439a4e7b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:00.441135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c99dea-953b-4154-8c04-2db439a4e7b4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:00.449255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 290/571] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:52:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:00.450022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c99dea-953b-4154-8c04-2db439a4e7b4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:00.501389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:00.507553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:00.539050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb8515a-48bc-412b-beb9-b6a93e2be357 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:00.551338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c99dea-953b-4154-8c04-2db439a4e7b4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:00.573437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a592140-60c9-4b77-a216-218c70c8d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:00.574088 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592140-60c9-4b77-a216-218c70c8d603 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.574370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592140-60c9-4b77-a216-218c70c8d603 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.574646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592140-60c9-4b77-a216-218c70c8d603 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.575365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a592140-60c9-4b77-a216-218c70c8d603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:00.575668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a592140-60c9-4b77-a216-218c70c8d603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:00.577593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a592140-60c9-4b77-a216-218c70c8d603 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:00.584140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfee08-f8e4-47cb-b05c-05e1d60e2eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:00.585045 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfee08-f8e4-47cb-b05c-05e1d60e2eed None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.585439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfee08-f8e4-47cb-b05c-05e1d60e2eed None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.585712 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfee08-f8e4-47cb-b05c-05e1d60e2eed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.589070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 282/572] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:00.589859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a592140-60c9-4b77-a216-218c70c8d603 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:00.598682 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfee08-f8e4-47cb-b05c-05e1d60e2eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:00.600126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfee08-f8e4-47cb-b05c-05e1d60e2eed None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-d8bfee08-f8e4-47cb-b05c-05e1d60e2eed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:00.618361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:00.619291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:00.620201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:00.620201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:00.620201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:00.620201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:00.620201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 291/573] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:00.620702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f475d6e-c061-483c-ad42-6785a1a6a0d8 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.620987 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f475d6e-c061-483c-ad42-6785a1a6a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.621262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f475d6e-c061-483c-ad42-6785a1a6a0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.637452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8f475d6e-c061-483c-ad42-6785a1a6a0d8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:00.638619 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8f475d6e-c061-483c-ad42-6785a1a6a0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:00.691355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a592140-60c9-4b77-a216-218c70c8d603 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:00.705570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 292/574] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:00.706374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f475d6e-c061-483c-ad42-6785a1a6a0d8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:00.715173 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:00.726287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ea750-0ba2-4e99-950e-9f50b4848473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:00.726946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ea750-0ba2-4e99-950e-9f50b4848473 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.727227 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ea750-0ba2-4e99-950e-9f50b4848473 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.727503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ea750-0ba2-4e99-950e-9f50b4848473 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.728549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ea750-0ba2-4e99-950e-9f50b4848473 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:00.728890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ea750-0ba2-4e99-950e-9f50b4848473 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:00.730333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ea750-0ba2-4e99-950e-9f50b4848473 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:00.743059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 283/575] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:00.743698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ea750-0ba2-4e99-950e-9f50b4848473 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:00.761494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:00.819132 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f475d6e-c061-483c-ad42-6785a1a6a0d8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:00.841757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ea750-0ba2-4e99-950e-9f50b4848473 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:00.853004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c73b-e349-44e4-827c-96602c5cdca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:00.853801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c73b-e349-44e4-827c-96602c5cdca5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.854082 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c73b-e349-44e4-827c-96602c5cdca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.854355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c73b-e349-44e4-827c-96602c5cdca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.866568 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349c73b-e349-44e4-827c-96602c5cdca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:00.868198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b349c73b-e349-44e4-827c-96602c5cdca5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:00.877971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401f690-3cc7-4c63-bd4e-5186fa1bb9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:00.878762 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401f690-3cc7-4c63-bd4e-5186fa1bb9f9 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:00.879049 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401f690-3cc7-4c63-bd4e-5186fa1bb9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:00.879330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401f690-3cc7-4c63-bd4e-5186fa1bb9f9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-b349c73b-e349-44e4-827c-96602c5cdca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:00.885617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:00.886942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:00.887823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:00.887823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:00.887823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:00.887823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:00.888045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401f690-3cc7-4c63-bd4e-5186fa1bb9f9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:00.888116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 293/576] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:00.888116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c73b-e349-44e4-827c-96602c5cdca5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:00.888250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401f690-3cc7-4c63-bd4e-5186fa1bb9f9 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-5401f690-3cc7-4c63-bd4e-5186fa1bb9f9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:00.909165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:00.910399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:00.916183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:00.916183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:00.916183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:00.916183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:00.916183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:00.916183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:00.916183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:00.916183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:00.916183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 12:52:00.916183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:00.916183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 284/577] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:00.916183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401f690-3cc7-4c63-bd4e-5186fa1bb9f9 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:00.957427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:00.990687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:01.000142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349c73b-e349-44e4-827c-96602c5cdca5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:01.010155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401f690-3cc7-4c63-bd4e-5186fa1bb9f9 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:01.033874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fea0e-13d6-47ea-96dd-1f4402bbdad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:01.034617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fea0e-13d6-47ea-96dd-1f4402bbdad7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:01.034903 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fea0e-13d6-47ea-96dd-1f4402bbdad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:01.035182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7fea0e-13d6-47ea-96dd-1f4402bbdad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:01.035907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fea0e-13d6-47ea-96dd-1f4402bbdad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:01.036214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fea0e-13d6-47ea-96dd-1f4402bbdad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:01.037613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7fea0e-13d6-47ea-96dd-1f4402bbdad7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:01.043650 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34c834-70d7-40cb-82b5-60eef20007b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:01.044429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34c834-70d7-40cb-82b5-60eef20007b8 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:01.044710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34c834-70d7-40cb-82b5-60eef20007b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:01.045013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34c834-70d7-40cb-82b5-60eef20007b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:01.048443 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 294/578] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:01.049251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fea0e-13d6-47ea-96dd-1f4402bbdad7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:01.055464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34c834-70d7-40cb-82b5-60eef20007b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-ae34c834-70d7-40cb-82b5-60eef20007b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:01.063703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:01.064798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 285/579] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:52:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:01.065688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34c834-70d7-40cb-82b5-60eef20007b8 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:01.155498 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7fea0e-13d6-47ea-96dd-1f4402bbdad7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:01.167669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34c834-70d7-40cb-82b5-60eef20007b8 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:01.169958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:01.189717 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb63ba5-fde9-499a-867f-b305b3c176e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:01.190379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb63ba5-fde9-499a-867f-b305b3c176e5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:01.190662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb63ba5-fde9-499a-867f-b305b3c176e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:01.190939 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb63ba5-fde9-499a-867f-b305b3c176e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:01.191769 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb63ba5-fde9-499a-867f-b305b3c176e5 None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=599a53720ecd4e729a6720a85b653eb0) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:01.192129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb63ba5-fde9-499a-867f-b305b3c176e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:01.193544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb63ba5-fde9-499a-867f-b305b3c176e5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:01.199286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 295/580] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:01 2022] GET /identity/v3/role_assignments?user.id=599a53720ecd4e729a6720a85b653eb0&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:01.200074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb63ba5-fde9-499a-867f-b305b3c176e5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:01.208642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705ca81-2930-4fd3-8ba3-a2622769682a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:01.209749 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705ca81-2930-4fd3-8ba3-a2622769682a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:01.210356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705ca81-2930-4fd3-8ba3-a2622769682a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:01.211043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705ca81-2930-4fd3-8ba3-a2622769682a None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:01.212001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705ca81-2930-4fd3-8ba3-a2622769682a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:01.212313 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705ca81-2930-4fd3-8ba3-a2622769682a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:01.213764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705ca81-2930-4fd3-8ba3-a2622769682a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:01.223100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:01.229483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 286/581] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:01.231415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705ca81-2930-4fd3-8ba3-a2622769682a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:01.319491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb63ba5-fde9-499a-867f-b305b3c176e5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:01.351105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705ca81-2930-4fd3-8ba3-a2622769682a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:01.358547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e003c-32a3-444e-a6bd-18e37ae11fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:01.360171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e003c-32a3-444e-a6bd-18e37ae11fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:01.360171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e003c-32a3-444e-a6bd-18e37ae11fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:01.360171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e003c-32a3-444e-a6bd-18e37ae11fb9 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:01.360733 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e003c-32a3-444e-a6bd-18e37ae11fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:01.361097 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e003c-32a3-444e-a6bd-18e37ae11fb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:01.362652 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e003c-32a3-444e-a6bd-18e37ae11fb9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:01.382133 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 296/582] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jun 23 12:52:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:01.383063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e003c-32a3-444e-a6bd-18e37ae11fb9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:01.391695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac67c8-bbb6-47e5-a0ba-55cabeb8303a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:01.392507 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac67c8-bbb6-47e5-a0ba-55cabeb8303a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:01.392797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac67c8-bbb6-47e5-a0ba-55cabeb8303a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:01.393103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac67c8-bbb6-47e5-a0ba-55cabeb8303a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:01.400027 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac67c8-bbb6-47e5-a0ba-55cabeb8303a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:01.401528 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac67c8-bbb6-47e5-a0ba-55cabeb8303a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-88ac67c8-bbb6-47e5-a0ba-55cabeb8303a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:01.416223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:01.417148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:01.418043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:01.418043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:01.418043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:01.418043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:01.418043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:01.418043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:01.418043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:01.418043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:01.422190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 287/583] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:01.422817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac67c8-bbb6-47e5-a0ba-55cabeb8303a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:01.450530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:01.462481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:01.492950 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e003c-32a3-444e-a6bd-18e37ae11fb9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:01.532074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7702cd-939b-4d3c-89ef-2286fdeca378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:01.533194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7702cd-939b-4d3c-89ef-2286fdeca378 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:01.533758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7702cd-939b-4d3c-89ef-2286fdeca378 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:01.534178 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7702cd-939b-4d3c-89ef-2286fdeca378 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:01.535400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7702cd-939b-4d3c-89ef-2286fdeca378 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:01.535953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7702cd-939b-4d3c-89ef-2286fdeca378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:01.538286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7702cd-939b-4d3c-89ef-2286fdeca378 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:01.542121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac67c8-bbb6-47e5-a0ba-55cabeb8303a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:01.555466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 297/584] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:52:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:01.555466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7702cd-939b-4d3c-89ef-2286fdeca378 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:01.589326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c271e-6820-4ac9-bbf5-6a576d98c31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:01.590223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c271e-6820-4ac9-bbf5-6a576d98c31d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:01.590508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c271e-6820-4ac9-bbf5-6a576d98c31d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:01.590782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c271e-6820-4ac9-bbf5-6a576d98c31d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:01.598725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c271e-6820-4ac9-bbf5-6a576d98c31d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:01.600183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c271e-6820-4ac9-bbf5-6a576d98c31d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-a16c271e-6820-4ac9-bbf5-6a576d98c31d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:01.616276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:01.617559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:01.623178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:01.623178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:01.623178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:01.623178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:01.623178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:01.623178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:01.623178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:01.623178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:01.623178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:52:01.623178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:01.623178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 288/585] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:01.623178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c271e-6820-4ac9-bbf5-6a576d98c31d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:01.689751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7702cd-939b-4d3c-89ef-2286fdeca378 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:01.712284 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:01.725639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b96a6-21ad-41ff-b2b7-2285c5e1e1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:01.726440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b96a6-21ad-41ff-b2b7-2285c5e1e1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:01.726720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b96a6-21ad-41ff-b2b7-2285c5e1e1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:01.726995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b96a6-21ad-41ff-b2b7-2285c5e1e1c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:01.728069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c271e-6820-4ac9-bbf5-6a576d98c31d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:01.729100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:01.739125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b96a6-21ad-41ff-b2b7-2285c5e1e1c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:01.740578 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b96a6-21ad-41ff-b2b7-2285c5e1e1c9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e13b96a6-21ad-41ff-b2b7-2285c5e1e1c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:01.759211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:01.760324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:01.761272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:01.761272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:01.761272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:01.761272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:01.761272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 298/586] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:01.761272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b96a6-21ad-41ff-b2b7-2285c5e1e1c9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:01.768981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f98e0-4b17-4e76-90b3-6c6743ae54e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:01.769651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f98e0-4b17-4e76-90b3-6c6743ae54e5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:01.769932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f98e0-4b17-4e76-90b3-6c6743ae54e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:01.770205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f98e0-4b17-4e76-90b3-6c6743ae54e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:01.771001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f98e0-4b17-4e76-90b3-6c6743ae54e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:01.771306 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f98e0-4b17-4e76-90b3-6c6743ae54e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:01.772736 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f98e0-4b17-4e76-90b3-6c6743ae54e5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:01.786786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 289/587] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:01.788328 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f98e0-4b17-4e76-90b3-6c6743ae54e5 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:01.867738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b96a6-21ad-41ff-b2b7-2285c5e1e1c9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:01.903606 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f98e0-4b17-4e76-90b3-6c6743ae54e5 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:01.906622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e3f43-8677-47ab-b729-8d42ca8dc1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:01.907920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e3f43-8677-47ab-b729-8d42ca8dc1f2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:01.908351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e3f43-8677-47ab-b729-8d42ca8dc1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:01.908792 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3e3f43-8677-47ab-b729-8d42ca8dc1f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:01.920854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e3f43-8677-47ab-b729-8d42ca8dc1f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:01.922321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3e3f43-8677-47ab-b729-8d42ca8dc1f2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-4b3e3f43-8677-47ab-b729-8d42ca8dc1f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:01.941065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:01.941953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:01.947332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:01.947332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:01.947332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:01.947332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:01.947564 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac720b-cf42-462b-a41e-2fe0e08e1bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:01.947564 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac720b-cf42-462b-a41e-2fe0e08e1bcb None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:01.947737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 299/588] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:01.947811 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac720b-cf42-462b-a41e-2fe0e08e1bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:01.947811 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac720b-cf42-462b-a41e-2fe0e08e1bcb None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:01.948028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e3f43-8677-47ab-b729-8d42ca8dc1f2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:01.948100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac720b-cf42-462b-a41e-2fe0e08e1bcb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:01.948100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac720b-cf42-462b-a41e-2fe0e08e1bcb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:01.948100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac720b-cf42-462b-a41e-2fe0e08e1bcb None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:01.968010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 290/589] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jun 23 12:52:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:01.972740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac720b-cf42-462b-a41e-2fe0e08e1bcb None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:01.975183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:01.992706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:02.055117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3e3f43-8677-47ab-b729-8d42ca8dc1f2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:02.075633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac720b-cf42-462b-a41e-2fe0e08e1bcb None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:02.091565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c886f-a42f-4a12-b9a3-32d121712cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:02.092739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c886f-a42f-4a12-b9a3-32d121712cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:02.093068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c886f-a42f-4a12-b9a3-32d121712cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:02.093353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c886f-a42f-4a12-b9a3-32d121712cc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:02.094074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c886f-a42f-4a12-b9a3-32d121712cc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:02.094378 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c886f-a42f-4a12-b9a3-32d121712cc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:02.095747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c886f-a42f-4a12-b9a3-32d121712cc3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:02.108918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 300/590] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:02.108918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c886f-a42f-4a12-b9a3-32d121712cc3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:02.112982 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6498c97-21f5-49a5-9979-36f56d011272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:02.114001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6498c97-21f5-49a5-9979-36f56d011272 None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:02.114288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6498c97-21f5-49a5-9979-36f56d011272 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:02.114568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6498c97-21f5-49a5-9979-36f56d011272 None admin] PATH_INFO: `/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/703c2c40fe434402817a8824c2756ee7/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:02.132717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6498c97-21f5-49a5-9979-36f56d011272 None admin] RBAC: Authorizing `identity:create_grant(project_id=66de76d7ea7a45a6b698f8b1295c66c3, user_id=703c2c40fe434402817a8824c2756ee7, role_id=66cfaff0c6ec455aa7274a8b8d1f8aaf)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:02.134291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6498c97-21f5-49a5-9979-36f56d011272 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:02.206247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 291/591] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:01 2022] PUT /identity/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/703c2c40fe434402817a8824c2756ee7/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:02.207674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:02.211074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c886f-a42f-4a12-b9a3-32d121712cc3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:02.218539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6498c97-21f5-49a5-9979-36f56d011272 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:02.251366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08476df-0e0c-41c3-a12c-589ea33f840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:02.252200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08476df-0e0c-41c3-a12c-589ea33f840f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:02.252589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08476df-0e0c-41c3-a12c-589ea33f840f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:02.253152 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08476df-0e0c-41c3-a12c-589ea33f840f None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:02.253864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08476df-0e0c-41c3-a12c-589ea33f840f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:02.254274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08476df-0e0c-41c3-a12c-589ea33f840f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:02.256045 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08476df-0e0c-41c3-a12c-589ea33f840f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:02.271149 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 301/592] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:02.276377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08476df-0e0c-41c3-a12c-589ea33f840f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:02.305743 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:02.374273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6498c97-21f5-49a5-9979-36f56d011272 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:02.401355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08476df-0e0c-41c3-a12c-589ea33f840f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:02.415101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a8107-3a82-4239-ae14-6fdca971853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:02.416039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a8107-3a82-4239-ae14-6fdca971853d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:02.416478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a8107-3a82-4239-ae14-6fdca971853d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:02.416893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a8107-3a82-4239-ae14-6fdca971853d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:02.430942 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a8107-3a82-4239-ae14-6fdca971853d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:02.432571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a8107-3a82-4239-ae14-6fdca971853d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:02.448386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2467c4-8477-482b-bdd9-6e9e28896a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:02.449474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2467c4-8477-482b-bdd9-6e9e28896a08 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:02.449919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2467c4-8477-482b-bdd9-6e9e28896a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:02.450334 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2467c4-8477-482b-bdd9-6e9e28896a08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-7e1a8107-3a82-4239-ae14-6fdca971853d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:02.458235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:02.459277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:02.460347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:02.460347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:02.460347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:02.460347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:02.461543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2467c4-8477-482b-bdd9-6e9e28896a08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:02.461898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 292/593] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:02.462759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a8107-3a82-4239-ae14-6fdca971853d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:02.463601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2467c4-8477-482b-bdd9-6e9e28896a08 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-8d2467c4-8477-482b-bdd9-6e9e28896a08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:02.484640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:02.485781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:02.486816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:02.486816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:02.486816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:02.486816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:02.486816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:02.486816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:02.486816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:02.486816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:02.489347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 302/594] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:02.490332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2467c4-8477-482b-bdd9-6e9e28896a08 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:02.518386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:02.603233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a8107-3a82-4239-ae14-6fdca971853d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:02.608518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:02.633290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2467c4-8477-482b-bdd9-6e9e28896a08 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:02.648294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3240d31-88a5-4ab1-93d7-8ced9bb7028b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:02.649671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3240d31-88a5-4ab1-93d7-8ced9bb7028b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:02.650065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3240d31-88a5-4ab1-93d7-8ced9bb7028b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:02.650457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3240d31-88a5-4ab1-93d7-8ced9bb7028b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:02.661241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3240d31-88a5-4ab1-93d7-8ced9bb7028b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:02.663676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3240d31-88a5-4ab1-93d7-8ced9bb7028b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:02.678311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a87bb2-25e8-47ab-9e0a-b221564260ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:02.679190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a87bb2-25e8-47ab-9e0a-b221564260ae None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:02.679640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a87bb2-25e8-47ab-9e0a-b221564260ae None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:02.680057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a87bb2-25e8-47ab-9e0a-b221564260ae None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:02.680951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a87bb2-25e8-47ab-9e0a-b221564260ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:02.681395 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a87bb2-25e8-47ab-9e0a-b221564260ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-f3240d31-88a5-4ab1-93d7-8ced9bb7028b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:02.682119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:02.683177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:02.684308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:02.684308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:02.684308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:02.684308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:02.684308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:02.684308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:02.684308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:02.684308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:02.684308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 12:52:02.684308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:02.686385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a87bb2-25e8-47ab-9e0a-b221564260ae None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:02.691187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 293/595] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:52:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:02.691187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3240d31-88a5-4ab1-93d7-8ced9bb7028b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:02.706096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 303/596] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:02.707640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a87bb2-25e8-47ab-9e0a-b221564260ae None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:02.794432 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:02.817584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a87bb2-25e8-47ab-9e0a-b221564260ae None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:02.841199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3240d31-88a5-4ab1-93d7-8ced9bb7028b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:02.854805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c5564-4f46-4486-9ea7-d19bede588af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:02.855490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c5564-4f46-4486-9ea7-d19bede588af None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:02.855771 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c5564-4f46-4486-9ea7-d19bede588af None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:02.856045 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c5564-4f46-4486-9ea7-d19bede588af None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:02.856910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c5564-4f46-4486-9ea7-d19bede588af None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:02.857394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c5564-4f46-4486-9ea7-d19bede588af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:02.859313 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c5564-4f46-4486-9ea7-d19bede588af None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:02.893825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df0e43-0ab5-44af-a293-55a13e3c51f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:02.894145 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df0e43-0ab5-44af-a293-55a13e3c51f4 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:02.894345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 304/597] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Jun 23 12:52:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:02.894469 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df0e43-0ab5-44af-a293-55a13e3c51f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:02.894634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df0e43-0ab5-44af-a293-55a13e3c51f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:02.895477 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df0e43-0ab5-44af-a293-55a13e3c51f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:02.895789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df0e43-0ab5-44af-a293-55a13e3c51f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:02.896127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c5564-4f46-4486-9ea7-d19bede588af None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:02.897447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df0e43-0ab5-44af-a293-55a13e3c51f4 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:02.912639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 294/598] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:02.913604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df0e43-0ab5-44af-a293-55a13e3c51f4 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:02.958348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:03.012813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c5564-4f46-4486-9ea7-d19bede588af None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:03.046076 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df0e43-0ab5-44af-a293-55a13e3c51f4 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:03.050168 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c9b51-d209-4bdb-bd1e-b1d73f808418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:03.050997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c9b51-d209-4bdb-bd1e-b1d73f808418 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:03.051278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c9b51-d209-4bdb-bd1e-b1d73f808418 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:03.051553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c9b51-d209-4bdb-bd1e-b1d73f808418 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:03.054337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:03.059411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c9b51-d209-4bdb-bd1e-b1d73f808418 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:03.061730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c9b51-d209-4bdb-bd1e-b1d73f808418 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-215c9b51-d209-4bdb-bd1e-b1d73f808418 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:03.075885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:03.077420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:03.078442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:03.078442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:03.078442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:03.078442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:03.078442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:03.078442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:03.078442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:03.078442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:03.078871 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 305/599] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:03.079397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c9b51-d209-4bdb-bd1e-b1d73f808418 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:03.088527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904bd2b-5fee-4b6e-95c9-39da4308dd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:03.089991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904bd2b-5fee-4b6e-95c9-39da4308dd33 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:03.090473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904bd2b-5fee-4b6e-95c9-39da4308dd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:03.091125 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904bd2b-5fee-4b6e-95c9-39da4308dd33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:03.104073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904bd2b-5fee-4b6e-95c9-39da4308dd33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:03.105849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904bd2b-5fee-4b6e-95c9-39da4308dd33 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-2904bd2b-5fee-4b6e-95c9-39da4308dd33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:03.124994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:03.125915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:03.126804 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:03.126804 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:03.126804 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:03.126804 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:03.128910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 295/600] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:03.129907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904bd2b-5fee-4b6e-95c9-39da4308dd33 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:03.191897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c9b51-d209-4bdb-bd1e-b1d73f808418 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:03.215935 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:03.235919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8c359-bf27-434d-8da6-6afd7e1e8350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:03.237215 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c359-bf27-434d-8da6-6afd7e1e8350 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:03.237703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c359-bf27-434d-8da6-6afd7e1e8350 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:03.238146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c359-bf27-434d-8da6-6afd7e1e8350 None admin] PATH_INFO: `/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/fe6832291d504cff9e787c0d791c70ed/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:03.250891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904bd2b-5fee-4b6e-95c9-39da4308dd33 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:03.256059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8c359-bf27-434d-8da6-6afd7e1e8350 None admin] RBAC: Authorizing `identity:create_grant(project_id=66de76d7ea7a45a6b698f8b1295c66c3, user_id=fe6832291d504cff9e787c0d791c70ed, role_id=66cfaff0c6ec455aa7274a8b8d1f8aaf)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:03.257471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8c359-bf27-434d-8da6-6afd7e1e8350 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:03.292154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac435c3b-4655-485b-a6a7-cbf905393e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:03.293283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac435c3b-4655-485b-a6a7-cbf905393e3b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:03.293882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac435c3b-4655-485b-a6a7-cbf905393e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:03.294541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac435c3b-4655-485b-a6a7-cbf905393e3b None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:03.295966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac435c3b-4655-485b-a6a7-cbf905393e3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:03.296538 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac435c3b-4655-485b-a6a7-cbf905393e3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:03.298675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac435c3b-4655-485b-a6a7-cbf905393e3b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:03.312415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 296/601] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:03.313579 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac435c3b-4655-485b-a6a7-cbf905393e3b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:03.357101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 306/602] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:03 2022] PUT /identity/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/fe6832291d504cff9e787c0d791c70ed/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:03.358582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8c359-bf27-434d-8da6-6afd7e1e8350 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:03.448393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac435c3b-4655-485b-a6a7-cbf905393e3b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:03.461193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:03.489063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8c359-bf27-434d-8da6-6afd7e1e8350 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:03.498006 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbef50c-da97-4241-be5a-4435b2bd3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:03.500081 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbef50c-da97-4241-be5a-4435b2bd3db0 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:03.500371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbef50c-da97-4241-be5a-4435b2bd3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:03.500652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbef50c-da97-4241-be5a-4435b2bd3db0 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:03.501454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbef50c-da97-4241-be5a-4435b2bd3db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:03.502155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbef50c-da97-4241-be5a-4435b2bd3db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:03.503941 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbef50c-da97-4241-be5a-4435b2bd3db0 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:03.508334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:03.521867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 297/603] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:03.524410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848ff8f-c43c-4c9c-9ded-d06583a76a4a None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:03.526012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848ff8f-c43c-4c9c-9ded-d06583a76a4a None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:03.527306 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848ff8f-c43c-4c9c-9ded-d06583a76a4a None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:03.528896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 298/604] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:03.531645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848ff8f-c43c-4c9c-9ded-d06583a76a4a None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:03.541047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1fa5f-a19e-45aa-87e8-16524a9b18b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:03.541954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1fa5f-a19e-45aa-87e8-16524a9b18b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:03.542232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1fa5f-a19e-45aa-87e8-16524a9b18b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:03.542502 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1fa5f-a19e-45aa-87e8-16524a9b18b2 None admin] PATH_INFO: `/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/75e6ac80e76b41e4976f5a10daad85d8/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:03.609619 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1fa5f-a19e-45aa-87e8-16524a9b18b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=66de76d7ea7a45a6b698f8b1295c66c3, user_id=75e6ac80e76b41e4976f5a10daad85d8, role_id=66cfaff0c6ec455aa7274a8b8d1f8aaf)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:03.611267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1fa5f-a19e-45aa-87e8-16524a9b18b2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:03.698871 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848ff8f-c43c-4c9c-9ded-d06583a76a4a None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:03.723253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 307/605] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:03 2022] PUT /identity/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/75e6ac80e76b41e4976f5a10daad85d8/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:03.725505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5eaa1-fd5b-4cb4-8180-e22e9eff34cc None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:03.726077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5eaa1-fd5b-4cb4-8180-e22e9eff34cc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:03.726562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd5eaa1-fd5b-4cb4-8180-e22e9eff34cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:03.750218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2fd5eaa1-fd5b-4cb4-8180-e22e9eff34cc None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:03.751975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2fd5eaa1-fd5b-4cb4-8180-e22e9eff34cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:03.762935 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d9afb-259a-41d6-b56f-3796d4f0fb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:03.763771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d9afb-259a-41d6-b56f-3796d4f0fb0e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:03.764661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d9afb-259a-41d6-b56f-3796d4f0fb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:03.764966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d9afb-259a-41d6-b56f-3796d4f0fb0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:03.782100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d9afb-259a-41d6-b56f-3796d4f0fb0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:03.783592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d9afb-259a-41d6-b56f-3796d4f0fb0e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-956d9afb-259a-41d6-b56f-3796d4f0fb0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:03.809192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:03.810157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:03.811213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:03.811213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:03.811213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:03.811213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:03.811213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:03.811213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:03.811213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:03.811213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:03.817539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 299/606] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:03.822804 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d9afb-259a-41d6-b56f-3796d4f0fb0e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:03.843547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 308/607] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:03.891490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5eaa1-fd5b-4cb4-8180-e22e9eff34cc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:03.924056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:03.929171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:03.991735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d9afb-259a-41d6-b56f-3796d4f0fb0e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:04.035033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd5eaa1-fd5b-4cb4-8180-e22e9eff34cc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:04.050492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9a7da-c60b-4845-b88d-8ef7a1112cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:04.051604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9a7da-c60b-4845-b88d-8ef7a1112cbc None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:04.052110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9a7da-c60b-4845-b88d-8ef7a1112cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:04.052522 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9a7da-c60b-4845-b88d-8ef7a1112cbc None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:04.054106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9a7da-c60b-4845-b88d-8ef7a1112cbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:04.054700 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9a7da-c60b-4845-b88d-8ef7a1112cbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:04.057386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9a7da-c60b-4845-b88d-8ef7a1112cbc None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:04.079325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 300/608] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:04.085580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9a7da-c60b-4845-b88d-8ef7a1112cbc None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:04.095790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe41ea-79d0-45d3-a612-1579936b5388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:04.096649 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe41ea-79d0-45d3-a612-1579936b5388 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:04.096961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe41ea-79d0-45d3-a612-1579936b5388 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:04.097235 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe41ea-79d0-45d3-a612-1579936b5388 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:04.116980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe41ea-79d0-45d3-a612-1579936b5388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-79fe41ea-79d0-45d3-a612-1579936b5388 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:04.131048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:04.132109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:04.132953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:04.132953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:04.132953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:04.132953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:04.132953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:04.132953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:04.132953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:04.132953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:04.132953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:04.132953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:04.132953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:04.132953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:04.133782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 309/609] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:52:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:04.139920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe41ea-79d0-45d3-a612-1579936b5388 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:04.274221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe41ea-79d0-45d3-a612-1579936b5388 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:04.277125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:04.297276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9a7da-c60b-4845-b88d-8ef7a1112cbc None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:04.330616 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:04.338382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6a531-beab-4875-be33-5581ad9294dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:04.339069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6a531-beab-4875-be33-5581ad9294dd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:04.339353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6a531-beab-4875-be33-5581ad9294dd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:04.339630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6a531-beab-4875-be33-5581ad9294dd None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:04.340387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6a531-beab-4875-be33-5581ad9294dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:04.340696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6a531-beab-4875-be33-5581ad9294dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:04.342124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6a531-beab-4875-be33-5581ad9294dd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:04.360935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 310/610] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:52:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:04.364987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b704f-941a-4daa-859f-47174d99f726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:04.365893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b704f-941a-4daa-859f-47174d99f726 None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:04.366183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b704f-941a-4daa-859f-47174d99f726 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:04.366463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b704f-941a-4daa-859f-47174d99f726 None admin] PATH_INFO: `/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/83858713769b41af800bab317602bf2f/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:04.368104 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6a531-beab-4875-be33-5581ad9294dd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:04.401441 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b704f-941a-4daa-859f-47174d99f726 None admin] RBAC: Authorizing `identity:create_grant(project_id=66de76d7ea7a45a6b698f8b1295c66c3, user_id=83858713769b41af800bab317602bf2f, role_id=66cfaff0c6ec455aa7274a8b8d1f8aaf)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:04.404913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b704f-941a-4daa-859f-47174d99f726 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:04.493752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6a531-beab-4875-be33-5581ad9294dd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:04.500856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 301/611] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:04 2022] PUT /identity/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/83858713769b41af800bab317602bf2f/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:04.501259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8846cb1-c0e9-443f-b24b-efbdf1aadc8a None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:04.501568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8846cb1-c0e9-443f-b24b-efbdf1aadc8a None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:04.501832 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8846cb1-c0e9-443f-b24b-efbdf1aadc8a None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:04.508330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 302/612] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:04.516034 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e986659-11a5-488a-bd42-ed495cf0e32c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:04.516359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e986659-11a5-488a-bd42-ed495cf0e32c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:04.516641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e986659-11a5-488a-bd42-ed495cf0e32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:04.547243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78f280-c286-4bb2-acbd-3df8e4c2d5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:04.548095 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78f280-c286-4bb2-acbd-3df8e4c2d5cb None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:04.548428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78f280-c286-4bb2-acbd-3df8e4c2d5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:04.548745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78f280-c286-4bb2-acbd-3df8e4c2d5cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:04.553986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-1e986659-11a5-488a-bd42-ed495cf0e32c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:04.560247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1e986659-11a5-488a-bd42-ed495cf0e32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:04.562624 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78f280-c286-4bb2-acbd-3df8e4c2d5cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:04.564204 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78f280-c286-4bb2-acbd-3df8e4c2d5cb None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-cf78f280-c286-4bb2-acbd-3df8e4c2d5cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:04.583869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:04.584930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:04.585843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:04.585843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:04.585843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:04.585843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:04.585843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 311/613] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:04.586874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:04.591291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78f280-c286-4bb2-acbd-3df8e4c2d5cb None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:04.730480 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 303/614] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:04.771823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78f280-c286-4bb2-acbd-3df8e4c2d5cb None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:04.784075 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e986659-11a5-488a-bd42-ed495cf0e32c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:04.844327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a59ac-75e6-489d-8e78-b8ef07bdaec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:04.846775 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a59ac-75e6-489d-8e78-b8ef07bdaec2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:04.849117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a59ac-75e6-489d-8e78-b8ef07bdaec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:04.849509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a59ac-75e6-489d-8e78-b8ef07bdaec2 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:04.850377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a59ac-75e6-489d-8e78-b8ef07bdaec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:04.850788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a59ac-75e6-489d-8e78-b8ef07bdaec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:04.855612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a59ac-75e6-489d-8e78-b8ef07bdaec2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:04.883428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 312/615] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:04.884432 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a59ac-75e6-489d-8e78-b8ef07bdaec2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:04.983724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:04.995602 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e986659-11a5-488a-bd42-ed495cf0e32c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:05.014964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:05.071148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e2df9-8cde-42e0-bd26-92097f81f742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:05.071961 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e2df9-8cde-42e0-bd26-92097f81f742 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:05.072251 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e2df9-8cde-42e0-bd26-92097f81f742 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:05.072530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e2df9-8cde-42e0-bd26-92097f81f742 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:05.088744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a59ac-75e6-489d-8e78-b8ef07bdaec2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:05.101815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59e2df9-8cde-42e0-bd26-92097f81f742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-b59e2df9-8cde-42e0-bd26-92097f81f742 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:05.109717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:05.110668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:05.111500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:05.111500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:05.111500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:05.111500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:05.111500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:05.111500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:05.111500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:05.111500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:05.111500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:05.111500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:05.111500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:05.111500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:05.118532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 304/616] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:52:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:05.119376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e2df9-8cde-42e0-bd26-92097f81f742 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:05.149114 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da377360-3587-4cc8-9bf3-b0343d2b8e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:05.149924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da377360-3587-4cc8-9bf3-b0343d2b8e46 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:05.150216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da377360-3587-4cc8-9bf3-b0343d2b8e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:05.150497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da377360-3587-4cc8-9bf3-b0343d2b8e46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:05.167530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da377360-3587-4cc8-9bf3-b0343d2b8e46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:05.168963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da377360-3587-4cc8-9bf3-b0343d2b8e46 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-da377360-3587-4cc8-9bf3-b0343d2b8e46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:05.195419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:05.196450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:05.197418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:05.197418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:05.197418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:05.197418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:05.197418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:05.197418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:05.197418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:05.197418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:05.197418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:52:05.197418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:05.208695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 313/617] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:05.209660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da377360-3587-4cc8-9bf3-b0343d2b8e46 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:05.339683 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e2df9-8cde-42e0-bd26-92097f81f742 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:05.409236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da377360-3587-4cc8-9bf3-b0343d2b8e46 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:05.431895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:05.443370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65e8f5-074e-4a3d-8071-4e7d6ea4d279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:05.452653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65e8f5-074e-4a3d-8071-4e7d6ea4d279 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:05.452653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65e8f5-074e-4a3d-8071-4e7d6ea4d279 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:05.452653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65e8f5-074e-4a3d-8071-4e7d6ea4d279 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:05.452653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65e8f5-074e-4a3d-8071-4e7d6ea4d279 None admin] RBAC: Adding query filter params (name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:05.452653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65e8f5-074e-4a3d-8071-4e7d6ea4d279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:05.453056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6deac7-5bc3-4807-b4c3-2ce5f37fa153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:05.453056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6deac7-5bc3-4807-b4c3-2ce5f37fa153 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:05.453056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6deac7-5bc3-4807-b4c3-2ce5f37fa153 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:05.453274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b65e8f5-074e-4a3d-8071-4e7d6ea4d279 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:05.453350 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6deac7-5bc3-4807-b4c3-2ce5f37fa153 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:05.453350 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6deac7-5bc3-4807-b4c3-2ce5f37fa153 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:05.453350 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6deac7-5bc3-4807-b4c3-2ce5f37fa153 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:05.453350 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6deac7-5bc3-4807-b4c3-2ce5f37fa153 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:05.473903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 305/618] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:52:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:05.477678 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 314/619] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jun 23 12:52:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:05.478786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65e8f5-074e-4a3d-8071-4e7d6ea4d279 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:05.484923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6deac7-5bc3-4807-b4c3-2ce5f37fa153 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:05.517259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:05.687820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65e8f5-074e-4a3d-8071-4e7d6ea4d279 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:05.696263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6deac7-5bc3-4807-b4c3-2ce5f37fa153 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:05.763225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc388f6e-16f2-4384-a318-fe8b11674e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:05.765060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc388f6e-16f2-4384-a318-fe8b11674e12 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:05.766715 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc388f6e-16f2-4384-a318-fe8b11674e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:05.767480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76076857-635c-4910-9f2b-6f1508f440ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:05.767873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc388f6e-16f2-4384-a318-fe8b11674e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:05.769341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76076857-635c-4910-9f2b-6f1508f440ab None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:05.771256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76076857-635c-4910-9f2b-6f1508f440ab None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:05.771646 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76076857-635c-4910-9f2b-6f1508f440ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:05.791519 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc388f6e-16f2-4384-a318-fe8b11674e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:05.793036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc388f6e-16f2-4384-a318-fe8b11674e12 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:05.795526 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76076857-635c-4910-9f2b-6f1508f440ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:05.797011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76076857-635c-4910-9f2b-6f1508f440ab None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-cc388f6e-16f2-4384-a318-fe8b11674e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:05.824232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:05.825250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:05.826171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:05.826171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:05.826171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:05.826171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:05.838330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 306/620] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-76076857-635c-4910-9f2b-6f1508f440ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:05.838496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:05.839527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:05.841173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:05.841173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:05.841173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:05.841173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:05.841442 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc388f6e-16f2-4384-a318-fe8b11674e12 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:05.841539 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 315/621] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:05.844882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76076857-635c-4910-9f2b-6f1508f440ab None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:05.894676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:05.945098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:05.975249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76076857-635c-4910-9f2b-6f1508f440ab None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:05.984794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc388f6e-16f2-4384-a318-fe8b11674e12 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:06.017764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f2420-5626-4b30-a414-409dffe1aa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:06.018810 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f2420-5626-4b30-a414-409dffe1aa4a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.019444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f2420-5626-4b30-a414-409dffe1aa4a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.020025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f2420-5626-4b30-a414-409dffe1aa4a None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.020993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f2420-5626-4b30-a414-409dffe1aa4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:06.021512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f2420-5626-4b30-a414-409dffe1aa4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:06.023337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f2420-5626-4b30-a414-409dffe1aa4a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:06.028336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085c8bc-023d-4e98-be2d-4afcbd9f4fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:06.029030 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085c8bc-023d-4e98-be2d-4afcbd9f4fdb None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.029365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085c8bc-023d-4e98-be2d-4afcbd9f4fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.029995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085c8bc-023d-4e98-be2d-4afcbd9f4fdb None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.030372 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085c8bc-023d-4e98-be2d-4afcbd9f4fdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:06.030681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085c8bc-023d-4e98-be2d-4afcbd9f4fdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:06.032208 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085c8bc-023d-4e98-be2d-4afcbd9f4fdb None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:06.038347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 316/622] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:06.039915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a610-fad7-4269-abec-f4b00a8d0f72 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.040455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a610-fad7-4269-abec-f4b00a8d0f72 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.040965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a610-fad7-4269-abec-f4b00a8d0f72 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.047775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 307/624] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:06.047775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085c8bc-023d-4e98-be2d-4afcbd9f4fdb None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:06.048275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 317/624] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:06.053140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083a610-fad7-4269-abec-f4b00a8d0f72 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:06.173794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085c8bc-023d-4e98-be2d-4afcbd9f4fdb None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:06.174975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:06.189285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083a610-fad7-4269-abec-f4b00a8d0f72 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:06.211004 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:06.218554 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444424b-010c-49ee-96ca-a6d8a86d501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:06.219356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444424b-010c-49ee-96ca-a6d8a86d501c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.219779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444424b-010c-49ee-96ca-a6d8a86d501c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.220082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444424b-010c-49ee-96ca-a6d8a86d501c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.229779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444424b-010c-49ee-96ca-a6d8a86d501c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:06.231555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c444424b-010c-49ee-96ca-a6d8a86d501c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:06.233757 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b85461-4bc6-4a51-9cb8-87d41457d984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:06.234856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b85461-4bc6-4a51-9cb8-87d41457d984 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.235344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b85461-4bc6-4a51-9cb8-87d41457d984 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.235832 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b85461-4bc6-4a51-9cb8-87d41457d984 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.243956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b85461-4bc6-4a51-9cb8-87d41457d984 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:06.245712 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b85461-4bc6-4a51-9cb8-87d41457d984 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-c444424b-010c-49ee-96ca-a6d8a86d501c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:06.248924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:06.249830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:06.250733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:06.250733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:06.250733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:06.250733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:06.250733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:06.250733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:06.250733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:06.250733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:06.250733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 308/625] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:06.251699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef11be-c1a8-4926-9da3-7ea4d33bf7f5 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.251984 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef11be-c1a8-4926-9da3-7ea4d33bf7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.252265 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef11be-c1a8-4926-9da3-7ea4d33bf7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-d6b85461-4bc6-4a51-9cb8-87d41457d984 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:06.267439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:06.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:06.269400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:06.269400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:06.269400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:06.269400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:06.269400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:06.269400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:06.269400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:06.269400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:06.269400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:52:06.269400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:06.271870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-05ef11be-c1a8-4926-9da3-7ea4d33bf7f5 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:06.273197 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-05ef11be-c1a8-4926-9da3-7ea4d33bf7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:06.277957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 318/626] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 23 12:52:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:06.279067 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b85461-4bc6-4a51-9cb8-87d41457d984 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:06.351717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 309/627] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:06.352576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef11be-c1a8-4926-9da3-7ea4d33bf7f5 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:06.399151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b85461-4bc6-4a51-9cb8-87d41457d984 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:06.435245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3cb2b-eb5c-473f-9075-0341a7949e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:06.437488 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3cb2b-eb5c-473f-9075-0341a7949e0d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.437777 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3cb2b-eb5c-473f-9075-0341a7949e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.438055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3cb2b-eb5c-473f-9075-0341a7949e0d None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.439312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3cb2b-eb5c-473f-9075-0341a7949e0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:06.439767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3cb2b-eb5c-473f-9075-0341a7949e0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:06.441382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3cb2b-eb5c-473f-9075-0341a7949e0d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:06.459155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 319/628] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:06.460525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86102712-7689-4214-b185-ceace317d416 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.460841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86102712-7689-4214-b185-ceace317d416 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.461181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86102712-7689-4214-b185-ceace317d416 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.461733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef11be-c1a8-4926-9da3-7ea4d33bf7f5 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:06.464876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 320/629] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:06.464876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86102712-7689-4214-b185-ceace317d416 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:06.481480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:06.485132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:06.499165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b362f-df36-4b5f-ae5c-fe46e6d21b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:06.499843 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b362f-df36-4b5f-ae5c-fe46e6d21b93 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.501681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b362f-df36-4b5f-ae5c-fe46e6d21b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.501681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b362f-df36-4b5f-ae5c-fe46e6d21b93 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.501681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b362f-df36-4b5f-ae5c-fe46e6d21b93 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:06.501681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b362f-df36-4b5f-ae5c-fe46e6d21b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:06.503103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b362f-df36-4b5f-ae5c-fe46e6d21b93 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:06.525970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 310/630] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 23 12:52:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:06.525970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b362f-df36-4b5f-ae5c-fe46e6d21b93 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:06.583691 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86102712-7689-4214-b185-ceace317d416 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:06.621222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c376238-61da-4024-9540-4ab5eceee598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:06.622042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c376238-61da-4024-9540-4ab5eceee598 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.622326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c376238-61da-4024-9540-4ab5eceee598 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.622598 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c376238-61da-4024-9540-4ab5eceee598 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.630078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b362f-df36-4b5f-ae5c-fe46e6d21b93 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:06.633968 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c376238-61da-4024-9540-4ab5eceee598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-5c376238-61da-4024-9540-4ab5eceee598 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:06.642088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:06.643040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:06.643872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 321/631] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:06.644570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c1136-ca9f-47ae-a4f0-68918362a998 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.645291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c1136-ca9f-47ae-a4f0-68918362a998 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.645291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c1136-ca9f-47ae-a4f0-68918362a998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.663551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-290c1136-ca9f-47ae-a4f0-68918362a998 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:06.664745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-290c1136-ca9f-47ae-a4f0-68918362a998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:06.673276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed96bb-83e9-432d-bd12-2d8a04cc40f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:06.673803 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed96bb-83e9-432d-bd12-2d8a04cc40f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.674080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed96bb-83e9-432d-bd12-2d8a04cc40f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.674351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed96bb-83e9-432d-bd12-2d8a04cc40f4 None admin] PATH_INFO: `/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/599a53720ecd4e729a6720a85b653eb0/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.690091 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed96bb-83e9-432d-bd12-2d8a04cc40f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=66de76d7ea7a45a6b698f8b1295c66c3, user_id=599a53720ecd4e729a6720a85b653eb0, role_id=66cfaff0c6ec455aa7274a8b8d1f8aaf)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:06.691546 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed96bb-83e9-432d-bd12-2d8a04cc40f4 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:06.733182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:06.737658 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 322/632] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:06.746711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c1136-ca9f-47ae-a4f0-68918362a998 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:06.763022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 311/633] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:06 2022] PUT /identity/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/599a53720ecd4e729a6720a85b653eb0/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:06.780130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed96bb-83e9-432d-bd12-2d8a04cc40f4 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:06.809372 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:06.865236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c1136-ca9f-47ae-a4f0-68918362a998 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:06.899523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed96bb-83e9-432d-bd12-2d8a04cc40f4 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:06.908827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24fbae1-2717-4f9d-97eb-c3100fdb420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:06.910412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fbae1-2717-4f9d-97eb-c3100fdb420f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.910699 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fbae1-2717-4f9d-97eb-c3100fdb420f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.910978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24fbae1-2717-4f9d-97eb-c3100fdb420f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.943697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c06fb-e596-417f-a281-f9bff41b0853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:06.944460 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c06fb-e596-417f-a281-f9bff41b0853 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:06.944829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c06fb-e596-417f-a281-f9bff41b0853 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:06.945274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c06fb-e596-417f-a281-f9bff41b0853 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:06.946031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c06fb-e596-417f-a281-f9bff41b0853 None admin] RBAC: Adding query filter params (name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:06.946338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c06fb-e596-417f-a281-f9bff41b0853 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:06.947724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c06fb-e596-417f-a281-f9bff41b0853 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:06.957604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 312/634] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:52:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:06.958255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c06fb-e596-417f-a281-f9bff41b0853 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:06.988634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:06.990915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fbae1-2717-4f9d-97eb-c3100fdb420f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:06.992390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24fbae1-2717-4f9d-97eb-c3100fdb420f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:07.057681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:07.068358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c06fb-e596-417f-a281-f9bff41b0853 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:07.105083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f1fd5-f41c-489b-9ff5-eb9917740c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:07.105876 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f1fd5-f41c-489b-9ff5-eb9917740c50 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:07.106155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f1fd5-f41c-489b-9ff5-eb9917740c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:07.106430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f1fd5-f41c-489b-9ff5-eb9917740c50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:07.109633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 323/635] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:07.115192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861d3f3-d8d0-4ace-8a9c-132e4bdcbd44 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:07.115487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861d3f3-d8d0-4ace-8a9c-132e4bdcbd44 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:07.115766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6861d3f3-d8d0-4ace-8a9c-132e4bdcbd44 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:07.117083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 324/636] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:07.117777 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861d3f3-d8d0-4ace-8a9c-132e4bdcbd44 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:07.121823 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f1fd5-f41c-489b-9ff5-eb9917740c50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-b32f1fd5-f41c-489b-9ff5-eb9917740c50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:07.131362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:07.132338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:07.133196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:07.133196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:07.133196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:07.133196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:07.133196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:07.133196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:07.133196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:07.133196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:07.133196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:07.133196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:07.133196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:07.133196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:07.134168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 313/637] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:52:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:07.134915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f1fd5-f41c-489b-9ff5-eb9917740c50 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:07.225678 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:07.229509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6861d3f3-d8d0-4ace-8a9c-132e4bdcbd44 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:07.249153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f1fd5-f41c-489b-9ff5-eb9917740c50 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:07.271283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468b467-9ed7-46a0-ba7d-e646a3a9137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:07.273013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468b467-9ed7-46a0-ba7d-e646a3a9137e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:07.273305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468b467-9ed7-46a0-ba7d-e646a3a9137e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:07.273577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468b467-9ed7-46a0-ba7d-e646a3a9137e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:07.285427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468b467-9ed7-46a0-ba7d-e646a3a9137e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:07.286877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468b467-9ed7-46a0-ba7d-e646a3a9137e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:07.287225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40f07f-c941-4695-9bac-85e4cbcfbaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:07.288027 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40f07f-c941-4695-9bac-85e4cbcfbaaf None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:07.288314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40f07f-c941-4695-9bac-85e4cbcfbaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:07.288595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40f07f-c941-4695-9bac-85e4cbcfbaaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:07.300845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40f07f-c941-4695-9bac-85e4cbcfbaaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:07.302316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac40f07f-c941-4695-9bac-85e4cbcfbaaf None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-5468b467-9ed7-46a0-ba7d-e646a3a9137e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:07.305607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:07.306497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:07.312236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:07.312236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:07.312236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:07.312236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:07.312236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 325/638] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:07.312236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d74120-79c3-4a1c-ae16-c35a30be3d19 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:07.312236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d74120-79c3-4a1c-ae16-c35a30be3d19 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:07.312236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d74120-79c3-4a1c-ae16-c35a30be3d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:07.325329 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-85d74120-79c3-4a1c-ae16-c35a30be3d19 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-ac40f07f-c941-4695-9bac-85e4cbcfbaaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:07.325491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:07.326388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:07.332246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:07.332246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:07.332246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:07.332246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:07.332246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 314/639] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:07.332598 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-85d74120-79c3-4a1c-ae16-c35a30be3d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:07.332693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40f07f-c941-4695-9bac-85e4cbcfbaaf None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:07.332693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:07.402031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 326/640] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:07.402966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d74120-79c3-4a1c-ae16-c35a30be3d19 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:07.449524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac40f07f-c941-4695-9bac-85e4cbcfbaaf None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:07.486985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40869e-c245-4c2c-9e88-1a801f625964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:07.487658 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40869e-c245-4c2c-9e88-1a801f625964 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:07.488069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40869e-c245-4c2c-9e88-1a801f625964 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:07.488350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c40869e-c245-4c2c-9e88-1a801f625964 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:07.489147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40869e-c245-4c2c-9e88-1a801f625964 None admin] RBAC: Adding query filter params (name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:07.489456 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40869e-c245-4c2c-9e88-1a801f625964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:07.490925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c40869e-c245-4c2c-9e88-1a801f625964 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:07.497808 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:07.514573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 315/641] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:07.514573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40869e-c245-4c2c-9e88-1a801f625964 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:07.526146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d74120-79c3-4a1c-ae16-c35a30be3d19 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:07.566527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe7ec5-adec-4bc1-a10e-8e3c5d5cf6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:07.567185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7ec5-adec-4bc1-a10e-8e3c5d5cf6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:07.567463 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7ec5-adec-4bc1-a10e-8e3c5d5cf6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:07.567915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe7ec5-adec-4bc1-a10e-8e3c5d5cf6d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:07.568411 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:07.568521 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe7ec5-adec-4bc1-a10e-8e3c5d5cf6d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:07.568876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe7ec5-adec-4bc1-a10e-8e3c5d5cf6d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:07.570231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe7ec5-adec-4bc1-a10e-8e3c5d5cf6d2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:07.582788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 327/642] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:07.583609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe7ec5-adec-4bc1-a10e-8e3c5d5cf6d2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:07.612429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c40869e-c245-4c2c-9e88-1a801f625964 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:07.647079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b95b09-26d3-45bf-8e4c-01cf82b93853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:07.647734 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b95b09-26d3-45bf-8e4c-01cf82b93853 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:07.648012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b95b09-26d3-45bf-8e4c-01cf82b93853 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:07.648290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b95b09-26d3-45bf-8e4c-01cf82b93853 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:07.649037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b95b09-26d3-45bf-8e4c-01cf82b93853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:07.649343 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b95b09-26d3-45bf-8e4c-01cf82b93853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:07.650718 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b95b09-26d3-45bf-8e4c-01cf82b93853 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:07.664181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 316/643] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:07.664999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b95b09-26d3-45bf-8e4c-01cf82b93853 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:07.690941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe7ec5-adec-4bc1-a10e-8e3c5d5cf6d2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:07.726999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539bf64-8bf5-4d16-aec3-a0828ff302fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:07.728142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539bf64-8bf5-4d16-aec3-a0828ff302fd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:07.728590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539bf64-8bf5-4d16-aec3-a0828ff302fd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:07.729044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539bf64-8bf5-4d16-aec3-a0828ff302fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:07.739853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539bf64-8bf5-4d16-aec3-a0828ff302fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6539bf64-8bf5-4d16-aec3-a0828ff302fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:07.747758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:07.748986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:07.750046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:07.750046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:07.750046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:07.750046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:07.750046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:07.750046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:07.750046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:07.750046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:07.750046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:07.750046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:07.750046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:07.750046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:07.756663 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 328/644] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:52:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:07.757510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539bf64-8bf5-4d16-aec3-a0828ff302fd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:07.761591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:07.773608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b95b09-26d3-45bf-8e4c-01cf82b93853 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:07.795766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:07.806928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58862621-80e1-40c8-9162-bf949095b58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:07.808592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58862621-80e1-40c8-9162-bf949095b58a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:07.808592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58862621-80e1-40c8-9162-bf949095b58a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:07.808592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58862621-80e1-40c8-9162-bf949095b58a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:07.820687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58862621-80e1-40c8-9162-bf949095b58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:07.822174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58862621-80e1-40c8-9162-bf949095b58a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-58862621-80e1-40c8-9162-bf949095b58a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:07.842608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:07.843530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:07.844574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:07.844574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:07.844574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:07.844574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:07.851404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 317/645] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:07.851404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58862621-80e1-40c8-9162-bf949095b58a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:07.866085 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539bf64-8bf5-4d16-aec3-a0828ff302fd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:07.907846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b028d3-8019-4d9c-87f9-53cd7f9f82df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:07.908932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b028d3-8019-4d9c-87f9-53cd7f9f82df None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:07.909399 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b028d3-8019-4d9c-87f9-53cd7f9f82df None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:07.909900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b028d3-8019-4d9c-87f9-53cd7f9f82df None admin] PATH_INFO: `/v3/users/glance` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:07.918402 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b028d3-8019-4d9c-87f9-53cd7f9f82df None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:07.920381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b028d3-8019-4d9c-87f9-53cd7f9f82df None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-f8b028d3-8019-4d9c-87f9-53cd7f9f82df None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:07.935897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:07.937249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:07.938184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:07.938184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:07.938184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:07.938184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:07.938184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:07.938184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:07.938184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:07.938184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:07.938184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 12:52:07.938184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:07.938184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 329/646] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:07.938767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b028d3-8019-4d9c-87f9-53cd7f9f82df None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:07.963893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58862621-80e1-40c8-9162-bf949095b58a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:08.002850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:08.005425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd06ea-fa13-4f1a-bcc8-d84cee39f43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:08.006460 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd06ea-fa13-4f1a-bcc8-d84cee39f43d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:08.006806 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd06ea-fa13-4f1a-bcc8-d84cee39f43d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:08.006993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd06ea-fa13-4f1a-bcc8-d84cee39f43d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:08.014450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd06ea-fa13-4f1a-bcc8-d84cee39f43d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:08.015896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd06ea-fa13-4f1a-bcc8-d84cee39f43d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-39bd06ea-fa13-4f1a-bcc8-d84cee39f43d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:08.030907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:08.031959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:08.033323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:08.033323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:08.033323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:08.033323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:08.033323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:08.033323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:08.033323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:08.033323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:08.033323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 318/647] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:08.033323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd06ea-fa13-4f1a-bcc8-d84cee39f43d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:08.050152 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b028d3-8019-4d9c-87f9-53cd7f9f82df None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:08.070794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:08.084326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fddb0b-0722-4a05-91d6-0c595d1cb323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:08.085027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fddb0b-0722-4a05-91d6-0c595d1cb323 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:08.085316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fddb0b-0722-4a05-91d6-0c595d1cb323 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:08.085593 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fddb0b-0722-4a05-91d6-0c595d1cb323 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:08.086343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fddb0b-0722-4a05-91d6-0c595d1cb323 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:08.086650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fddb0b-0722-4a05-91d6-0c595d1cb323 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:08.088009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fddb0b-0722-4a05-91d6-0c595d1cb323 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:08.096776 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 330/648] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:08.097586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fddb0b-0722-4a05-91d6-0c595d1cb323 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:08.143487 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd06ea-fa13-4f1a-bcc8-d84cee39f43d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:08.180998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd051aa-f0c2-4a15-8fe5-e46622ac8567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:08.181751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd051aa-f0c2-4a15-8fe5-e46622ac8567 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:08.182039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd051aa-f0c2-4a15-8fe5-e46622ac8567 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:08.182319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd051aa-f0c2-4a15-8fe5-e46622ac8567 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:08.183047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd051aa-f0c2-4a15-8fe5-e46622ac8567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:08.183355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd051aa-f0c2-4a15-8fe5-e46622ac8567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:08.184996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd051aa-f0c2-4a15-8fe5-e46622ac8567 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:08.201283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 319/649] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:08.201283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd051aa-f0c2-4a15-8fe5-e46622ac8567 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:08.201684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fddb0b-0722-4a05-91d6-0c595d1cb323 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:08.224143 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:08.235986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d89c0-d462-417c-b164-d74bbc7a6df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:08.236957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d89c0-d462-417c-b164-d74bbc7a6df4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:08.237053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d89c0-d462-417c-b164-d74bbc7a6df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:08.237294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d89c0-d462-417c-b164-d74bbc7a6df4 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:08.238141 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d89c0-d462-417c-b164-d74bbc7a6df4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:08.238457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d89c0-d462-417c-b164-d74bbc7a6df4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:08.239896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d89c0-d462-417c-b164-d74bbc7a6df4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:08.257678 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 331/650] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jun 23 12:52:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:08.258324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d89c0-d462-417c-b164-d74bbc7a6df4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:08.317106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:08.324168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd051aa-f0c2-4a15-8fe5-e46622ac8567 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:08.362297 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80aa669-ba98-4214-b8d7-cd23fc581ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:08.362972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80aa669-ba98-4214-b8d7-cd23fc581ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:08.363442 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80aa669-ba98-4214-b8d7-cd23fc581ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:08.363730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80aa669-ba98-4214-b8d7-cd23fc581ec5 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:08.364940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80aa669-ba98-4214-b8d7-cd23fc581ec5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:08.365251 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80aa669-ba98-4214-b8d7-cd23fc581ec5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:08.366774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80aa669-ba98-4214-b8d7-cd23fc581ec5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:08.370611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d89c0-d462-417c-b164-d74bbc7a6df4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:08.379535 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 320/651] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:08.380245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80aa669-ba98-4214-b8d7-cd23fc581ec5 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:08.412337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7bf9c-1c3a-4904-8dff-ac852c7f1d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:08.413160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7bf9c-1c3a-4904-8dff-ac852c7f1d0f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:08.413445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7bf9c-1c3a-4904-8dff-ac852c7f1d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:08.413724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7bf9c-1c3a-4904-8dff-ac852c7f1d0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:08.424769 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7bf9c-1c3a-4904-8dff-ac852c7f1d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:08.426618 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f7bf9c-1c3a-4904-8dff-ac852c7f1d0f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-19f7bf9c-1c3a-4904-8dff-ac852c7f1d0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:08.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:08.446354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:08.447222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:08.447222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:08.447222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:08.447222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:08.447222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 332/652] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:08.447499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7bf9c-1c3a-4904-8dff-ac852c7f1d0f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:08.490241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80aa669-ba98-4214-b8d7-cd23fc581ec5 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:08.490922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:08.528539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964e7cd-277f-4f3f-a97c-b0a98292635a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:08.530271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964e7cd-277f-4f3f-a97c-b0a98292635a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:08.530729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964e7cd-277f-4f3f-a97c-b0a98292635a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:08.531157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964e7cd-277f-4f3f-a97c-b0a98292635a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:08.539183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964e7cd-277f-4f3f-a97c-b0a98292635a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:08.540617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964e7cd-277f-4f3f-a97c-b0a98292635a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-2964e7cd-277f-4f3f-a97c-b0a98292635a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:08.555636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:08.556933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:08.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:08.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:08.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:08.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:08.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:08.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:08.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:08.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:08.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:52:08.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:08.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 321/653] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:08.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964e7cd-277f-4f3f-a97c-b0a98292635a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:08.568790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7bf9c-1c3a-4904-8dff-ac852c7f1d0f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:08.580035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:08.608516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61190160-2f47-46eb-9366-b8f1dcf2d58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:08.609147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190160-2f47-46eb-9366-b8f1dcf2d58f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:08.609603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190160-2f47-46eb-9366-b8f1dcf2d58f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:08.609890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61190160-2f47-46eb-9366-b8f1dcf2d58f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:08.681355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61190160-2f47-46eb-9366-b8f1dcf2d58f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:08.682826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61190160-2f47-46eb-9366-b8f1dcf2d58f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:08.697492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964e7cd-277f-4f3f-a97c-b0a98292635a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:08.718553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:08.733444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f096cc-0ded-4fc7-baf1-fd4db71d7c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:08.734110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f096cc-0ded-4fc7-baf1-fd4db71d7c9e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:08.734396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f096cc-0ded-4fc7-baf1-fd4db71d7c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:08.734679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f096cc-0ded-4fc7-baf1-fd4db71d7c9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:08.735573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f096cc-0ded-4fc7-baf1-fd4db71d7c9e None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=703c2c40fe434402817a8824c2756ee7) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:08.735889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f096cc-0ded-4fc7-baf1-fd4db71d7c9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:08.737475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f096cc-0ded-4fc7-baf1-fd4db71d7c9e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:08.753166 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 322/654] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:08 2022] GET /identity/v3/role_assignments?user.id=703c2c40fe434402817a8824c2756ee7&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:08.753166 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f096cc-0ded-4fc7-baf1-fd4db71d7c9e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:08.823201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 333/655] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:08.824026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61190160-2f47-46eb-9366-b8f1dcf2d58f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:08.855908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:08.882355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f096cc-0ded-4fc7-baf1-fd4db71d7c9e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:08.928535 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4c21e-1b67-4458-ae76-8718f18d6de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:08.929250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4c21e-1b67-4458-ae76-8718f18d6de5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:08.929530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4c21e-1b67-4458-ae76-8718f18d6de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:08.929805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4c21e-1b67-4458-ae76-8718f18d6de5 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:08.930665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4c21e-1b67-4458-ae76-8718f18d6de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:08.930970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4c21e-1b67-4458-ae76-8718f18d6de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:08.932345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4c21e-1b67-4458-ae76-8718f18d6de5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:08.943695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61190160-2f47-46eb-9366-b8f1dcf2d58f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:08.945581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 323/656] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:08.947717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b275f-091f-4cf7-8206-7bd789868b80 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:08.948009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b275f-091f-4cf7-8206-7bd789868b80 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:08.948286 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b275f-091f-4cf7-8206-7bd789868b80 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:08.952948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 324/657] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:08.953753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b275f-091f-4cf7-8206-7bd789868b80 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:08.988858 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b705c-7b0a-4223-a19a-85a6f11a048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:08.989947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b705c-7b0a-4223-a19a-85a6f11a048d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:08.990430 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b705c-7b0a-4223-a19a-85a6f11a048d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:08.990893 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b705c-7b0a-4223-a19a-85a6f11a048d None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:08.991933 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b705c-7b0a-4223-a19a-85a6f11a048d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:08.992422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b705c-7b0a-4223-a19a-85a6f11a048d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:08.994165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1b705c-7b0a-4223-a19a-85a6f11a048d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:08.996889 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:09.016844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 334/658] 10.222.0.16 () {56 vars in 1137 bytes} [Thu Jun 23 12:52:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:09.017907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b705c-7b0a-4223-a19a-85a6f11a048d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:09.088628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b275f-091f-4cf7-8206-7bd789868b80 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:09.121879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1b705c-7b0a-4223-a19a-85a6f11a048d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:09.130010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d36b2-8929-4a4f-a13d-6932a2fc6ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:09.130728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d36b2-8929-4a4f-a13d-6932a2fc6ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:09.131015 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d36b2-8929-4a4f-a13d-6932a2fc6ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:09.131288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d36b2-8929-4a4f-a13d-6932a2fc6ee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:09.142166 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:09.144588 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d36b2-8929-4a4f-a13d-6932a2fc6ee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:09.146084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d36b2-8929-4a4f-a13d-6932a2fc6ee2 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:09.159685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50887c8c-2686-4a79-9c53-b41a5d40d953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:09.160490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50887c8c-2686-4a79-9c53-b41a5d40d953 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:09.160776 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50887c8c-2686-4a79-9c53-b41a5d40d953 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:09.161084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50887c8c-2686-4a79-9c53-b41a5d40d953 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-4d9d36b2-8929-4a4f-a13d-6932a2fc6ee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:09.165601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:09.166454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:09.167350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:09.167350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:09.167350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:09.167350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:09.168953 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 325/659] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:09.170266 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d91b9-446c-4524-9889-9ab9a36851a8 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:09.170553 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d91b9-446c-4524-9889-9ab9a36851a8 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:09.170831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d91b9-446c-4524-9889-9ab9a36851a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:09.172612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50887c8c-2686-4a79-9c53-b41a5d40d953 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:09.174252 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50887c8c-2686-4a79-9c53-b41a5d40d953 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:09.187890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-c15d91b9-446c-4524-9889-9ab9a36851a8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:09.189122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c15d91b9-446c-4524-9889-9ab9a36851a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-50887c8c-2686-4a79-9c53-b41a5d40d953 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:09.191304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:09.192393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:09.193387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:09.193387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:09.193387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:09.193387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:09.193387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:09.193387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:09.193387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:09.193387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:09.193387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 12:52:09.193387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:09.193387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 335/660] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:52:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:09.193986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50887c8c-2686-4a79-9c53-b41a5d40d953 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:09.251638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:09.265608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 326/661] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:09.272666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d91b9-446c-4524-9889-9ab9a36851a8 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:09.308326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50887c8c-2686-4a79-9c53-b41a5d40d953 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:09.344614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b4c5d-c8f9-48e6-a9e4-d1000eba25ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:09.345231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b4c5d-c8f9-48e6-a9e4-d1000eba25ab None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:09.345518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b4c5d-c8f9-48e6-a9e4-d1000eba25ab None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:09.345797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b4c5d-c8f9-48e6-a9e4-d1000eba25ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:09.393014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d91b9-446c-4524-9889-9ab9a36851a8 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:09.416731 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b4c5d-c8f9-48e6-a9e4-d1000eba25ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:09.418335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b4c5d-c8f9-48e6-a9e4-d1000eba25ab None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:09.418477 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:09.434741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc93ed-d4c1-4224-99a1-0a0ee36381e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:09.436326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc93ed-d4c1-4224-99a1-0a0ee36381e7 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:09.436791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc93ed-d4c1-4224-99a1-0a0ee36381e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:09.437281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc93ed-d4c1-4224-99a1-0a0ee36381e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:09.438202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc93ed-d4c1-4224-99a1-0a0ee36381e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:09.438698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc93ed-d4c1-4224-99a1-0a0ee36381e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:09.440297 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc93ed-d4c1-4224-99a1-0a0ee36381e7 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:09.452236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 327/662] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:09.453409 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc93ed-d4c1-4224-99a1-0a0ee36381e7 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:09.476097 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:09.532853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 336/663] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:09.532853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b4c5d-c8f9-48e6-a9e4-d1000eba25ab None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:09.564686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc93ed-d4c1-4224-99a1-0a0ee36381e7 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:09.600853 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125d46d-2f1e-4486-a2c3-02a4b2528be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:09.601458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125d46d-2f1e-4486-a2c3-02a4b2528be3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:09.601746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125d46d-2f1e-4486-a2c3-02a4b2528be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:09.602030 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125d46d-2f1e-4486-a2c3-02a4b2528be3 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:09.602879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125d46d-2f1e-4486-a2c3-02a4b2528be3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:09.603196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125d46d-2f1e-4486-a2c3-02a4b2528be3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:09.604644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125d46d-2f1e-4486-a2c3-02a4b2528be3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:09.622410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 328/664] 10.222.0.16 () {56 vars in 1139 bytes} [Thu Jun 23 12:52:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:09.623353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125d46d-2f1e-4486-a2c3-02a4b2528be3 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:09.639779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b4c5d-c8f9-48e6-a9e4-d1000eba25ab None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:09.667583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:09.675748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0a127-22aa-4ebb-be49-d303ad0d3a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:09.676551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0a127-22aa-4ebb-be49-d303ad0d3a34 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:09.676855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0a127-22aa-4ebb-be49-d303ad0d3a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:09.677138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0a127-22aa-4ebb-be49-d303ad0d3a34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:09.687088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0a127-22aa-4ebb-be49-d303ad0d3a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-52a0a127-22aa-4ebb-be49-d303ad0d3a34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:09.694839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:09.695834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:09.696693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 337/665] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:52:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:09.697420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0a127-22aa-4ebb-be49-d303ad0d3a34 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:09.712750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:09.732649 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125d46d-2f1e-4486-a2c3-02a4b2528be3 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:09.769188 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fc81c-0f56-4651-bff4-e7829583cfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:09.770057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fc81c-0f56-4651-bff4-e7829583cfe5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:09.770352 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fc81c-0f56-4651-bff4-e7829583cfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:09.770622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4fc81c-0f56-4651-bff4-e7829583cfe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:09.782326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fc81c-0f56-4651-bff4-e7829583cfe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:09.783792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4fc81c-0f56-4651-bff4-e7829583cfe5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-0b4fc81c-0f56-4651-bff4-e7829583cfe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:09.798972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:09.799878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:09.805746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:09.805746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:09.805746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:09.805746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:09.805746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:09.805746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:09.805746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:09.805746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:09.805746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 329/666] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:09.806228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0a127-22aa-4ebb-be49-d303ad0d3a34 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:09.806302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fc81c-0f56-4651-bff4-e7829583cfe5 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:09.843852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb55a75-74a1-4943-a733-21fd14fe4809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:09.844653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb55a75-74a1-4943-a733-21fd14fe4809 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:09.844972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb55a75-74a1-4943-a733-21fd14fe4809 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:09.845253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb55a75-74a1-4943-a733-21fd14fe4809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:09.855309 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb55a75-74a1-4943-a733-21fd14fe4809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:09.856696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb55a75-74a1-4943-a733-21fd14fe4809 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6bb55a75-74a1-4943-a733-21fd14fe4809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:09.880477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:09.881515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:09.887159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:09.887159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:09.887159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:09.887159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:09.887159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 338/667] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:09.887159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb55a75-74a1-4943-a733-21fd14fe4809 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:09.912702 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:09.915840 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4fc81c-0f56-4651-bff4-e7829583cfe5 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:09.955190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357ba74-c6f3-41cb-bfd0-24fc747f81be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:09.955864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357ba74-c6f3-41cb-bfd0-24fc747f81be None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:09.956149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357ba74-c6f3-41cb-bfd0-24fc747f81be None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:09.956431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357ba74-c6f3-41cb-bfd0-24fc747f81be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:09.957738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:09.998768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb55a75-74a1-4943-a733-21fd14fe4809 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:10.036393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f283e63-568a-4d0c-b3ed-160ec5939fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:10.037090 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283e63-568a-4d0c-b3ed-160ec5939fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:10.037373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283e63-568a-4d0c-b3ed-160ec5939fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:10.037650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f283e63-568a-4d0c-b3ed-160ec5939fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:10.038394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f283e63-568a-4d0c-b3ed-160ec5939fe7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:10.038699 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f283e63-568a-4d0c-b3ed-160ec5939fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:10.039588 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357ba74-c6f3-41cb-bfd0-24fc747f81be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:10.040060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f283e63-568a-4d0c-b3ed-160ec5939fe7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:10.041471 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357ba74-c6f3-41cb-bfd0-24fc747f81be None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:10.048539 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 339/668] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:52:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:10.048539 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f283e63-568a-4d0c-b3ed-160ec5939fe7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:10.146815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:10.155805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 330/669] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:10.155805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357ba74-c6f3-41cb-bfd0-24fc747f81be None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:10.160075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f283e63-568a-4d0c-b3ed-160ec5939fe7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:10.187268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:10.196083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf958045-8007-43be-82ed-586cd646d996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:10.196773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf958045-8007-43be-82ed-586cd646d996 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:10.197086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf958045-8007-43be-82ed-586cd646d996 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:10.197362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf958045-8007-43be-82ed-586cd646d996 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:10.198149 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf958045-8007-43be-82ed-586cd646d996 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:10.198462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf958045-8007-43be-82ed-586cd646d996 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:10.199892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf958045-8007-43be-82ed-586cd646d996 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:10.217096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 340/670] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:10.217096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf958045-8007-43be-82ed-586cd646d996 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:10.259514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357ba74-c6f3-41cb-bfd0-24fc747f81be None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:10.295425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e258ae-f343-421c-9fa4-1efa14062585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:10.296107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e258ae-f343-421c-9fa4-1efa14062585 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:10.296386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e258ae-f343-421c-9fa4-1efa14062585 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:10.296674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e258ae-f343-421c-9fa4-1efa14062585 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:10.297488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e258ae-f343-421c-9fa4-1efa14062585 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:10.297794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e258ae-f343-421c-9fa4-1efa14062585 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:10.299723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e258ae-f343-421c-9fa4-1efa14062585 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:10.315855 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 331/671] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:10.317251 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e258ae-f343-421c-9fa4-1efa14062585 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:10.323181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf958045-8007-43be-82ed-586cd646d996 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:10.362672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03618b3d-4ac2-47d1-90e9-582222833089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:10.363491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03618b3d-4ac2-47d1-90e9-582222833089 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:10.363773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03618b3d-4ac2-47d1-90e9-582222833089 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:10.364044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03618b3d-4ac2-47d1-90e9-582222833089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:10.374846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03618b3d-4ac2-47d1-90e9-582222833089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:10.376470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03618b3d-4ac2-47d1-90e9-582222833089 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:10.381132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-03618b3d-4ac2-47d1-90e9-582222833089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:10.396091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:10.402669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:10.403564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:10.403564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:10.403564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:10.403564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:10.403564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 341/672] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:10.403564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03618b3d-4ac2-47d1-90e9-582222833089 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:10.431870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e258ae-f343-421c-9fa4-1efa14062585 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:10.442052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:10.467687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc2371-889f-45c9-a6e3-629a52de0a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:10.468471 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc2371-889f-45c9-a6e3-629a52de0a45 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:10.468753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc2371-889f-45c9-a6e3-629a52de0a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:10.469071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fc2371-889f-45c9-a6e3-629a52de0a45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:10.481201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc2371-889f-45c9-a6e3-629a52de0a45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:10.482778 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fc2371-889f-45c9-a6e3-629a52de0a45 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-a5fc2371-889f-45c9-a6e3-629a52de0a45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:10.501119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:10.502209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:10.503095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:10.503095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:10.503095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:10.503095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:10.503095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 332/673] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:10.503095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc2371-889f-45c9-a6e3-629a52de0a45 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:10.516086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03618b3d-4ac2-47d1-90e9-582222833089 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:10.553166 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3f7c4-4254-43dd-be36-263f5bb1607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:10.553828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3f7c4-4254-43dd-be36-263f5bb1607b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:10.554108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3f7c4-4254-43dd-be36-263f5bb1607b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:10.554384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3f7c4-4254-43dd-be36-263f5bb1607b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:10.555215 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3f7c4-4254-43dd-be36-263f5bb1607b None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=fe6832291d504cff9e787c0d791c70ed) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:10.555588 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3f7c4-4254-43dd-be36-263f5bb1607b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:10.557096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3f7c4-4254-43dd-be36-263f5bb1607b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:10.572830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 342/674] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:10 2022] GET /identity/v3/role_assignments?user.id=fe6832291d504cff9e787c0d791c70ed&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:10.572830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3f7c4-4254-43dd-be36-263f5bb1607b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:10.639824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fc2371-889f-45c9-a6e3-629a52de0a45 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:10.663178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:10.686793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3f7c4-4254-43dd-be36-263f5bb1607b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:10.693409 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990b970-17ad-472c-a855-498f4f5fdd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:10.695039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990b970-17ad-472c-a855-498f4f5fdd28 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:10.695474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990b970-17ad-472c-a855-498f4f5fdd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:10.695896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990b970-17ad-472c-a855-498f4f5fdd28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:10.706628 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:10.707321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990b970-17ad-472c-a855-498f4f5fdd28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:10.709006 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990b970-17ad-472c-a855-498f4f5fdd28 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:10.725240 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4012a82-aa40-4880-8c87-a4f5316d9a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:10.726061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4012a82-aa40-4880-8c87-a4f5316d9a42 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:10.726442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4012a82-aa40-4880-8c87-a4f5316d9a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:10.726837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4012a82-aa40-4880-8c87-a4f5316d9a42 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:10.727680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4012a82-aa40-4880-8c87-a4f5316d9a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:10.728071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4012a82-aa40-4880-8c87-a4f5316d9a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:10.729962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4012a82-aa40-4880-8c87-a4f5316d9a42 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-9990b970-17ad-472c-a855-498f4f5fdd28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:10.730449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:10.735420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:10.736363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:10.736363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:10.736363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:10.736363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:10.736363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:10.736363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:10.736363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:10.736363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:10.736363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 333/675] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:10.736363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990b970-17ad-472c-a855-498f4f5fdd28 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:10.753333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 343/676] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:10.754281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4012a82-aa40-4880-8c87-a4f5316d9a42 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:10.865118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990b970-17ad-472c-a855-498f4f5fdd28 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:10.896839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4012a82-aa40-4880-8c87-a4f5316d9a42 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:10.914565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a780cc-3e73-4f0f-a937-f57af9c1904a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:10.915189 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a780cc-3e73-4f0f-a937-f57af9c1904a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:10.915473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a780cc-3e73-4f0f-a937-f57af9c1904a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:10.915925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a780cc-3e73-4f0f-a937-f57af9c1904a None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:10.916682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a780cc-3e73-4f0f-a937-f57af9c1904a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:10.917026 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a780cc-3e73-4f0f-a937-f57af9c1904a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:10.918411 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a780cc-3e73-4f0f-a937-f57af9c1904a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:10.929582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeedfac-7644-4a8f-8d14-5459fb8103b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:10.930246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeedfac-7644-4a8f-8d14-5459fb8103b7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:10.930529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeedfac-7644-4a8f-8d14-5459fb8103b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:10.930802 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeedfac-7644-4a8f-8d14-5459fb8103b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:10.931661 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeedfac-7644-4a8f-8d14-5459fb8103b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:10.931973 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeedfac-7644-4a8f-8d14-5459fb8103b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:10.932881 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 334/677] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:10.933518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeedfac-7644-4a8f-8d14-5459fb8103b7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:10.934134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a780cc-3e73-4f0f-a937-f57af9c1904a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:10.945964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 344/678] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:10.947380 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11fdaa-5634-44c6-98f7-9d0343394399 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:10.947676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11fdaa-5634-44c6-98f7-9d0343394399 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:10.947956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11fdaa-5634-44c6-98f7-9d0343394399 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:10.951411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 345/679] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:10.952437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11fdaa-5634-44c6-98f7-9d0343394399 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:10.974706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:10.979025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:11.045286 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a780cc-3e73-4f0f-a937-f57af9c1904a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:11.055866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de11fdaa-5634-44c6-98f7-9d0343394399 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:11.083574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601ef75-f166-469f-9fa2-37aa93a5bda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:11.084513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ef75-f166-469f-9fa2-37aa93a5bda0 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:11.085154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ef75-f166-469f-9fa2-37aa93a5bda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:11.085437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2601ef75-f166-469f-9fa2-37aa93a5bda0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:11.092583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7161d1-19df-4978-b779-5345c942dd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:11.093416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7161d1-19df-4978-b779-5345c942dd87 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:11.093695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7161d1-19df-4978-b779-5345c942dd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:11.093968 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7161d1-19df-4978-b779-5345c942dd87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:11.094364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601ef75-f166-469f-9fa2-37aa93a5bda0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:11.095981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2601ef75-f166-469f-9fa2-37aa93a5bda0 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:11.101590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7161d1-19df-4978-b779-5345c942dd87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:11.103252 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7161d1-19df-4978-b779-5345c942dd87 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-2601ef75-f166-469f-9fa2-37aa93a5bda0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:11.116427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:11.117489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:11.118424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:11.118424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:11.118424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:11.118424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:11.118424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:11.118424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:11.118424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:11.118424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:11.118424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:52:11.118424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-5c7161d1-19df-4978-b779-5345c942dd87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:11.118969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:11.119744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:11.120634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:11.120634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:11.120634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:11.120634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:11.120634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:11.120634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:11.120634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:11.120634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:11.122481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 335/680] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:11.124518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 346/681] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:11.124689 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601ef75-f166-469f-9fa2-37aa93a5bda0 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:11.125710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169766-240d-4f59-817a-c6ab66ab13e7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:11.126001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169766-240d-4f59-817a-c6ab66ab13e7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:11.126276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d169766-240d-4f59-817a-c6ab66ab13e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:11.143253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-4d169766-240d-4f59-817a-c6ab66ab13e7 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:11.144454 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4d169766-240d-4f59-817a-c6ab66ab13e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:11.216939 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 347/682] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:11.221227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d169766-240d-4f59-817a-c6ab66ab13e7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:11.230370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:11.240057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2601ef75-f166-469f-9fa2-37aa93a5bda0 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:11.241520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:11.277821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23222845-3a41-4669-bd32-f2925e98596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:11.278475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23222845-3a41-4669-bd32-f2925e98596a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:11.278756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23222845-3a41-4669-bd32-f2925e98596a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:11.279373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23222845-3a41-4669-bd32-f2925e98596a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:11.280443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23222845-3a41-4669-bd32-f2925e98596a None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=75e6ac80e76b41e4976f5a10daad85d8) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:11.280888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23222845-3a41-4669-bd32-f2925e98596a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:11.282225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23222845-3a41-4669-bd32-f2925e98596a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:11.288913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 336/683] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:11 2022] GET /identity/v3/role_assignments?user.id=75e6ac80e76b41e4976f5a10daad85d8&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:11.290667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23222845-3a41-4669-bd32-f2925e98596a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:11.359787 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d169766-240d-4f59-817a-c6ab66ab13e7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:11.405623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae732418-b144-4f05-ac5c-787bb5725441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:11.406316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae732418-b144-4f05-ac5c-787bb5725441 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:11.406602 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae732418-b144-4f05-ac5c-787bb5725441 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:11.406879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae732418-b144-4f05-ac5c-787bb5725441 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:11.407857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae732418-b144-4f05-ac5c-787bb5725441 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:11.408172 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae732418-b144-4f05-ac5c-787bb5725441 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:11.409840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae732418-b144-4f05-ac5c-787bb5725441 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:11.415302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23222845-3a41-4669-bd32-f2925e98596a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:11.431546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 348/684] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jun 23 12:52:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:11.432378 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae732418-b144-4f05-ac5c-787bb5725441 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:11.455413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192aeaa-20db-421f-b40b-9d9a2a936706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:11.456455 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192aeaa-20db-421f-b40b-9d9a2a936706 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:11.456997 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192aeaa-20db-421f-b40b-9d9a2a936706 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:11.458116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192aeaa-20db-421f-b40b-9d9a2a936706 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:11.459458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192aeaa-20db-421f-b40b-9d9a2a936706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:11.460019 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192aeaa-20db-421f-b40b-9d9a2a936706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:11.462821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192aeaa-20db-421f-b40b-9d9a2a936706 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:11.483269 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 337/685] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:11.487718 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192aeaa-20db-421f-b40b-9d9a2a936706 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:11.506760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:11.527866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:11.558791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae732418-b144-4f05-ac5c-787bb5725441 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:11.595868 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95146fdf-2e3e-4d5e-93dc-a7dfdd3b421d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:11.597121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95146fdf-2e3e-4d5e-93dc-a7dfdd3b421d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:11.597410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95146fdf-2e3e-4d5e-93dc-a7dfdd3b421d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:11.597690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95146fdf-2e3e-4d5e-93dc-a7dfdd3b421d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:11.610676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192aeaa-20db-421f-b40b-9d9a2a936706 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:11.610967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95146fdf-2e3e-4d5e-93dc-a7dfdd3b421d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-95146fdf-2e3e-4d5e-93dc-a7dfdd3b421d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:11.620945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:11.621904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:11.623388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:11.623388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:11.623388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:11.623388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:11.623388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:11.623388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:11.623388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:11.623388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:11.623388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:11.623388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:11.623388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:11.623388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:11.627746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 349/686] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:11.628771 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95146fdf-2e3e-4d5e-93dc-a7dfdd3b421d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:11.653183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025f470-1220-4493-ba68-78d6c771840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:11.655987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025f470-1220-4493-ba68-78d6c771840f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:11.656453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025f470-1220-4493-ba68-78d6c771840f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:11.656927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025f470-1220-4493-ba68-78d6c771840f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:11.748905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025f470-1220-4493-ba68-78d6c771840f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:11.750201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025f470-1220-4493-ba68-78d6c771840f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:11.750934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95146fdf-2e3e-4d5e-93dc-a7dfdd3b421d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:11.771807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:11.785156 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:11.789425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e15b8-bf7d-4789-a94d-692bfe53ee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:11.790212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e15b8-bf7d-4789-a94d-692bfe53ee37 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:11.790561 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e15b8-bf7d-4789-a94d-692bfe53ee37 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:11.790904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e15b8-bf7d-4789-a94d-692bfe53ee37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:11.791810 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e15b8-bf7d-4789-a94d-692bfe53ee37 None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=83858713769b41af800bab317602bf2f) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:11.792185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e15b8-bf7d-4789-a94d-692bfe53ee37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:11.793877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e15b8-bf7d-4789-a94d-692bfe53ee37 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:11.800905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 350/687] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:11 2022] GET /identity/v3/role_assignments?user.id=83858713769b41af800bab317602bf2f&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:11.801908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e15b8-bf7d-4789-a94d-692bfe53ee37 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:11.875503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 338/688] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:11.890882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025f470-1220-4493-ba68-78d6c771840f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:11.962179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e15b8-bf7d-4789-a94d-692bfe53ee37 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:12.003724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025f470-1220-4493-ba68-78d6c771840f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:12.021187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:12.038001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb2d26-ef70-4cea-ac6f-1884d4e11059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:12.041816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb2d26-ef70-4cea-ac6f-1884d4e11059 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:12.041816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb2d26-ef70-4cea-ac6f-1884d4e11059 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:12.041816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb2d26-ef70-4cea-ac6f-1884d4e11059 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:12.041816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb2d26-ef70-4cea-ac6f-1884d4e11059 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:12.041816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb2d26-ef70-4cea-ac6f-1884d4e11059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:12.042165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d76979-3a63-4883-a7d2-629a61a8de07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:12.042165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d76979-3a63-4883-a7d2-629a61a8de07 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:12.042165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d76979-3a63-4883-a7d2-629a61a8de07 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:12.042165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d76979-3a63-4883-a7d2-629a61a8de07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:12.042421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb2d26-ef70-4cea-ac6f-1884d4e11059 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:12.052412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 351/689] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:12.055399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d76979-3a63-4883-a7d2-629a61a8de07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:12.057149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d76979-3a63-4883-a7d2-629a61a8de07 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:12.057968 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb2d26-ef70-4cea-ac6f-1884d4e11059 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-11d76979-3a63-4883-a7d2-629a61a8de07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:12.077384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:12.078365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:12.079244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:12.079244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:12.079244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:12.079244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:12.079244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 339/690] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:12.084177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d76979-3a63-4883-a7d2-629a61a8de07 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:12.130667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:12.204362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb2d26-ef70-4cea-ac6f-1884d4e11059 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:12.220392 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d76979-3a63-4883-a7d2-629a61a8de07 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:12.267884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa5eab-fc1e-4003-b77f-7263ca471534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:12.268601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa5eab-fc1e-4003-b77f-7263ca471534 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:12.268905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa5eab-fc1e-4003-b77f-7263ca471534 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:12.269319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa5eab-fc1e-4003-b77f-7263ca471534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:12.282876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa5eab-fc1e-4003-b77f-7263ca471534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:12.284351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa5eab-fc1e-4003-b77f-7263ca471534 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:12.299136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0ae9e-587a-4ae5-8eca-fd2cd365915c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:12.299810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ae9e-587a-4ae5-8eca-fd2cd365915c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:12.300093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ae9e-587a-4ae5-8eca-fd2cd365915c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:12.300372 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ae9e-587a-4ae5-8eca-fd2cd365915c None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:12.301129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0ae9e-587a-4ae5-8eca-fd2cd365915c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:12.301435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0ae9e-587a-4ae5-8eca-fd2cd365915c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:12.302800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a0ae9e-587a-4ae5-8eca-fd2cd365915c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-51aa5eab-fc1e-4003-b77f-7263ca471534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:12.320161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:12.321103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:12.322928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:12.322928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:12.322928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:12.322928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:12.322928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 352/691] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:12.333470 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 340/692] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:12.334364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa5eab-fc1e-4003-b77f-7263ca471534 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:12.337159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0ae9e-587a-4ae5-8eca-fd2cd365915c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:12.374566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:12.463499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa5eab-fc1e-4003-b77f-7263ca471534 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:12.481482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:12.516060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a8e7f-7ced-4960-8cdf-95ef8c25b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:12.518263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a8e7f-7ced-4960-8cdf-95ef8c25b39a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:12.518767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a8e7f-7ced-4960-8cdf-95ef8c25b39a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:12.519949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a8e7f-7ced-4960-8cdf-95ef8c25b39a None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:12.520929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a8e7f-7ced-4960-8cdf-95ef8c25b39a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:12.522070 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a8e7f-7ced-4960-8cdf-95ef8c25b39a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:12.523865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a8e7f-7ced-4960-8cdf-95ef8c25b39a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:12.531786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a0ae9e-587a-4ae5-8eca-fd2cd365915c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:12.548843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 353/693] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:12.548843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a8e7f-7ced-4960-8cdf-95ef8c25b39a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:12.600481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106bf32-166d-4059-a53f-fe3e4d5d07e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:12.602639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106bf32-166d-4059-a53f-fe3e4d5d07e9 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:12.603809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106bf32-166d-4059-a53f-fe3e4d5d07e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:12.604487 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106bf32-166d-4059-a53f-fe3e4d5d07e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:12.616908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106bf32-166d-4059-a53f-fe3e4d5d07e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:12.624291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0106bf32-166d-4059-a53f-fe3e4d5d07e9 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-0106bf32-166d-4059-a53f-fe3e4d5d07e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:12.657292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:12.658841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:12.659949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:12.659949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:12.659949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:12.659949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:12.659949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:12.659949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:12.659949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:12.659949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:12.662182 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 341/694] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:12.673843 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106bf32-166d-4059-a53f-fe3e4d5d07e9 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:12.713935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a8e7f-7ced-4960-8cdf-95ef8c25b39a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:12.759820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b47bf-85b8-48fa-ae0e-e6ce344af2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:12.760914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b47bf-85b8-48fa-ae0e-e6ce344af2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:12.762801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b47bf-85b8-48fa-ae0e-e6ce344af2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:12.764724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b47bf-85b8-48fa-ae0e-e6ce344af2c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:12.780364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b47bf-85b8-48fa-ae0e-e6ce344af2c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:12.783072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b47bf-85b8-48fa-ae0e-e6ce344af2c3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-e59b47bf-85b8-48fa-ae0e-e6ce344af2c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:12.808614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:12.809870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:12.810982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:12.810982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:12.810982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:12.810982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:12.810982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:12.810982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:12.810982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:12.810982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:12.810982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:52:12.810982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:12.820835 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 354/695] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 23 12:52:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:12.822488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:12.832318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b47bf-85b8-48fa-ae0e-e6ce344af2c3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:12.834676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0106bf32-166d-4059-a53f-fe3e4d5d07e9 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:12.870479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba0685-a4e9-41fa-ab80-571de736292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:12.872100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba0685-a4e9-41fa-ab80-571de736292a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:12.872551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba0685-a4e9-41fa-ab80-571de736292a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:12.873031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba0685-a4e9-41fa-ab80-571de736292a None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:12.874001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba0685-a4e9-41fa-ab80-571de736292a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:12.874477 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba0685-a4e9-41fa-ab80-571de736292a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:12.876067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba0685-a4e9-41fa-ab80-571de736292a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:12.889480 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 342/696] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:12.890831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:12.895308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba0685-a4e9-41fa-ab80-571de736292a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:13.024938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b47bf-85b8-48fa-ae0e-e6ce344af2c3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:13.048425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba0685-a4e9-41fa-ab80-571de736292a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:13.060913 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d972db-a9cd-42f4-923d-9f79484a1585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:13.061635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d972db-a9cd-42f4-923d-9f79484a1585 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:13.062018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d972db-a9cd-42f4-923d-9f79484a1585 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:13.062400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d972db-a9cd-42f4-923d-9f79484a1585 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:13.063460 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d972db-a9cd-42f4-923d-9f79484a1585 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:13.063873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d972db-a9cd-42f4-923d-9f79484a1585 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:13.065545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d972db-a9cd-42f4-923d-9f79484a1585 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:13.085483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 355/697] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 23 12:52:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:13.086850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaf791-bc0e-4381-88ef-f2be5a725f1f None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:13.087248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaf791-bc0e-4381-88ef-f2be5a725f1f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:13.087633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaf791-bc0e-4381-88ef-f2be5a725f1f None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:13.093464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 356/698] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:13.093464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaf791-bc0e-4381-88ef-f2be5a725f1f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:13.098996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f61973-623a-48ba-b9a5-b5bd695a8aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:13.099888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f61973-623a-48ba-b9a5-b5bd695a8aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:13.100344 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f61973-623a-48ba-b9a5-b5bd695a8aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:13.100789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f61973-623a-48ba-b9a5-b5bd695a8aa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:13.102335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f61973-623a-48ba-b9a5-b5bd695a8aa0 None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=599a53720ecd4e729a6720a85b653eb0) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:13.102842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f61973-623a-48ba-b9a5-b5bd695a8aa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:13.106311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f61973-623a-48ba-b9a5-b5bd695a8aa0 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:13.124950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 343/699] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:12 2022] GET /identity/v3/role_assignments?user.id=599a53720ecd4e729a6720a85b653eb0&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:13.126879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2171876-8b8b-4c89-9075-57ffee65fbdd None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:13.127404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2171876-8b8b-4c89-9075-57ffee65fbdd None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:13.127950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2171876-8b8b-4c89-9075-57ffee65fbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:13.162011 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e2171876-8b8b-4c89-9075-57ffee65fbdd None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:13.163598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e2171876-8b8b-4c89-9075-57ffee65fbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:13.179515 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:13.191433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:13.208949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaf791-bc0e-4381-88ef-f2be5a725f1f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:13.247059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2212b4d-3ee5-4ad9-ada1-1dcdd18c0881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:13.248386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2212b4d-3ee5-4ad9-ada1-1dcdd18c0881 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:13.249125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2212b4d-3ee5-4ad9-ada1-1dcdd18c0881 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:13.249125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2212b4d-3ee5-4ad9-ada1-1dcdd18c0881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:13.318885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 344/700] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:13.330801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2212b4d-3ee5-4ad9-ada1-1dcdd18c0881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:13.332480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2212b4d-3ee5-4ad9-ada1-1dcdd18c0881 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:13.347199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2171876-8b8b-4c89-9075-57ffee65fbdd None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:13.425936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:13.445700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 357/701] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:13.450630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2212b4d-3ee5-4ad9-ada1-1dcdd18c0881 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:13.517187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2171876-8b8b-4c89-9075-57ffee65fbdd None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:13.564400 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a59a16-5b65-4c80-9fb3-e451a05a279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:13.565236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a59a16-5b65-4c80-9fb3-e451a05a279d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:13.565525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a59a16-5b65-4c80-9fb3-e451a05a279d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:13.565807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a59a16-5b65-4c80-9fb3-e451a05a279d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:13.583172 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a59a16-5b65-4c80-9fb3-e451a05a279d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:13.585249 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a59a16-5b65-4c80-9fb3-e451a05a279d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:13.588676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:13.594457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2212b4d-3ee5-4ad9-ada1-1dcdd18c0881 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:13.634524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903eefc5-fd70-4b8a-8a63-d4abdce16ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:13.635372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eefc5-fd70-4b8a-8a63-d4abdce16ecf None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:13.635657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eefc5-fd70-4b8a-8a63-d4abdce16ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:13.635936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903eefc5-fd70-4b8a-8a63-d4abdce16ecf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:13.650631 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903eefc5-fd70-4b8a-8a63-d4abdce16ecf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:13.652127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903eefc5-fd70-4b8a-8a63-d4abdce16ecf None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-903eefc5-fd70-4b8a-8a63-d4abdce16ecf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:13.674918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:13.675859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:13.676851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:13.676851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:13.676851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:13.676851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:13.676851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 358/702] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:13.682476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903eefc5-fd70-4b8a-8a63-d4abdce16ecf None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:13.730740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-34a59a16-5b65-4c80-9fb3-e451a05a279d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:13.744589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:13.745856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:13.746746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:13.746746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:13.746746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:13.746746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:13.746975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 345/703] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:13.752996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39d07f-8a21-4cc6-92e5-ceca1ca549ed None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:13.752996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39d07f-8a21-4cc6-92e5-ceca1ca549ed None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:13.752996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39d07f-8a21-4cc6-92e5-ceca1ca549ed None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:13.752996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 346/704] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:13.755081 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39d07f-8a21-4cc6-92e5-ceca1ca549ed None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:13.796256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903eefc5-fd70-4b8a-8a63-d4abdce16ecf None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:13.833029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356102a-f3ca-475a-ad23-cb67371638ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:13.833786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356102a-f3ca-475a-ad23-cb67371638ec None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:13.834014 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356102a-f3ca-475a-ad23-cb67371638ec None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:13.834291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356102a-f3ca-475a-ad23-cb67371638ec None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:13.835030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356102a-f3ca-475a-ad23-cb67371638ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:13.835339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356102a-f3ca-475a-ad23-cb67371638ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:13.836730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356102a-f3ca-475a-ad23-cb67371638ec None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:13.849246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 359/705] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:13.850542 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae8edd-5658-4fce-a7d9-d8157fd98e81 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:13.850835 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae8edd-5658-4fce-a7d9-d8157fd98e81 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:13.851173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae8edd-5658-4fce-a7d9-d8157fd98e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:13.875690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39d07f-8a21-4cc6-92e5-ceca1ca549ed None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:13.889919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-33ae8edd-5658-4fce-a7d9-d8157fd98e81 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:13.891991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-33ae8edd-5658-4fce-a7d9-d8157fd98e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:13.918089 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ee3a3-563c-4e6e-940a-6526d11a0249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:13.918907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ee3a3-563c-4e6e-940a-6526d11a0249 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:13.919380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ee3a3-563c-4e6e-940a-6526d11a0249 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:13.920751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ee3a3-563c-4e6e-940a-6526d11a0249 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:13.921946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ee3a3-563c-4e6e-940a-6526d11a0249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:13.922357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ee3a3-563c-4e6e-940a-6526d11a0249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:13.924334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ee3a3-563c-4e6e-940a-6526d11a0249 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:13.948889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 347/706] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:13.950817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ee3a3-563c-4e6e-940a-6526d11a0249 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:13.980948 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 360/707] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:13.982078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae8edd-5658-4fce-a7d9-d8157fd98e81 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:14.020437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:14.027445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:14.082054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ee3a3-563c-4e6e-940a-6526d11a0249 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:14.123903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317460c8-f9de-40ed-aac7-00ae021606e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:14.124113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae8edd-5658-4fce-a7d9-d8157fd98e81 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:14.124624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317460c8-f9de-40ed-aac7-00ae021606e3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:14.124936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317460c8-f9de-40ed-aac7-00ae021606e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:14.125215 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317460c8-f9de-40ed-aac7-00ae021606e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:14.132741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317460c8-f9de-40ed-aac7-00ae021606e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:14.134236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317460c8-f9de-40ed-aac7-00ae021606e3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-317460c8-f9de-40ed-aac7-00ae021606e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:14.150107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:14.151057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:14.151952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:14.151952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:14.151952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:14.151952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:14.151952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:14.151952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:14.151952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:14.151952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:14.156840 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 348/708] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:14.157898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317460c8-f9de-40ed-aac7-00ae021606e3 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:14.163424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887d6e3-1050-435e-87b4-bca8b05e120a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:14.164109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887d6e3-1050-435e-87b4-bca8b05e120a None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:14.164394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887d6e3-1050-435e-87b4-bca8b05e120a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:14.164673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887d6e3-1050-435e-87b4-bca8b05e120a None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:14.165416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887d6e3-1050-435e-87b4-bca8b05e120a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:14.167390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887d6e3-1050-435e-87b4-bca8b05e120a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:14.263149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317460c8-f9de-40ed-aac7-00ae021606e3 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:14.268906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 361/709] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:52:13 2022] POST /identity/v3/users => generated 254 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:14.269901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887d6e3-1050-435e-87b4-bca8b05e120a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:14.298931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:14.346255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98762843-d39c-4fbc-8b53-a38ecaf5a487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:14.347094 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98762843-d39c-4fbc-8b53-a38ecaf5a487 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:14.350713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98762843-d39c-4fbc-8b53-a38ecaf5a487 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:14.351008 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98762843-d39c-4fbc-8b53-a38ecaf5a487 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:14.351720 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98762843-d39c-4fbc-8b53-a38ecaf5a487 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:14.356731 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98762843-d39c-4fbc-8b53-a38ecaf5a487 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-98762843-d39c-4fbc-8b53-a38ecaf5a487 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:14.380572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:14.381637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:14.382940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 349/710] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Jun 23 12:52:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:14.383839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152fe61-ef82-4c14-b49d-d6b56d82a91d None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:14.383839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152fe61-ef82-4c14-b49d-d6b56d82a91d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:14.384256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152fe61-ef82-4c14-b49d-d6b56d82a91d None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:14.390529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 350/711] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:14.391767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285ffc0-284d-41b2-90e9-1f857cb4d8df None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:14.392050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285ffc0-284d-41b2-90e9-1f857cb4d8df None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:14.392326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285ffc0-284d-41b2-90e9-1f857cb4d8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:14.410565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-7285ffc0-284d-41b2-90e9-1f857cb4d8df None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:14.411980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7285ffc0-284d-41b2-90e9-1f857cb4d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:14.414559 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:14.432462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887d6e3-1050-435e-87b4-bca8b05e120a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:14.474720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee3026-000a-4b6c-a224-0447823934e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:14.475388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee3026-000a-4b6c-a224-0447823934e9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:14.475671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee3026-000a-4b6c-a224-0447823934e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:14.475955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee3026-000a-4b6c-a224-0447823934e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:14.476743 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee3026-000a-4b6c-a224-0447823934e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:14.478723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee3026-000a-4b6c-a224-0447823934e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:14.480174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ee3026-000a-4b6c-a224-0447823934e9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:14.495640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 362/712] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:14.496238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee3026-000a-4b6c-a224-0447823934e9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:14.505595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 351/713] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:14.506381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285ffc0-284d-41b2-90e9-1f857cb4d8df None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:14.632466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee3026-000a-4b6c-a224-0447823934e9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:14.644243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285ffc0-284d-41b2-90e9-1f857cb4d8df None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:14.656967 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:14.691203 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73262699-2b4b-43df-8830-310200f37db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:14.692319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73262699-2b4b-43df-8830-310200f37db3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:14.692902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73262699-2b4b-43df-8830-310200f37db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:14.693382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73262699-2b4b-43df-8830-310200f37db3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:14.693710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828aa95d-8dda-4d52-9ad0-4eb3c5283a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:14.694394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aa95d-8dda-4d52-9ad0-4eb3c5283a7a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:14.694677 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aa95d-8dda-4d52-9ad0-4eb3c5283a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:14.694975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aa95d-8dda-4d52-9ad0-4eb3c5283a7a None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:14.695586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73262699-2b4b-43df-8830-310200f37db3 None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=703c2c40fe434402817a8824c2756ee7) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:14.695694 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828aa95d-8dda-4d52-9ad0-4eb3c5283a7a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:14.695985 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828aa95d-8dda-4d52-9ad0-4eb3c5283a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:14.696431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73262699-2b4b-43df-8830-310200f37db3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:14.697422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828aa95d-8dda-4d52-9ad0-4eb3c5283a7a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:14.698326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73262699-2b4b-43df-8830-310200f37db3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:14.710079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 363/715] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jun 23 12:52:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:14.710392 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828aa95d-8dda-4d52-9ad0-4eb3c5283a7a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:14.710729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 352/715] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:14 2022] GET /identity/v3/role_assignments?user.id=703c2c40fe434402817a8824c2756ee7&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:14.719682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73262699-2b4b-43df-8830-310200f37db3 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:14.730016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:14.837997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828aa95d-8dda-4d52-9ad0-4eb3c5283a7a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:14.876040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f8bb4-9deb-43f6-9214-c067e0688f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:14.877070 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f8bb4-9deb-43f6-9214-c067e0688f8a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:14.877455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f8bb4-9deb-43f6-9214-c067e0688f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:14.877832 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f8bb4-9deb-43f6-9214-c067e0688f8a None admin] PATH_INFO: `/v3/services/network` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:14.878195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73262699-2b4b-43df-8830-310200f37db3 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:14.878692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f8bb4-9deb-43f6-9214-c067e0688f8a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:14.880230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f8bb4-9deb-43f6-9214-c067e0688f8a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-414f8bb4-9deb-43f6-9214-c067e0688f8a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:14.902892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:14.903988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:52:14.904853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:14.905606 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 364/716] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:14 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:14.914856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f8bb4-9deb-43f6-9214-c067e0688f8a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:14.941433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6a514-de70-47a0-b0db-e39ba05a0d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:14.942502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6a514-de70-47a0-b0db-e39ba05a0d4f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:14.942996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6a514-de70-47a0-b0db-e39ba05a0d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:14.943481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6a514-de70-47a0-b0db-e39ba05a0d4f None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:14.944398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6a514-de70-47a0-b0db-e39ba05a0d4f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:14.945909 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6a514-de70-47a0-b0db-e39ba05a0d4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:14.947525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6a514-de70-47a0-b0db-e39ba05a0d4f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:14.964063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 353/717] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jun 23 12:52:14 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:15.026762 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:15.076838 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f8bb4-9deb-43f6-9214-c067e0688f8a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:15.131718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a1f89-74e9-4dcd-9a09-0afd94c31f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:15.132839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1f89-74e9-4dcd-9a09-0afd94c31f20 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:15.133315 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1f89-74e9-4dcd-9a09-0afd94c31f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:15.133700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1f89-74e9-4dcd-9a09-0afd94c31f20 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:15.134433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a1f89-74e9-4dcd-9a09-0afd94c31f20 None admin] RBAC: Adding query filter params (name=network) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:15.134735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a1f89-74e9-4dcd-9a09-0afd94c31f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:15.136138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a1f89-74e9-4dcd-9a09-0afd94c31f20 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:15.143548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 365/718] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:15.154501 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6a514-de70-47a0-b0db-e39ba05a0d4f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:15.205120 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:15.290565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6a514-de70-47a0-b0db-e39ba05a0d4f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:15.346796 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9318e-fd65-413e-ad8e-deaa7b74495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:15.347472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9318e-fd65-413e-ad8e-deaa7b74495f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:15.347755 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9318e-fd65-413e-ad8e-deaa7b74495f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:15.348031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9318e-fd65-413e-ad8e-deaa7b74495f None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:15.348745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9318e-fd65-413e-ad8e-deaa7b74495f None admin] RBAC: Adding query filter params (type=network) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:15.349083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9318e-fd65-413e-ad8e-deaa7b74495f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:15.350464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9318e-fd65-413e-ad8e-deaa7b74495f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:15.356416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 354/719] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:15.949556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb976ab-0729-46e0-8978-f5ef3f4da6eb None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:15.950093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb976ab-0729-46e0-8978-f5ef3f4da6eb None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:15.950093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb976ab-0729-46e0-8978-f5ef3f4da6eb None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:15.952229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 366/720] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:15.957688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf645a0b-468d-4d22-99f9-88c8b04bb4e6 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:15.958116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf645a0b-468d-4d22-99f9-88c8b04bb4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:15.958314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf645a0b-468d-4d22-99f9-88c8b04bb4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:15.981101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-cf645a0b-468d-4d22-99f9-88c8b04bb4e6 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:15.982808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cf645a0b-468d-4d22-99f9-88c8b04bb4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:16.070708 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 355/721] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:16.118414 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb976ab-0729-46e0-8978-f5ef3f4da6eb None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:16.261499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb976ab-0729-46e0-8978-f5ef3f4da6eb None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:16.299189 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091d904-76ac-494c-a36d-e57751d42c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:16.299997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091d904-76ac-494c-a36d-e57751d42c37 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:16.300284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091d904-76ac-494c-a36d-e57751d42c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:16.300565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7091d904-76ac-494c-a36d-e57751d42c37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:16.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:16.312826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7091d904-76ac-494c-a36d-e57751d42c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-7091d904-76ac-494c-a36d-e57751d42c37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:16.320703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:16.324465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:16.326074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 367/722] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:16.330023 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf645a0b-468d-4d22-99f9-88c8b04bb4e6 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:16.375820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:16.475438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf645a0b-468d-4d22-99f9-88c8b04bb4e6 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:16.526872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af28e42-7319-4910-81ba-5348cf398f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:16.527619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28e42-7319-4910-81ba-5348cf398f9f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:16.527907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28e42-7319-4910-81ba-5348cf398f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:16.528190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af28e42-7319-4910-81ba-5348cf398f9f None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:16.529010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af28e42-7319-4910-81ba-5348cf398f9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:16.529321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af28e42-7319-4910-81ba-5348cf398f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:16.530763 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af28e42-7319-4910-81ba-5348cf398f9f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:16.545279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 356/723] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:16.550754 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091d904-76ac-494c-a36d-e57751d42c37 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:16.685507 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7091d904-76ac-494c-a36d-e57751d42c37 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:16.694968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16867ecb-d233-44a1-8309-f68897fdf677 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:16.695256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16867ecb-d233-44a1-8309-f68897fdf677 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:16.695534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16867ecb-d233-44a1-8309-f68897fdf677 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:16.696920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 357/724] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:16.704041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3545ebc-1d84-460e-becf-d35ab5c47fd1 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:16.704041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3545ebc-1d84-460e-becf-d35ab5c47fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:16.704041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3545ebc-1d84-460e-becf-d35ab5c47fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:16.738255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-f3545ebc-1d84-460e-becf-d35ab5c47fd1 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:16.739792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f3545ebc-1d84-460e-becf-d35ab5c47fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:16.741779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60790908-09cf-4708-856a-ce5508ff63a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:16.744035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60790908-09cf-4708-856a-ce5508ff63a9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:16.744035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60790908-09cf-4708-856a-ce5508ff63a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:16.744035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60790908-09cf-4708-856a-ce5508ff63a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:16.764471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60790908-09cf-4708-856a-ce5508ff63a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:16.766258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60790908-09cf-4708-856a-ce5508ff63a9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-60790908-09cf-4708-856a-ce5508ff63a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:16.798351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:16.799381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:16.800295 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:16.800295 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:16.800295 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:16.800295 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:16.802574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 368/725] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:16.809730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60790908-09cf-4708-856a-ce5508ff63a9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:16.859821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 358/726] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 12:52:16.886797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3545ebc-1d84-460e-becf-d35ab5c47fd1 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:16.928595 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:16.944850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:17.028979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60790908-09cf-4708-856a-ce5508ff63a9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:17.093062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09266bb-3989-40f7-97d0-01150fbaec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:17.094660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09266bb-3989-40f7-97d0-01150fbaec29 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:17.095646 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09266bb-3989-40f7-97d0-01150fbaec29 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:17.096068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09266bb-3989-40f7-97d0-01150fbaec29 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:17.097145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09266bb-3989-40f7-97d0-01150fbaec29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:17.099104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3545ebc-1d84-460e-becf-d35ab5c47fd1 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:17.099898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09266bb-3989-40f7-97d0-01150fbaec29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:17.101443 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09266bb-3989-40f7-97d0-01150fbaec29 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:17.127881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 369/727] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:17.129332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09266bb-3989-40f7-97d0-01150fbaec29 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:17.150143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91ee47-3be2-4425-b467-1096d60a9891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:17.151165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91ee47-3be2-4425-b467-1096d60a9891 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:17.151585 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91ee47-3be2-4425-b467-1096d60a9891 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:17.152019 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91ee47-3be2-4425-b467-1096d60a9891 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:17.163831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91ee47-3be2-4425-b467-1096d60a9891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-1b91ee47-3be2-4425-b467-1096d60a9891 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:17.172045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:17.173155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:17.174176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:17.174176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:17.174176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:17.174176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:17.174176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:17.174176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:17.174176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:17.174176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:17.174176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:17.174176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:17.174176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:17.174176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:17.176608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 359/728] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:52:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:17.184103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91ee47-3be2-4425-b467-1096d60a9891 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:17.314514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:17.316552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09266bb-3989-40f7-97d0-01150fbaec29 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:17.327612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:17.337035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91ee47-3be2-4425-b467-1096d60a9891 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:17.354894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728331f1-7d41-4802-a19f-b02d5da22d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:17.355935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728331f1-7d41-4802-a19f-b02d5da22d2c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:17.356385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728331f1-7d41-4802-a19f-b02d5da22d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:17.357983 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728331f1-7d41-4802-a19f-b02d5da22d2c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:17.366235 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728331f1-7d41-4802-a19f-b02d5da22d2c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:17.368073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728331f1-7d41-4802-a19f-b02d5da22d2c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:17.382981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a1045-9e70-4e28-b85a-9c0a5d6918d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:17.383738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a1045-9e70-4e28-b85a-9c0a5d6918d7 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:17.384094 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a1045-9e70-4e28-b85a-9c0a5d6918d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:17.384443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a1045-9e70-4e28-b85a-9c0a5d6918d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:17.385304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a1045-9e70-4e28-b85a-9c0a5d6918d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:17.385679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a1045-9e70-4e28-b85a-9c0a5d6918d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:17.387126 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a1045-9e70-4e28-b85a-9c0a5d6918d7 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-728331f1-7d41-4802-a19f-b02d5da22d2c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:17.390816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:17.391711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:17.392650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:17.392650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:17.392650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:17.392650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:17.392650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:17.392650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:17.392650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:17.392650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:17.392650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:52:17.392650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:17.399957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 370/729] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:17.401183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 360/730] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:52:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:17.401899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a125c9-8993-49cf-a98d-e37259a8c0d1 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:17.402191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a1045-9e70-4e28-b85a-9c0a5d6918d7 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:17.402559 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a125c9-8993-49cf-a98d-e37259a8c0d1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:17.403007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a125c9-8993-49cf-a98d-e37259a8c0d1 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:17.409697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 371/731] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:17.410812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a125c9-8993-49cf-a98d-e37259a8c0d1 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:17.533152 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a125c9-8993-49cf-a98d-e37259a8c0d1 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:17.534410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a1045-9e70-4e28-b85a-9c0a5d6918d7 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:17.572664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebd02c-8068-4614-b2ae-bdc23c5008ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:17.573450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebd02c-8068-4614-b2ae-bdc23c5008ec None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:17.573836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebd02c-8068-4614-b2ae-bdc23c5008ec None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:17.574218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebd02c-8068-4614-b2ae-bdc23c5008ec None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:17.575285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebd02c-8068-4614-b2ae-bdc23c5008ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:17.575802 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebd02c-8068-4614-b2ae-bdc23c5008ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:17.576387 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e98c1e-517f-43d0-8209-c0d8dc534143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:17.577395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98c1e-517f-43d0-8209-c0d8dc534143 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:17.577782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebd02c-8068-4614-b2ae-bdc23c5008ec None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:17.578003 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98c1e-517f-43d0-8209-c0d8dc534143 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:17.578436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e98c1e-517f-43d0-8209-c0d8dc534143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:17.589929 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e98c1e-517f-43d0-8209-c0d8dc534143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:17.591851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e98c1e-517f-43d0-8209-c0d8dc534143 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:17.594833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:17.603522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 372/732] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jun 23 12:52:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:17.613246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aee3b9-b519-40be-9957-162c0d02173b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:17.613246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aee3b9-b519-40be-9957-162c0d02173b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:17.613246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aee3b9-b519-40be-9957-162c0d02173b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-d0e98c1e-517f-43d0-8209-c0d8dc534143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:17.613505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:17.614320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:17.615238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:17.615238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:17.615238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:17.615238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:17.615238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 361/733] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:17.617325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e98c1e-517f-43d0-8209-c0d8dc534143 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:17.625522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-23aee3b9-b519-40be-9957-162c0d02173b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:17.626860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-23aee3b9-b519-40be-9957-162c0d02173b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:17.651029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:17.711120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 373/734] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:17.712280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aee3b9-b519-40be-9957-162c0d02173b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:17.724897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e98c1e-517f-43d0-8209-c0d8dc534143 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:17.758292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26670a-caf1-4537-b341-927bfc68172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:17.758952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26670a-caf1-4537-b341-927bfc68172b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:17.759242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26670a-caf1-4537-b341-927bfc68172b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:17.759506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26670a-caf1-4537-b341-927bfc68172b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:17.827552 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:17.834338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26670a-caf1-4537-b341-927bfc68172b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:17.835797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26670a-caf1-4537-b341-927bfc68172b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:17.845474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aee3b9-b519-40be-9957-162c0d02173b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:17.891852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7d31c-4eb0-475f-b913-05fb39f40e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:17.892527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7d31c-4eb0-475f-b913-05fb39f40e4b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:17.892828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7d31c-4eb0-475f-b913-05fb39f40e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:17.893118 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7d31c-4eb0-475f-b913-05fb39f40e4b None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:17.893855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7d31c-4eb0-475f-b913-05fb39f40e4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:17.894164 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7d31c-4eb0-475f-b913-05fb39f40e4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:17.895552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec7d31c-4eb0-475f-b913-05fb39f40e4b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:17.909113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 374/735] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:17.910070 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7d31c-4eb0-475f-b913-05fb39f40e4b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:17.931474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:17.947939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 362/736] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:17.949320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be96df2-4d1c-4218-aa8a-ae21620caf74 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:17.949587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be96df2-4d1c-4218-aa8a-ae21620caf74 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:17.949863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be96df2-4d1c-4218-aa8a-ae21620caf74 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:17.951363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 363/737] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:17.951899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be96df2-4d1c-4218-aa8a-ae21620caf74 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:18.015091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7d31c-4eb0-475f-b913-05fb39f40e4b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:18.049180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9175e03-54a3-4d09-a235-a0fed4b1e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:18.049802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:18.050083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9175e03-54a3-4d09-a235-a0fed4b1e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.050384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9175e03-54a3-4d09-a235-a0fed4b1e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.050637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9175e03-54a3-4d09-a235-a0fed4b1e7e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.056439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be96df2-4d1c-4218-aa8a-ae21620caf74 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:18.061259 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9175e03-54a3-4d09-a235-a0fed4b1e7e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-a9175e03-54a3-4d09-a235-a0fed4b1e7e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:18.069083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:18.076901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 375/738] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:18.077772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b1121-f78b-411d-9ec8-cd6da93668c5 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.078524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b1121-f78b-411d-9ec8-cd6da93668c5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.078524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b1121-f78b-411d-9ec8-cd6da93668c5 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.078524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 376/739] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:18.078524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b1121-f78b-411d-9ec8-cd6da93668c5 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:18.094503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a702dd-b1f9-4bf3-b7b7-2abba1d3cd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:18.095321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a702dd-b1f9-4bf3-b7b7-2abba1d3cd13 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.095603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a702dd-b1f9-4bf3-b7b7-2abba1d3cd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.095879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a702dd-b1f9-4bf3-b7b7-2abba1d3cd13 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.102947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a702dd-b1f9-4bf3-b7b7-2abba1d3cd13 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:18.104397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a702dd-b1f9-4bf3-b7b7-2abba1d3cd13 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-70a702dd-b1f9-4bf3-b7b7-2abba1d3cd13 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:18.118794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:18.119740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:18.120699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:18.120699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:18.120699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:18.120699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:18.120699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:18.120699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:18.120699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:18.120699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:18.120699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:52:18.120699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:18.120699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 364/740] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 23 12:52:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:18.121329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41acf6-8cf7-4435-87b4-eca7dab5d539 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.121405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41acf6-8cf7-4435-87b4-eca7dab5d539 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.121692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41acf6-8cf7-4435-87b4-eca7dab5d539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.137613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-fa41acf6-8cf7-4435-87b4-eca7dab5d539 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:18.139670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fa41acf6-8cf7-4435-87b4-eca7dab5d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:18.157663 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:18.181025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b1121-f78b-411d-9ec8-cd6da93668c5 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:18.205660 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 365/741] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:18.206484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41acf6-8cf7-4435-87b4-eca7dab5d539 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:18.225930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770d6e2-c8bb-41c3-a099-6a5483db8d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:18.226728 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770d6e2-c8bb-41c3-a099-6a5483db8d33 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.227570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770d6e2-c8bb-41c3-a099-6a5483db8d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.227697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770d6e2-c8bb-41c3-a099-6a5483db8d33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.239043 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770d6e2-c8bb-41c3-a099-6a5483db8d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:18.240505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770d6e2-c8bb-41c3-a099-6a5483db8d33 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6770d6e2-c8bb-41c3-a099-6a5483db8d33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:18.257071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:18.258129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:18.259119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:18.259119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:18.259119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:18.259119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:18.259119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 377/742] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:18.259510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93759094-409e-4ea9-902c-4c3cbbc6391b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.259651 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93759094-409e-4ea9-902c-4c3cbbc6391b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.259932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93759094-409e-4ea9-902c-4c3cbbc6391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.276683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-93759094-409e-4ea9-902c-4c3cbbc6391b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:18.277898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-93759094-409e-4ea9-902c-4c3cbbc6391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:18.293117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:18.308002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41acf6-8cf7-4435-87b4-eca7dab5d539 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:18.342599 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 378/743] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 12:52:18.342756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd94a9f-a925-4f41-8a18-9122c85f18db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:18.343349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd94a9f-a925-4f41-8a18-9122c85f18db None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.343452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93759094-409e-4ea9-902c-4c3cbbc6391b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:18.343633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd94a9f-a925-4f41-8a18-9122c85f18db None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.343904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd94a9f-a925-4f41-8a18-9122c85f18db None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.344646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd94a9f-a925-4f41-8a18-9122c85f18db None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:18.344988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd94a9f-a925-4f41-8a18-9122c85f18db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:18.346358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd94a9f-a925-4f41-8a18-9122c85f18db None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:18.354447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 366/744] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:18.355020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd94a9f-a925-4f41-8a18-9122c85f18db None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:18.412518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:18.453277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93759094-409e-4ea9-902c-4c3cbbc6391b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:18.457121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd94a9f-a925-4f41-8a18-9122c85f18db None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:18.487387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccaf43-5763-43a8-b1f9-c2248a62f736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:18.488069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccaf43-5763-43a8-b1f9-c2248a62f736 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.488357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccaf43-5763-43a8-b1f9-c2248a62f736 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.488633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ccaf43-5763-43a8-b1f9-c2248a62f736 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.489562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccaf43-5763-43a8-b1f9-c2248a62f736 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:18.489813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccaf43-5763-43a8-b1f9-c2248a62f736 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:18.490138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b97f4c-4976-4487-a01f-b22d5a3c01df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:18.490795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b97f4c-4976-4487-a01f-b22d5a3c01df None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.491077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b97f4c-4976-4487-a01f-b22d5a3c01df None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.491242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ccaf43-5763-43a8-b1f9-c2248a62f736 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:18.491333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b97f4c-4976-4487-a01f-b22d5a3c01df None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.492051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b97f4c-4976-4487-a01f-b22d5a3c01df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:18.493436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b97f4c-4976-4487-a01f-b22d5a3c01df None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:18.509148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 379/745] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jun 23 12:52:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:18.509957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccaf43-5763-43a8-b1f9-c2248a62f736 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:18.570928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 367/746] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:52:18 2022] POST /identity/v3/services => generated 240 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:18.571825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b97f4c-4976-4487-a01f-b22d5a3c01df None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:18.598150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:18.631361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ccaf43-5763-43a8-b1f9-c2248a62f736 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:18.652176 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:18.687797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f90fb8-391a-462f-9ac2-2e8c1b4a4488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:18.688487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f90fb8-391a-462f-9ac2-2e8c1b4a4488 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.688768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f90fb8-391a-462f-9ac2-2e8c1b4a4488 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.689127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f90fb8-391a-462f-9ac2-2e8c1b4a4488 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.689821 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f90fb8-391a-462f-9ac2-2e8c1b4a4488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:18.690127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f90fb8-391a-462f-9ac2-2e8c1b4a4488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:18.691570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f90fb8-391a-462f-9ac2-2e8c1b4a4488 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:18.703696 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b97f4c-4976-4487-a01f-b22d5a3c01df None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:18.704583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 380/747] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:18.705334 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f90fb8-391a-462f-9ac2-2e8c1b4a4488 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:18.750898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce586e-18b9-4fa5-a599-d8c438e09a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:18.751728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce586e-18b9-4fa5-a599-d8c438e09a63 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.751989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce586e-18b9-4fa5-a599-d8c438e09a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.752510 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce586e-18b9-4fa5-a599-d8c438e09a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.764698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce586e-18b9-4fa5-a599-d8c438e09a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:18.766230 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce586e-18b9-4fa5-a599-d8c438e09a63 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-01ce586e-18b9-4fa5-a599-d8c438e09a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:18.783598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:18.784548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:18.785461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:18.785461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:18.785461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:18.785461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:18.785461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 368/748] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:18.785741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce586e-18b9-4fa5-a599-d8c438e09a63 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:18.821620 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f90fb8-391a-462f-9ac2-2e8c1b4a4488 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:18.858359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:18.860756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3761d-b4aa-42ab-bbd2-998bb578e452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:18.861517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3761d-b4aa-42ab-bbd2-998bb578e452 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.861802 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3761d-b4aa-42ab-bbd2-998bb578e452 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.862079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3761d-b4aa-42ab-bbd2-998bb578e452 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.862819 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3761d-b4aa-42ab-bbd2-998bb578e452 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:18.864559 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3761d-b4aa-42ab-bbd2-998bb578e452 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:18.906647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce586e-18b9-4fa5-a599-d8c438e09a63 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:18.940345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccafb3-fb68-4918-8892-3644f70fcf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:18.941023 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccafb3-fb68-4918-8892-3644f70fcf0a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:18.941308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccafb3-fb68-4918-8892-3644f70fcf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:18.941582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dccafb3-fb68-4918-8892-3644f70fcf0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:18.948222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 381/749] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:52:18 2022] POST /identity/v3/services => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:18.958189 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3761d-b4aa-42ab-bbd2-998bb578e452 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:19.004279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:19.027441 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccafb3-fb68-4918-8892-3644f70fcf0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:19.029271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dccafb3-fb68-4918-8892-3644f70fcf0a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:19.091599 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3761d-b4aa-42ab-bbd2-998bb578e452 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:19.109775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:19.135078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2567e-5cc4-47d5-9f68-49cbccc6715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:19.136418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2567e-5cc4-47d5-9f68-49cbccc6715d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:19.136734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2567e-5cc4-47d5-9f68-49cbccc6715d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:19.137106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2567e-5cc4-47d5-9f68-49cbccc6715d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:19.148030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2567e-5cc4-47d5-9f68-49cbccc6715d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:19.150140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2567e-5cc4-47d5-9f68-49cbccc6715d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:19.164305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 369/750] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:18 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 12:52:19.165491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccafb3-fb68-4918-8892-3644f70fcf0a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-adc2567e-5cc4-47d5-9f68-49cbccc6715d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:19.166518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:19.167371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:19.168256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:19.168256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:19.168256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:19.168256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:19.168256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:19.168256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:19.168256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:19.168256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:19.169226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 382/751] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:19.177786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2567e-5cc4-47d5-9f68-49cbccc6715d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:19.279440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:19.292067 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2567e-5cc4-47d5-9f68-49cbccc6715d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:19.298176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dccafb3-fb68-4918-8892-3644f70fcf0a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:19.330034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57f8d7-e47b-4716-90ed-1bb91e3cdd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:19.331225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57f8d7-e47b-4716-90ed-1bb91e3cdd05 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:19.331807 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57f8d7-e47b-4716-90ed-1bb91e3cdd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:19.332394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57f8d7-e47b-4716-90ed-1bb91e3cdd05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:19.340470 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acabea3-9621-43c6-b4ce-c5e535026aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:19.341256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acabea3-9621-43c6-b4ce-c5e535026aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:19.341538 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acabea3-9621-43c6-b4ce-c5e535026aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:19.341810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acabea3-9621-43c6-b4ce-c5e535026aa6 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:19.342537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acabea3-9621-43c6-b4ce-c5e535026aa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:19.342838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acabea3-9621-43c6-b4ce-c5e535026aa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:19.344224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acabea3-9621-43c6-b4ce-c5e535026aa6 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:19.350037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57f8d7-e47b-4716-90ed-1bb91e3cdd05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:19.352035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57f8d7-e47b-4716-90ed-1bb91e3cdd05 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:19.369303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 370/752] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:19.369303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acabea3-9621-43c6-b4ce-c5e535026aa6 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-4c57f8d7-e47b-4716-90ed-1bb91e3cdd05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:19.379186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:19.380242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:19.382364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:19.382364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:19.382364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:19.382364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:19.384423 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 383/753] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:19.385501 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57f8d7-e47b-4716-90ed-1bb91e3cdd05 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:19.406125 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:19.501698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57f8d7-e47b-4716-90ed-1bb91e3cdd05 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:19.504915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acabea3-9621-43c6-b4ce-c5e535026aa6 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:19.537943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cd272-de4f-4edb-80cf-b1aa3f23ea0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:19.538748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cd272-de4f-4edb-80cf-b1aa3f23ea0a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:19.539031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cd272-de4f-4edb-80cf-b1aa3f23ea0a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:19.539616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cd272-de4f-4edb-80cf-b1aa3f23ea0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:19.548240 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cd272-de4f-4edb-80cf-b1aa3f23ea0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:19.549665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cd272-de4f-4edb-80cf-b1aa3f23ea0a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:19.552400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:19.557247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bd342-3acf-4d50-8850-253aa9714cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:19.558206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bd342-3acf-4d50-8850-253aa9714cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:19.558697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bd342-3acf-4d50-8850-253aa9714cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:19.559171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bd342-3acf-4d50-8850-253aa9714cb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:19.560337 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bd342-3acf-4d50-8850-253aa9714cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:19.560980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bd342-3acf-4d50-8850-253aa9714cb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:19.562748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bd342-3acf-4d50-8850-253aa9714cb0 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-959cd272-de4f-4edb-80cf-b1aa3f23ea0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:19.566337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:19.567567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:19.568555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:19.568555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:19.568555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:19.568555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:19.568555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:19.568555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:19.568555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:19.568555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:19.568555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:52:19.568555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:19.572075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 384/754] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 23 12:52:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:19.573015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cd272-de4f-4edb-80cf-b1aa3f23ea0a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:19.581318 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 371/755] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:19.582448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bd342-3acf-4d50-8850-253aa9714cb0 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:19.679758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:19.691381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cd272-de4f-4edb-80cf-b1aa3f23ea0a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:19.702411 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bd342-3acf-4d50-8850-253aa9714cb0 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:19.727558 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760022a-3d8e-4904-9d6d-6e9c2ae1a0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:19.728230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760022a-3d8e-4904-9d6d-6e9c2ae1a0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:19.728598 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760022a-3d8e-4904-9d6d-6e9c2ae1a0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:19.728776 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760022a-3d8e-4904-9d6d-6e9c2ae1a0b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:19.729555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760022a-3d8e-4904-9d6d-6e9c2ae1a0b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:19.729861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760022a-3d8e-4904-9d6d-6e9c2ae1a0b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:19.731873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760022a-3d8e-4904-9d6d-6e9c2ae1a0b2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:19.744099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d208cb-2d30-48f4-8e26-c526ef6e931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:19.749259 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 385/756] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:19.749259 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760022a-3d8e-4904-9d6d-6e9c2ae1a0b2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:19.750379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d208cb-2d30-48f4-8e26-c526ef6e931b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:19.750772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d208cb-2d30-48f4-8e26-c526ef6e931b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:19.751164 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d208cb-2d30-48f4-8e26-c526ef6e931b None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:19.752193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d208cb-2d30-48f4-8e26-c526ef6e931b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:19.752624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d208cb-2d30-48f4-8e26-c526ef6e931b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:19.754275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d208cb-2d30-48f4-8e26-c526ef6e931b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:19.779728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 372/757] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 23 12:52:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:19.780967 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d208cb-2d30-48f4-8e26-c526ef6e931b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:19.826093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:19.874678 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760022a-3d8e-4904-9d6d-6e9c2ae1a0b2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:19.911755 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c64b67-b622-419e-972f-3acc67dd27d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:19.912354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c64b67-b622-419e-972f-3acc67dd27d0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:19.912643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c64b67-b622-419e-972f-3acc67dd27d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:19.912953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c64b67-b622-419e-972f-3acc67dd27d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:19.913788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c64b67-b622-419e-972f-3acc67dd27d0 None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=599a53720ecd4e729a6720a85b653eb0) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:19.914105 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c64b67-b622-419e-972f-3acc67dd27d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:19.915564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c64b67-b622-419e-972f-3acc67dd27d0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:19.919404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d208cb-2d30-48f4-8e26-c526ef6e931b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:19.921885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 386/758] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:19 2022] GET /identity/v3/role_assignments?user.id=599a53720ecd4e729a6720a85b653eb0&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:19.923229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c64b67-b622-419e-972f-3acc67dd27d0 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:19.970743 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417856db-efa5-4d7d-ab64-75857026150b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:19.972613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417856db-efa5-4d7d-ab64-75857026150b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:19.973144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417856db-efa5-4d7d-ab64-75857026150b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:19.973612 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417856db-efa5-4d7d-ab64-75857026150b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:19.985296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417856db-efa5-4d7d-ab64-75857026150b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:19.987956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417856db-efa5-4d7d-ab64-75857026150b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:19.991204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-417856db-efa5-4d7d-ab64-75857026150b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:20.010191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:20.011169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:20.012063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:20.012063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:20.012063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:20.012063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:20.012063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:20.012063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:20.012063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:20.012063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:20.016112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 373/759] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:20.021753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417856db-efa5-4d7d-ab64-75857026150b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:20.038092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c64b67-b622-419e-972f-3acc67dd27d0 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:20.064793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:20.077092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13864-ad83-4785-b8d6-7b98974396a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:20.078139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13864-ad83-4785-b8d6-7b98974396a8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:20.078529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13864-ad83-4785-b8d6-7b98974396a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:20.078918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee13864-ad83-4785-b8d6-7b98974396a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:20.092013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13864-ad83-4785-b8d6-7b98974396a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:20.093510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee13864-ad83-4785-b8d6-7b98974396a8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-0ee13864-ad83-4785-b8d6-7b98974396a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:20.116826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:20.117800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:20.118690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:20.118690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:20.118690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:20.118690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:20.118690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 387/760] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:20.120613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13864-ad83-4785-b8d6-7b98974396a8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:20.177295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417856db-efa5-4d7d-ab64-75857026150b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:20.215163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52867b9-c2b9-4713-9a39-91afc82574c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:20.217000 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52867b9-c2b9-4713-9a39-91afc82574c1 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:20.217442 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52867b9-c2b9-4713-9a39-91afc82574c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:20.218190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52867b9-c2b9-4713-9a39-91afc82574c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:20.219148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52867b9-c2b9-4713-9a39-91afc82574c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:20.219610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52867b9-c2b9-4713-9a39-91afc82574c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:20.221753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52867b9-c2b9-4713-9a39-91afc82574c1 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:20.234541 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee13864-ad83-4785-b8d6-7b98974396a8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:20.239003 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 374/761] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:20.244893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52867b9-c2b9-4713-9a39-91afc82574c1 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:20.306608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87844e-6c00-458d-853e-458ee39d2067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:20.307338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87844e-6c00-458d-853e-458ee39d2067 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:20.307632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87844e-6c00-458d-853e-458ee39d2067 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:20.307914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b87844e-6c00-458d-853e-458ee39d2067 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:20.308652 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87844e-6c00-458d-853e-458ee39d2067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:20.308993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87844e-6c00-458d-853e-458ee39d2067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:20.310481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b87844e-6c00-458d-853e-458ee39d2067 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:20.316391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:20.335402 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 388/762] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:20.340425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87844e-6c00-458d-853e-458ee39d2067 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:20.366421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52867b9-c2b9-4713-9a39-91afc82574c1 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:20.420084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa1eb6-bc89-4e02-8fc6-d8c82679a027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:20.420822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa1eb6-bc89-4e02-8fc6-d8c82679a027 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:20.421118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa1eb6-bc89-4e02-8fc6-d8c82679a027 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:20.421397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa1eb6-bc89-4e02-8fc6-d8c82679a027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:20.422241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa1eb6-bc89-4e02-8fc6-d8c82679a027 None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=6af4358779f947acade2ed0293893b89) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:20.422553 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa1eb6-bc89-4e02-8fc6-d8c82679a027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:20.423996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa1eb6-bc89-4e02-8fc6-d8c82679a027 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:20.427445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:20.441076 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 375/763] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:20 2022] GET /identity/v3/role_assignments?user.id=6af4358779f947acade2ed0293893b89&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:20.510719 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b87844e-6c00-458d-853e-458ee39d2067 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:20.564128 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc17232-6f7a-41ad-a6dd-44960f5b3957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:20.565026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc17232-6f7a-41ad-a6dd-44960f5b3957 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:20.565311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc17232-6f7a-41ad-a6dd-44960f5b3957 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:20.565588 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc17232-6f7a-41ad-a6dd-44960f5b3957 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:20.577112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc17232-6f7a-41ad-a6dd-44960f5b3957 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:20.578685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc17232-6f7a-41ad-a6dd-44960f5b3957 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-bcc17232-6f7a-41ad-a6dd-44960f5b3957 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:20.601785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:20.602770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:20.603666 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:20.603666 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:20.603666 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:20.603666 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:20.603666 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:20.603666 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:20.603666 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:20.603666 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:20.603666 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 389/764] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:20.608942 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa1eb6-bc89-4e02-8fc6-d8c82679a027 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:20.741788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa1eb6-bc89-4e02-8fc6-d8c82679a027 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:20.770090 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:20.788384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cac96-30f6-4863-b723-0c620b93e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:20.789082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cac96-30f6-4863-b723-0c620b93e321 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:20.789368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cac96-30f6-4863-b723-0c620b93e321 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:20.789645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cac96-30f6-4863-b723-0c620b93e321 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:20.790440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cac96-30f6-4863-b723-0c620b93e321 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:20.790751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cac96-30f6-4863-b723-0c620b93e321 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:20.792255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cac96-30f6-4863-b723-0c620b93e321 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:20.811617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 376/765] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:20.817478 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc17232-6f7a-41ad-a6dd-44960f5b3957 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:20.959184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:20.965194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc17232-6f7a-41ad-a6dd-44960f5b3957 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:20.988921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d397-2a4f-4853-97cf-871b3fbb524a None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:20.989230 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d397-2a4f-4853-97cf-871b3fbb524a None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:20.989487 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4d397-2a4f-4853-97cf-871b3fbb524a None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:20.991393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 377/766] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:20.996571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4529c47-ad11-4b0f-a59f-8830e7059714 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:20.997481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4529c47-ad11-4b0f-a59f-8830e7059714 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:20.997890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4529c47-ad11-4b0f-a59f-8830e7059714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:21.011908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3a080-1852-473a-b36e-e3ab8e523b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:21.013190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3a080-1852-473a-b36e-e3ab8e523b2c None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:21.013573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3a080-1852-473a-b36e-e3ab8e523b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:21.014965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3a080-1852-473a-b36e-e3ab8e523b2c None admin] PATH_INFO: `/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/703c2c40fe434402817a8824c2756ee7/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:21.017122 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3a080-1852-473a-b36e-e3ab8e523b2c None admin] RBAC: Authorizing `identity:create_grant(project_id=66de76d7ea7a45a6b698f8b1295c66c3, user_id=703c2c40fe434402817a8824c2756ee7, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:21.018572 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c3a080-1852-473a-b36e-e3ab8e523b2c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:21.035176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e4529c47-ad11-4b0f-a59f-8830e7059714 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:21.035176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e4529c47-ad11-4b0f-a59f-8830e7059714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:21.106205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 378/767] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:21.135692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 390/768] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:20 2022] PUT /identity/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/703c2c40fe434402817a8824c2756ee7/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:21.137434 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56195c0-2451-448b-bf3e-ce0dfb552ee9 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:21.138310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56195c0-2451-448b-bf3e-ce0dfb552ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:21.138639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56195c0-2451-448b-bf3e-ce0dfb552ee9 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:21.140454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 379/769] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:21.143692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3a080-1852-473a-b36e-e3ab8e523b2c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:21.154162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c645488-8a45-4473-b21a-8c60ff653ba8 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:21.154450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c645488-8a45-4473-b21a-8c60ff653ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:21.156056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c645488-8a45-4473-b21a-8c60ff653ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:21.192711 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-2c645488-8a45-4473-b21a-8c60ff653ba8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:21.193980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2c645488-8a45-4473-b21a-8c60ff653ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:21.335844 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 380/770] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:21.336140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3a080-1852-473a-b36e-e3ab8e523b2c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:21.362592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c645488-8a45-4473-b21a-8c60ff653ba8 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:21.373711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559b3e-c79e-47bb-a37b-559ca1728753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:21.374645 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559b3e-c79e-47bb-a37b-559ca1728753 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:21.374930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559b3e-c79e-47bb-a37b-559ca1728753 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:21.375207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85559b3e-c79e-47bb-a37b-559ca1728753 None admin] PATH_INFO: `/v3/services/network` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:21.375870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85559b3e-c79e-47bb-a37b-559ca1728753 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:21.377419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85559b3e-c79e-47bb-a37b-559ca1728753 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-85559b3e-c79e-47bb-a37b-559ca1728753 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:21.390600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:21.392928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:52:21.394936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:21.403642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 391/771] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:21 2022] GET /identity/v3/services/network => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:21.403642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559b3e-c79e-47bb-a37b-559ca1728753 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:21.416511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:21.423050 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:21.481769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c645488-8a45-4473-b21a-8c60ff653ba8 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:21.506251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85559b3e-c79e-47bb-a37b-559ca1728753 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:21.518691 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4e7e1-0b89-47e6-b830-7cf7906ba929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:21.519512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4e7e1-0b89-47e6-b830-7cf7906ba929 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:21.519796 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4e7e1-0b89-47e6-b830-7cf7906ba929 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:21.520074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4e7e1-0b89-47e6-b830-7cf7906ba929 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:21.520739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4e7e1-0b89-47e6-b830-7cf7906ba929 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:21.522236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4e7e1-0b89-47e6-b830-7cf7906ba929 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-b3b4e7e1-0b89-47e6-b830-7cf7906ba929 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:21.536555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:21.538766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:21.540593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 381/772] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Jun 23 12:52:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:21.545420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4e7e1-0b89-47e6-b830-7cf7906ba929 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:21.560847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402995c-e270-4445-8c94-477309035f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:21.560847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402995c-e270-4445-8c94-477309035f3b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:21.560847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402995c-e270-4445-8c94-477309035f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:21.560847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402995c-e270-4445-8c94-477309035f3b None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:21.561285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402995c-e270-4445-8c94-477309035f3b None admin] RBAC: Adding query filter params (name=network) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:21.564048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402995c-e270-4445-8c94-477309035f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:21.564048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402995c-e270-4445-8c94-477309035f3b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:21.571017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 392/773] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:21.576996 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402995c-e270-4445-8c94-477309035f3b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:21.654621 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4e7e1-0b89-47e6-b830-7cf7906ba929 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:21.686396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:21.690232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1a183-dbc4-4dd0-ac3d-1e4f7390e986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:21.690908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1a183-dbc4-4dd0-ac3d-1e4f7390e986 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:21.691193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1a183-dbc4-4dd0-ac3d-1e4f7390e986 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:21.691472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d1a183-dbc4-4dd0-ac3d-1e4f7390e986 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:21.692191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1a183-dbc4-4dd0-ac3d-1e4f7390e986 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:21.692503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1a183-dbc4-4dd0-ac3d-1e4f7390e986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:21.693948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d1a183-dbc4-4dd0-ac3d-1e4f7390e986 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:21.699123 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 382/774] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jun 23 12:52:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:21.704636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1a183-dbc4-4dd0-ac3d-1e4f7390e986 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:21.758826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:21.774201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402995c-e270-4445-8c94-477309035f3b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:21.839026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71000ded-d72a-4fff-a537-73fdd0e99ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:21.839697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71000ded-d72a-4fff-a537-73fdd0e99ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:21.839976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71000ded-d72a-4fff-a537-73fdd0e99ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:21.840249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71000ded-d72a-4fff-a537-73fdd0e99ed4 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:21.842164 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71000ded-d72a-4fff-a537-73fdd0e99ed4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:21.842475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71000ded-d72a-4fff-a537-73fdd0e99ed4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:21.845169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71000ded-d72a-4fff-a537-73fdd0e99ed4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:21.862345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 393/775] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:21.870100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71000ded-d72a-4fff-a537-73fdd0e99ed4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:21.917723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d1a183-dbc4-4dd0-ac3d-1e4f7390e986 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:21.987999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00a290-c200-468b-a12d-dd39d5dc1975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:21.988672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a290-c200-468b-a12d-dd39d5dc1975 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:21.988977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a290-c200-468b-a12d-dd39d5dc1975 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:21.989246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00a290-c200-468b-a12d-dd39d5dc1975 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:21.989954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00a290-c200-468b-a12d-dd39d5dc1975 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:21.990253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00a290-c200-468b-a12d-dd39d5dc1975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:21.991620 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d00a290-c200-468b-a12d-dd39d5dc1975 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:22.007113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 383/776] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jun 23 12:52:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:22.014962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00a290-c200-468b-a12d-dd39d5dc1975 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:22.072615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:22.078783 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71000ded-d72a-4fff-a537-73fdd0e99ed4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:22.149130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00a290-c200-468b-a12d-dd39d5dc1975 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:22.180162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc5f58-4a3d-433b-8429-9188db8001d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:22.180788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc5f58-4a3d-433b-8429-9188db8001d3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:22.181104 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc5f58-4a3d-433b-8429-9188db8001d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:22.181387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc5f58-4a3d-433b-8429-9188db8001d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:22.182197 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc5f58-4a3d-433b-8429-9188db8001d3 None admin] RBAC: Adding query filter params (interface=public, service_id=a8b63783be8f4f3296970f99477cb389, region_id=RegionOne) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:22.182516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc5f58-4a3d-433b-8429-9188db8001d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:22.183912 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc5f58-4a3d-433b-8429-9188db8001d3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:22.193156 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7bb23-a067-413e-addd-de1622f00f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:22.195311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7bb23-a067-413e-addd-de1622f00f63 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:22.195750 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7bb23-a067-413e-addd-de1622f00f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:22.196343 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7bb23-a067-413e-addd-de1622f00f63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:22.199022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7bb23-a067-413e-addd-de1622f00f63 None admin] RBAC: Adding query filter params (interface=public, service_id=373ec16dc73a49789b2d2e5230531c4f, region_id=RegionOne) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:22.199521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7bb23-a067-413e-addd-de1622f00f63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:22.201433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb7bb23-a067-413e-addd-de1622f00f63 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:22.201601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 394/777] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 23 12:52:21 2022] GET /identity/v3/endpoints?service_id=a8b63783be8f4f3296970f99477cb389&interface=public®ion_id=RegionOne => generated 194 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:22.204721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc5f58-4a3d-433b-8429-9188db8001d3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:22.220181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 384/778] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 23 12:52:22 2022] GET /identity/v3/endpoints?service_id=373ec16dc73a49789b2d2e5230531c4f&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:22.225188 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7bb23-a067-413e-addd-de1622f00f63 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:22.233150 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:22.359258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:22.366699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7bb23-a067-413e-addd-de1622f00f63 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:22.401276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc5f58-4a3d-433b-8429-9188db8001d3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:22.445740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b06d64-f7ea-4d96-84aa-e553bc0c88d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:22.447568 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b06d64-f7ea-4d96-84aa-e553bc0c88d3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:22.449102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b06d64-f7ea-4d96-84aa-e553bc0c88d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:22.449774 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b06d64-f7ea-4d96-84aa-e553bc0c88d3 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:22.451134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b06d64-f7ea-4d96-84aa-e553bc0c88d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:22.453597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b06d64-f7ea-4d96-84aa-e553bc0c88d3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:22.457180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b46e9-d8f7-48a9-8235-9f7054280128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:22.458869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b46e9-d8f7-48a9-8235-9f7054280128 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:22.460882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b46e9-d8f7-48a9-8235-9f7054280128 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:22.461321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b46e9-d8f7-48a9-8235-9f7054280128 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:22.462223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b46e9-d8f7-48a9-8235-9f7054280128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:22.464860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 395/779] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 23 12:52:22 2022] GET /identity/v3/services => generated 772 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:22.466960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b46e9-d8f7-48a9-8235-9f7054280128 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:22.473584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 385/780] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 23 12:52:22 2022] GET /identity/v3/services => generated 772 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:22.608125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a5195-d398-4de7-81b1-70beb0fbe899 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:22.608463 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a5195-d398-4de7-81b1-70beb0fbe899 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:22.608696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a5195-d398-4de7-81b1-70beb0fbe899 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:22.610307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 396/781] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:22.616271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af1960-73cf-474b-b27c-25389e37a4e8 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:22.616953 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af1960-73cf-474b-b27c-25389e37a4e8 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:22.617437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af1960-73cf-474b-b27c-25389e37a4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:22.643068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-13af1960-73cf-474b-b27c-25389e37a4e8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:22.644686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-13af1960-73cf-474b-b27c-25389e37a4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:22.727427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 386/782] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:22.751003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a5195-d398-4de7-81b1-70beb0fbe899 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:22.834248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:22.879470 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f30ac-62d0-4488-a831-00460abd2880 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:22.879750 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f30ac-62d0-4488-a831-00460abd2880 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:22.880025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549f30ac-62d0-4488-a831-00460abd2880 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:22.880315 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a5195-d398-4de7-81b1-70beb0fbe899 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:22.882284 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 387/783] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:22.889167 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a31a9-73ff-48ed-874b-48522323485b None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:22.889719 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a31a9-73ff-48ed-874b-48522323485b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:22.890209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a31a9-73ff-48ed-874b-48522323485b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:22.918894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a676e9-2ce9-4928-b39e-dcefec1cbe2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:22.919837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a676e9-2ce9-4928-b39e-dcefec1cbe2b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:22.920313 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a676e9-2ce9-4928-b39e-dcefec1cbe2b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:22.920737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a676e9-2ce9-4928-b39e-dcefec1cbe2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:22.931789 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a676e9-2ce9-4928-b39e-dcefec1cbe2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-a8a676e9-2ce9-4928-b39e-dcefec1cbe2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:22.940520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:22.941509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:22.942355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:22.942355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:22.942355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:22.942355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:22.942355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:22.942355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:22.942355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:22.942355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:22.942355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:22.942355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:22.942355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:22.942355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:22.947677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-443a31a9-73ff-48ed-874b-48522323485b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:22.947677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-443a31a9-73ff-48ed-874b-48522323485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:22.947962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 397/784] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:22.958055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a676e9-2ce9-4928-b39e-dcefec1cbe2b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:23.061987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 388/785] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:23.097276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a31a9-73ff-48ed-874b-48522323485b None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:23.128345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:23.134437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a676e9-2ce9-4928-b39e-dcefec1cbe2b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:23.202107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb52eef-8a36-4f60-9223-133efa10e033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:23.202876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb52eef-8a36-4f60-9223-133efa10e033 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:23.203072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb52eef-8a36-4f60-9223-133efa10e033 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:23.203332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb52eef-8a36-4f60-9223-133efa10e033 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:23.204090 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb52eef-8a36-4f60-9223-133efa10e033 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:23.204394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb52eef-8a36-4f60-9223-133efa10e033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:23.205803 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb52eef-8a36-4f60-9223-133efa10e033 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:23.214384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:23.232199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 398/786] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:23.234952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb52eef-8a36-4f60-9223-133efa10e033 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:23.256992 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a31a9-73ff-48ed-874b-48522323485b None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:23.343248 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f70fd-db01-4273-8a62-8f5cad47d2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:23.343980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f70fd-db01-4273-8a62-8f5cad47d2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:23.344267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f70fd-db01-4273-8a62-8f5cad47d2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:23.344549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f70fd-db01-4273-8a62-8f5cad47d2f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:23.362753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f70fd-db01-4273-8a62-8f5cad47d2f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:23.367003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb52eef-8a36-4f60-9223-133efa10e033 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-ff6f70fd-db01-4273-8a62-8f5cad47d2f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:23.375136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:23.376127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:23.377022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:23.377022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:23.377022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:23.377022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:23.377022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:23.377022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:23.377022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:23.377022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:23.377022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:23.377022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:23.377022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:23.377022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:23.379321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 389/787] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:52:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:23.385828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f70fd-db01-4273-8a62-8f5cad47d2f6 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:23.417207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f3d49-dbb4-47fe-bf8f-75f4a67463e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:23.418440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f3d49-dbb4-47fe-bf8f-75f4a67463e8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:23.419177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f3d49-dbb4-47fe-bf8f-75f4a67463e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:23.419667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f3d49-dbb4-47fe-bf8f-75f4a67463e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:23.430887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f3d49-dbb4-47fe-bf8f-75f4a67463e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:23.432599 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f3d49-dbb4-47fe-bf8f-75f4a67463e8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-013f3d49-dbb4-47fe-bf8f-75f4a67463e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:23.452052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:23.453037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:23.453938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:23.453938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:23.453938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:23.453938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:23.460667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 399/788] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:23.462267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f3d49-dbb4-47fe-bf8f-75f4a67463e8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:23.555435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f70fd-db01-4273-8a62-8f5cad47d2f6 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:23.561228 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:23.590039 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:23.616865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eb6a8-5339-46f4-b54f-46338de786c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:23.621146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eb6a8-5339-46f4-b54f-46338de786c5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:23.621642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eb6a8-5339-46f4-b54f-46338de786c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:23.623799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04eb6a8-5339-46f4-b54f-46338de786c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:23.623799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eb6a8-5339-46f4-b54f-46338de786c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:23.623799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eb6a8-5339-46f4-b54f-46338de786c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:23.626835 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04eb6a8-5339-46f4-b54f-46338de786c5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:23.638460 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 390/789] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:52:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:23.645766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eb6a8-5339-46f4-b54f-46338de786c5 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:23.679710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f3d49-dbb4-47fe-bf8f-75f4a67463e8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:23.756305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04eb6a8-5339-46f4-b54f-46338de786c5 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:23.795868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9085be2-be71-40e3-87c4-11bf06c77bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:23.797137 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9085be2-be71-40e3-87c4-11bf06c77bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:23.797646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9085be2-be71-40e3-87c4-11bf06c77bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:23.798119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9085be2-be71-40e3-87c4-11bf06c77bd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:23.811506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9085be2-be71-40e3-87c4-11bf06c77bd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:23.813406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9085be2-be71-40e3-87c4-11bf06c77bd3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:23.817270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-e9085be2-be71-40e3-87c4-11bf06c77bd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:23.833944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:23.834971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:23.835849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:23.835849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:23.835849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:23.835849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:23.838078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 391/790] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:23.839781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5549-b840-48ca-8b04-1589165f737d None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:23.840241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5549-b840-48ca-8b04-1589165f737d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:23.846081 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab5549-b840-48ca-8b04-1589165f737d None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:23.846081 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 392/791] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:23.846577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5549-b840-48ca-8b04-1589165f737d None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:23.877849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531293d5-df93-45d0-87d2-309c57e59174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:23.878624 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531293d5-df93-45d0-87d2-309c57e59174 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:23.878989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531293d5-df93-45d0-87d2-309c57e59174 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:23.879342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531293d5-df93-45d0-87d2-309c57e59174 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:23.880151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531293d5-df93-45d0-87d2-309c57e59174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:23.880943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531293d5-df93-45d0-87d2-309c57e59174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:23.882102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531293d5-df93-45d0-87d2-309c57e59174 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:23.898994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 400/792] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:23.898994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778ed34-93c7-41ee-b8b3-b8dcedef790e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:23.898994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778ed34-93c7-41ee-b8b3-b8dcedef790e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:23.898994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778ed34-93c7-41ee-b8b3-b8dcedef790e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:23.918150 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3778ed34-93c7-41ee-b8b3-b8dcedef790e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:23.920124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3778ed34-93c7-41ee-b8b3-b8dcedef790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:23.976820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab5549-b840-48ca-8b04-1589165f737d None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:23.997480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 401/793] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:23.998479 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778ed34-93c7-41ee-b8b3-b8dcedef790e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:24.026595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d40aae-65c6-4485-95f8-f799fee07bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:24.027381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d40aae-65c6-4485-95f8-f799fee07bbd None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:24.027670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d40aae-65c6-4485-95f8-f799fee07bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:24.028036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d40aae-65c6-4485-95f8-f799fee07bbd None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:24.028886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d40aae-65c6-4485-95f8-f799fee07bbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:24.030431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d40aae-65c6-4485-95f8-f799fee07bbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:24.031885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d40aae-65c6-4485-95f8-f799fee07bbd None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:24.048036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 393/794] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:24.048920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d40aae-65c6-4485-95f8-f799fee07bbd None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:24.062330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:24.121988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:24.133383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778ed34-93c7-41ee-b8b3-b8dcedef790e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:24.169612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a61c46-40c9-48a9-8dd1-e7c26ce31009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:24.170565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a61c46-40c9-48a9-8dd1-e7c26ce31009 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:24.170920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a61c46-40c9-48a9-8dd1-e7c26ce31009 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:24.171267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a61c46-40c9-48a9-8dd1-e7c26ce31009 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:24.174933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d40aae-65c6-4485-95f8-f799fee07bbd None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:24.178805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a61c46-40c9-48a9-8dd1-e7c26ce31009 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:24.180332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a61c46-40c9-48a9-8dd1-e7c26ce31009 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-90a61c46-40c9-48a9-8dd1-e7c26ce31009 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:24.195129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:24.196063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:24.197321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:24.197321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:24.197321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:24.197321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:24.197321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:24.197321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:24.197321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:24.197321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:24.197321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:52:24.197321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:24.197321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 402/795] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:24.202687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a61c46-40c9-48a9-8dd1-e7c26ce31009 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:24.216625 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761211ff-4a6f-4266-bce1-6ecc310c5300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:24.217804 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761211ff-4a6f-4266-bce1-6ecc310c5300 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:24.218296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761211ff-4a6f-4266-bce1-6ecc310c5300 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:24.218753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761211ff-4a6f-4266-bce1-6ecc310c5300 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:24.230487 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761211ff-4a6f-4266-bce1-6ecc310c5300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-761211ff-4a6f-4266-bce1-6ecc310c5300 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:24.238888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:24.239829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:24.240647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:24.240647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:24.240647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:24.240647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:24.240647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:24.240647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:24.240647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:24.240647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:24.240647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:24.240647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:24.240647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:24.240647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:24.248477 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 394/796] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:24.249593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761211ff-4a6f-4266-bce1-6ecc310c5300 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:24.312658 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:24.315674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a61c46-40c9-48a9-8dd1-e7c26ce31009 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:24.351667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ed505-8310-40ec-8d00-5afb4d07742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:24.352570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ed505-8310-40ec-8d00-5afb4d07742b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:24.353079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ed505-8310-40ec-8d00-5afb4d07742b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:24.353375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ed505-8310-40ec-8d00-5afb4d07742b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:24.361850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ed505-8310-40ec-8d00-5afb4d07742b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:24.363752 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761211ff-4a6f-4266-bce1-6ecc310c5300 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:24.364200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ed505-8310-40ec-8d00-5afb4d07742b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-971ed505-8310-40ec-8d00-5afb4d07742b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:24.381099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:24.382086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:24.383020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:24.383020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:24.383020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:24.383020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:24.383020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:24.383020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:24.383020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:24.383020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:24.383020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:52:24.383020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:24.383812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 403/797] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 23 12:52:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:24.384849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ed505-8310-40ec-8d00-5afb4d07742b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:24.386299 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:24.407568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56418e-cfad-4af2-828a-34a534cfb17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:24.408509 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56418e-cfad-4af2-828a-34a534cfb17d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:24.409011 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56418e-cfad-4af2-828a-34a534cfb17d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:24.409534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56418e-cfad-4af2-828a-34a534cfb17d None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:24.410563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56418e-cfad-4af2-828a-34a534cfb17d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:24.411066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56418e-cfad-4af2-828a-34a534cfb17d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:24.412827 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56418e-cfad-4af2-828a-34a534cfb17d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:24.433071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 395/798] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jun 23 12:52:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:24.434861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56418e-cfad-4af2-828a-34a534cfb17d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:24.499117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ed505-8310-40ec-8d00-5afb4d07742b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:24.535540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b41ff8-0437-444b-8a29-2b8f26134ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:24.536222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41ff8-0437-444b-8a29-2b8f26134ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:24.536509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41ff8-0437-444b-8a29-2b8f26134ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:24.536886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41ff8-0437-444b-8a29-2b8f26134ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:24.537708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b41ff8-0437-444b-8a29-2b8f26134ee0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:24.538008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b41ff8-0437-444b-8a29-2b8f26134ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:24.539395 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b41ff8-0437-444b-8a29-2b8f26134ee0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:24.550365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 404/799] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:24.551211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b41ff8-0437-444b-8a29-2b8f26134ee0 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:24.552271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56418e-cfad-4af2-828a-34a534cfb17d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:24.577318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:24.593211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8209a4-acbb-457d-b476-fd3a0a3d652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:24.594259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8209a4-acbb-457d-b476-fd3a0a3d652d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:24.594788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8209a4-acbb-457d-b476-fd3a0a3d652d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:24.595266 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8209a4-acbb-457d-b476-fd3a0a3d652d None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:24.596336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8209a4-acbb-457d-b476-fd3a0a3d652d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:24.596931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8209a4-acbb-457d-b476-fd3a0a3d652d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:24.598596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8209a4-acbb-457d-b476-fd3a0a3d652d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:24.619762 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 396/800] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jun 23 12:52:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:24.621048 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8209a4-acbb-457d-b476-fd3a0a3d652d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:24.656157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:24.666430 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b41ff8-0437-444b-8a29-2b8f26134ee0 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:24.704035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedda64-8fcc-4bfa-a79f-c3ca34c7195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:24.704940 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedda64-8fcc-4bfa-a79f-c3ca34c7195b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:24.705232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedda64-8fcc-4bfa-a79f-c3ca34c7195b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:24.705511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedda64-8fcc-4bfa-a79f-c3ca34c7195b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:24.717505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedda64-8fcc-4bfa-a79f-c3ca34c7195b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:24.719123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aedda64-8fcc-4bfa-a79f-c3ca34c7195b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:24.734963 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8209a4-acbb-457d-b476-fd3a0a3d652d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-0aedda64-8fcc-4bfa-a79f-c3ca34c7195b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:24.739836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:24.740704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:24.741617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:24.741617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:24.741617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:24.741617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:24.746175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 405/801] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:24.746873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedda64-8fcc-4bfa-a79f-c3ca34c7195b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:24.776294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a82a8-e135-4830-bf7a-8fc59251d80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:24.777569 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a82a8-e135-4830-bf7a-8fc59251d80f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:24.778431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a82a8-e135-4830-bf7a-8fc59251d80f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:24.778925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a82a8-e135-4830-bf7a-8fc59251d80f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:24.790336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a82a8-e135-4830-bf7a-8fc59251d80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:24.792191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a82a8-e135-4830-bf7a-8fc59251d80f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-d39a82a8-e135-4830-bf7a-8fc59251d80f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:24.812573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:24.813690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:24.814595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:24.814595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:24.814595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:24.814595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:24.816571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 397/802] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:24.817786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a82a8-e135-4830-bf7a-8fc59251d80f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:24.829345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:24.857397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedda64-8fcc-4bfa-a79f-c3ca34c7195b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:24.904317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2478d-09b8-477c-8e4a-2ca890829bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:24.905158 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2478d-09b8-477c-8e4a-2ca890829bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:24.905444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2478d-09b8-477c-8e4a-2ca890829bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:24.905723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2478d-09b8-477c-8e4a-2ca890829bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:24.917056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2478d-09b8-477c-8e4a-2ca890829bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:24.918442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2478d-09b8-477c-8e4a-2ca890829bd5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:24.919651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:24.936069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a82a8-e135-4830-bf7a-8fc59251d80f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-1ee2478d-09b8-477c-8e4a-2ca890829bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:24.936528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:24.937425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:24.938326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:24.938326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:24.938326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:24.938326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:24.938326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 406/803] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:24.938596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2478d-09b8-477c-8e4a-2ca890829bd5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:24.980859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d16c8e-3fe3-45df-b202-dad094ddd05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:24.981560 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d16c8e-3fe3-45df-b202-dad094ddd05e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:24.981936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d16c8e-3fe3-45df-b202-dad094ddd05e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:24.982221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d16c8e-3fe3-45df-b202-dad094ddd05e None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:24.982952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d16c8e-3fe3-45df-b202-dad094ddd05e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:24.983265 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d16c8e-3fe3-45df-b202-dad094ddd05e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:24.984647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d16c8e-3fe3-45df-b202-dad094ddd05e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:24.996196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 398/804] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:24.997600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef9bc3-b402-480a-a337-8ceff6e89a5c None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:24.997895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef9bc3-b402-480a-a337-8ceff6e89a5c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:24.998180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef9bc3-b402-480a-a337-8ceff6e89a5c None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:24.999561 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 399/805] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:25.000117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef9bc3-b402-480a-a337-8ceff6e89a5c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:25.041925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2478d-09b8-477c-8e4a-2ca890829bd5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:25.066854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:25.075959 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4a826-5077-4521-911f-b2efaecf9881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:25.079437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4a826-5077-4521-911f-b2efaecf9881 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.079437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4a826-5077-4521-911f-b2efaecf9881 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.079437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4a826-5077-4521-911f-b2efaecf9881 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.079437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4a826-5077-4521-911f-b2efaecf9881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:25.079437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4a826-5077-4521-911f-b2efaecf9881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:25.079955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4a826-5077-4521-911f-b2efaecf9881 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:25.091150 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 407/806] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:25.092465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a4b4-5c72-4409-ab47-c61e6fb1224a None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.092838 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a4b4-5c72-4409-ab47-c61e6fb1224a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.093109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8a4b4-5c72-4409-ab47-c61e6fb1224a None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.094346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 408/807] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:25.095033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a4b4-5c72-4409-ab47-c61e6fb1224a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:25.106232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef9bc3-b402-480a-a337-8ceff6e89a5c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:25.140391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18595fe6-4fe3-4163-86ee-8a8829c38a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:25.141067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595fe6-4fe3-4163-86ee-8a8829c38a49 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.141353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595fe6-4fe3-4163-86ee-8a8829c38a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.141642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18595fe6-4fe3-4163-86ee-8a8829c38a49 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.142341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18595fe6-4fe3-4163-86ee-8a8829c38a49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:25.142646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18595fe6-4fe3-4163-86ee-8a8829c38a49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:25.144007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18595fe6-4fe3-4163-86ee-8a8829c38a49 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:25.155142 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 400/808] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:25.156341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6ee39-fbd3-4974-b548-c43e8b6e6f02 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.156637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6ee39-fbd3-4974-b548-c43e8b6e6f02 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.157101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6ee39-fbd3-4974-b548-c43e8b6e6f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.162595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:25.173047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-06d6ee39-fbd3-4974-b548-c43e8b6e6f02 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:25.174187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-06d6ee39-fbd3-4974-b548-c43e8b6e6f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:25.194901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8a4b4-5c72-4409-ab47-c61e6fb1224a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:25.228211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1043f-45c3-4dae-ae36-768b6142d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:25.229033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1043f-45c3-4dae-ae36-768b6142d91f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.229317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1043f-45c3-4dae-ae36-768b6142d91f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.229599 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1043f-45c3-4dae-ae36-768b6142d91f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.236782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1043f-45c3-4dae-ae36-768b6142d91f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:25.238259 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1043f-45c3-4dae-ae36-768b6142d91f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:25.240293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 401/809] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:25.241139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6ee39-fbd3-4974-b548-c43e8b6e6f02 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6ab1043f-45c3-4dae-ae36-768b6142d91f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:25.253157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:25.254241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:25.255384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:25.255384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:25.255384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:25.255384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:25.255384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:25.255384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:25.255384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:25.255384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:25.255384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 409/810] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:25.255976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71bdf7-e84a-4144-add9-9f6ca1fca8ec None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.255976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71bdf7-e84a-4144-add9-9f6ca1fca8ec None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.256123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71bdf7-e84a-4144-add9-9f6ca1fca8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.275862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2e71bdf7-e84a-4144-add9-9f6ca1fca8ec None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:25.277076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2e71bdf7-e84a-4144-add9-9f6ca1fca8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:25.319050 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:25.343539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6ee39-fbd3-4974-b548-c43e8b6e6f02 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:25.343694 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 410/811] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:25.344543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71bdf7-e84a-4144-add9-9f6ca1fca8ec None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:25.383178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2021c-d1aa-4d91-a5aa-02a507423050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:25.383975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2021c-d1aa-4d91-a5aa-02a507423050 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.384264 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2021c-d1aa-4d91-a5aa-02a507423050 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.384545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2021c-d1aa-4d91-a5aa-02a507423050 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.386530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:25.393028 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2021c-d1aa-4d91-a5aa-02a507423050 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:25.394575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2021c-d1aa-4d91-a5aa-02a507423050 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-94c2021c-d1aa-4d91-a5aa-02a507423050 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:25.415761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:25.417321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:25.418254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:25.418254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:25.418254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:25.418254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:25.418254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:25.418254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:25.418254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:25.418254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:25.418254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:52:25.418254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:25.418254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 402/812] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 23 12:52:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:25.418254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2021c-d1aa-4d91-a5aa-02a507423050 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:25.454309 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71bdf7-e84a-4144-add9-9f6ca1fca8ec None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:25.488230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc22ee-cc6b-45b7-b766-ffe0974c8594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:25.489060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc22ee-cc6b-45b7-b766-ffe0974c8594 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.489345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc22ee-cc6b-45b7-b766-ffe0974c8594 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.489620 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc22ee-cc6b-45b7-b766-ffe0974c8594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.496248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc22ee-cc6b-45b7-b766-ffe0974c8594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:25.498257 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc22ee-cc6b-45b7-b766-ffe0974c8594 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-85bc22ee-cc6b-45b7-b766-ffe0974c8594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:25.513030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:25.514190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:25.515078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:25.515078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:25.515078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:25.515078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:25.515078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:25.515078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:25.515078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:25.515078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:25.515078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 411/813] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:25.515864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc22ee-cc6b-45b7-b766-ffe0974c8594 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:25.525969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2021c-d1aa-4d91-a5aa-02a507423050 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:25.550377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:25.560385 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ddab0-3892-4173-8a50-0368cabd7211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:25.561222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ddab0-3892-4173-8a50-0368cabd7211 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.561503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ddab0-3892-4173-8a50-0368cabd7211 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.561780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ddab0-3892-4173-8a50-0368cabd7211 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.562566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ddab0-3892-4173-8a50-0368cabd7211 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:25.565968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ddab0-3892-4173-8a50-0368cabd7211 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:25.565968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ddab0-3892-4173-8a50-0368cabd7211 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:25.576688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 403/814] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:25.577503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ddab0-3892-4173-8a50-0368cabd7211 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:25.615053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc22ee-cc6b-45b7-b766-ffe0974c8594 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:25.634218 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:25.649193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837399a3-26c3-4a80-a1d1-09cede8fcbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:25.650022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837399a3-26c3-4a80-a1d1-09cede8fcbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.650306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837399a3-26c3-4a80-a1d1-09cede8fcbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.650579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837399a3-26c3-4a80-a1d1-09cede8fcbd5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.651235 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837399a3-26c3-4a80-a1d1-09cede8fcbd5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:25.652730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837399a3-26c3-4a80-a1d1-09cede8fcbd5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-837399a3-26c3-4a80-a1d1-09cede8fcbd5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:25.665209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:25.666336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:25.667174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 412/815] 10.222.0.16 () {56 vars in 1129 bytes} [Thu Jun 23 12:52:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:25.668014 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837399a3-26c3-4a80-a1d1-09cede8fcbd5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:25.681195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ddab0-3892-4173-8a50-0368cabd7211 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:25.714342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d452b-8e6c-4afc-ad74-e5408d9bb84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:25.715067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d452b-8e6c-4afc-ad74-e5408d9bb84b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.715433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d452b-8e6c-4afc-ad74-e5408d9bb84b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.715760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d452b-8e6c-4afc-ad74-e5408d9bb84b None admin] PATH_INFO: `/v3/services/network` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.716417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d452b-8e6c-4afc-ad74-e5408d9bb84b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:25.717818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d452b-8e6c-4afc-ad74-e5408d9bb84b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-3a1d452b-8e6c-4afc-ad74-e5408d9bb84b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:25.729285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:25.730433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:25.736921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 404/816] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:25 2022] GET /identity/v3/services/network => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:25.737753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d452b-8e6c-4afc-ad74-e5408d9bb84b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:25.764277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:25.767318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837399a3-26c3-4a80-a1d1-09cede8fcbd5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:25.799869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87251dc-9b12-4aad-bc71-da6d86857582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:25.800538 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87251dc-9b12-4aad-bc71-da6d86857582 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.800840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87251dc-9b12-4aad-bc71-da6d86857582 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.801123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87251dc-9b12-4aad-bc71-da6d86857582 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.801961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87251dc-9b12-4aad-bc71-da6d86857582 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:25.802268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87251dc-9b12-4aad-bc71-da6d86857582 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:25.803699 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87251dc-9b12-4aad-bc71-da6d86857582 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:25.821726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 413/817] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 23 12:52:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:25.827476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87251dc-9b12-4aad-bc71-da6d86857582 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:25.830188 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d452b-8e6c-4afc-ad74-e5408d9bb84b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:25.847056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:25.868899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60852ace-d88e-4fb4-8640-e7b900d88c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:25.869648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60852ace-d88e-4fb4-8640-e7b900d88c4c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.870002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60852ace-d88e-4fb4-8640-e7b900d88c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.870356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60852ace-d88e-4fb4-8640-e7b900d88c4c None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.871225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60852ace-d88e-4fb4-8640-e7b900d88c4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:25.872174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60852ace-d88e-4fb4-8640-e7b900d88c4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:25.873667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60852ace-d88e-4fb4-8640-e7b900d88c4c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:25.886365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 405/818] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:25.887033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60852ace-d88e-4fb4-8640-e7b900d88c4c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:25.931989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87251dc-9b12-4aad-bc71-da6d86857582 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:25.965828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943140e-1f76-4fe4-a307-10097bc306df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:25.966652 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943140e-1f76-4fe4-a307-10097bc306df None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:25.966927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943140e-1f76-4fe4-a307-10097bc306df None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:25.967198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943140e-1f76-4fe4-a307-10097bc306df None admin] PATH_INFO: `/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/599a53720ecd4e729a6720a85b653eb0/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:25.969191 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943140e-1f76-4fe4-a307-10097bc306df None admin] RBAC: Authorizing `identity:create_grant(project_id=66de76d7ea7a45a6b698f8b1295c66c3, user_id=599a53720ecd4e729a6720a85b653eb0, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:25.970617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943140e-1f76-4fe4-a307-10097bc306df None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:25.989316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60852ace-d88e-4fb4-8640-e7b900d88c4c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:26.022148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83c51e-1cc3-4fac-92ee-37fdb15028d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:26.022800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83c51e-1cc3-4fac-92ee-37fdb15028d1 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:26.023083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83c51e-1cc3-4fac-92ee-37fdb15028d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:26.023355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83c51e-1cc3-4fac-92ee-37fdb15028d1 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:26.024066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83c51e-1cc3-4fac-92ee-37fdb15028d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:26.024366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83c51e-1cc3-4fac-92ee-37fdb15028d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:26.025752 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83c51e-1cc3-4fac-92ee-37fdb15028d1 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:26.030705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 406/819] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jun 23 12:52:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:26.031552 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83c51e-1cc3-4fac-92ee-37fdb15028d1 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:26.061284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 414/820] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:25 2022] PUT /identity/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/599a53720ecd4e729a6720a85b653eb0/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:26.062100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943140e-1f76-4fe4-a307-10097bc306df None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:26.078956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:26.082636 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:26.144667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83c51e-1cc3-4fac-92ee-37fdb15028d1 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:26.179090 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943140e-1f76-4fe4-a307-10097bc306df None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:26.185367 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2508-294c-4c89-89d3-64e4f121ec6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:26.186048 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2508-294c-4c89-89d3-64e4f121ec6e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:26.186333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2508-294c-4c89-89d3-64e4f121ec6e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:26.186613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2508-294c-4c89-89d3-64e4f121ec6e None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:26.187428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a2508-294c-4c89-89d3-64e4f121ec6e None admin] RBAC: Adding query filter params (name=network) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:26.187736 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a2508-294c-4c89-89d3-64e4f121ec6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:26.189228 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a2508-294c-4c89-89d3-64e4f121ec6e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:26.195180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 407/821] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:26.196020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2508-294c-4c89-89d3-64e4f121ec6e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:26.227638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa0b14-0c62-4afb-9305-04c2dac13ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:26.228396 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa0b14-0c62-4afb-9305-04c2dac13ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:26.228975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa0b14-0c62-4afb-9305-04c2dac13ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:26.229066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa0b14-0c62-4afb-9305-04c2dac13ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:26.304786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa0b14-0c62-4afb-9305-04c2dac13ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:26.306312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa0b14-0c62-4afb-9305-04c2dac13ef6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:26.307224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2508-294c-4c89-89d3-64e4f121ec6e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:26.315319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:26.326361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:26.343179 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6be74-e768-4ba1-a21c-9b23e089a979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:26.344145 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6be74-e768-4ba1-a21c-9b23e089a979 None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:26.344492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6be74-e768-4ba1-a21c-9b23e089a979 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:26.344855 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6be74-e768-4ba1-a21c-9b23e089a979 None admin] PATH_INFO: `/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/6af4358779f947acade2ed0293893b89/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:26.361099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6be74-e768-4ba1-a21c-9b23e089a979 None admin] RBAC: Authorizing `identity:create_grant(project_id=66de76d7ea7a45a6b698f8b1295c66c3, user_id=6af4358779f947acade2ed0293893b89, role_id=66cfaff0c6ec455aa7274a8b8d1f8aaf)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:26.362807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a6be74-e768-4ba1-a21c-9b23e089a979 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:26.410729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 415/822] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:52:26.411660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa0b14-0c62-4afb-9305-04c2dac13ef6 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:26.432721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 408/823] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:26 2022] PUT /identity/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/6af4358779f947acade2ed0293893b89/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:52:26.434681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6be74-e768-4ba1-a21c-9b23e089a979 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:26.532658 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa0b14-0c62-4afb-9305-04c2dac13ef6 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:26.558026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:26.565450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6be74-e768-4ba1-a21c-9b23e089a979 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:26.579731 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9168e-b0be-4e00-a521-3681def8d661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:26.580865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9168e-b0be-4e00-a521-3681def8d661 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:26.581127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9168e-b0be-4e00-a521-3681def8d661 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:26.581412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9168e-b0be-4e00-a521-3681def8d661 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:26.582240 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9168e-b0be-4e00-a521-3681def8d661 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:26.582630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9168e-b0be-4e00-a521-3681def8d661 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:26.584238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9168e-b0be-4e00-a521-3681def8d661 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:26.596590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 416/824] 10.222.0.16 () {56 vars in 1124 bytes} [Thu Jun 23 12:52:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:26.596590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9168e-b0be-4e00-a521-3681def8d661 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:26.624137 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514960-c502-437e-946a-5353c4f70961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:26.625131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514960-c502-437e-946a-5353c4f70961 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:26.625565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514960-c502-437e-946a-5353c4f70961 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:26.625980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83514960-c502-437e-946a-5353c4f70961 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:26.626827 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83514960-c502-437e-946a-5353c4f70961 None admin] RBAC: Adding query filter params (type=network) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:26.627301 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83514960-c502-437e-946a-5353c4f70961 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:26.628917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83514960-c502-437e-946a-5353c4f70961 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:26.635886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 409/825] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:26.636855 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514960-c502-437e-946a-5353c4f70961 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:26.663461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:26.722486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9168e-b0be-4e00-a521-3681def8d661 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:26.753558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83514960-c502-437e-946a-5353c4f70961 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:26.768087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4297c56-8e63-4af1-a5e7-000c834d6850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:26.768952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4297c56-8e63-4af1-a5e7-000c834d6850 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:26.769293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4297c56-8e63-4af1-a5e7-000c834d6850 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:26.769580 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4297c56-8e63-4af1-a5e7-000c834d6850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:26.785082 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4297c56-8e63-4af1-a5e7-000c834d6850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:26.787745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4297c56-8e63-4af1-a5e7-000c834d6850 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:26.803864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941466ce-7dae-4236-a9c7-36871d1add98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:26.804582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941466ce-7dae-4236-a9c7-36871d1add98 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:26.804914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941466ce-7dae-4236-a9c7-36871d1add98 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:26.805200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941466ce-7dae-4236-a9c7-36871d1add98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:26.806008 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941466ce-7dae-4236-a9c7-36871d1add98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:26.807435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941466ce-7dae-4236-a9c7-36871d1add98 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-f4297c56-8e63-4af1-a5e7-000c834d6850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:26.810713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:26.811583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:26.812482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:26.812482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:26.812482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:26.812482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:26.819131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 417/826] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:26.820271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4297c56-8e63-4af1-a5e7-000c834d6850 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:26.857410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:26.926006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4297c56-8e63-4af1-a5e7-000c834d6850 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:26.947715 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 410/827] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 23 12:52:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:26.947715 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941466ce-7dae-4236-a9c7-36871d1add98 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:27.018474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea1030-dbc9-4f53-8ead-c8e7e52392a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:27.019297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea1030-dbc9-4f53-8ead-c8e7e52392a0 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:27.019582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea1030-dbc9-4f53-8ead-c8e7e52392a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:27.019866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea1030-dbc9-4f53-8ead-c8e7e52392a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:27.020633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea1030-dbc9-4f53-8ead-c8e7e52392a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:27.022078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea1030-dbc9-4f53-8ead-c8e7e52392a0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:27.075827 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:27.097194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 418/828] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 23 12:52:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:27.121151 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941466ce-7dae-4236-a9c7-36871d1add98 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:27.176929 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e28967-6b9d-4330-af06-d27c96d83c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:27.178053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e28967-6b9d-4330-af06-d27c96d83c88 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:27.178542 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e28967-6b9d-4330-af06-d27c96d83c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:27.179088 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e28967-6b9d-4330-af06-d27c96d83c88 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:27.180097 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e28967-6b9d-4330-af06-d27c96d83c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:27.180622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e28967-6b9d-4330-af06-d27c96d83c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:27.182306 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e28967-6b9d-4330-af06-d27c96d83c88 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:27.197918 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 411/829] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:27.205339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea1030-dbc9-4f53-8ead-c8e7e52392a0 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:27.307828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:27.323978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea1030-dbc9-4f53-8ead-c8e7e52392a0 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:27.364893 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450519a-5376-4b05-9e6a-ad1464af12d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:27.365687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450519a-5376-4b05-9e6a-ad1464af12d9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:27.365974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450519a-5376-4b05-9e6a-ad1464af12d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:27.366253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450519a-5376-4b05-9e6a-ad1464af12d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:27.375944 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450519a-5376-4b05-9e6a-ad1464af12d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:27.377446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450519a-5376-4b05-9e6a-ad1464af12d9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-b450519a-5376-4b05-9e6a-ad1464af12d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:27.391978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:27.392929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:27.393919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:27.393919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:27.393919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:27.393919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:27.393919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:27.393919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:27.393919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:27.393919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:27.393919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 419/830] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:27.401183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e28967-6b9d-4330-af06-d27c96d83c88 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:27.520762 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e28967-6b9d-4330-af06-d27c96d83c88 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:27.552237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:27.557928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691a816-0098-4c61-a66b-836b0958ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:27.558795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a816-0098-4c61-a66b-836b0958ad44 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:27.559699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a816-0098-4c61-a66b-836b0958ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:27.559980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a816-0098-4c61-a66b-836b0958ad44 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:27.560786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691a816-0098-4c61-a66b-836b0958ad44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:27.561124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691a816-0098-4c61-a66b-836b0958ad44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:27.562799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691a816-0098-4c61-a66b-836b0958ad44 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:27.575440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 412/831] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:27.581378 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450519a-5376-4b05-9e6a-ad1464af12d9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:27.693284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450519a-5376-4b05-9e6a-ad1464af12d9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:27.729746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e73fde-c8b5-4f8b-b967-66507b5bd817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:27.730833 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e73fde-c8b5-4f8b-b967-66507b5bd817 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:27.731333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e73fde-c8b5-4f8b-b967-66507b5bd817 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:27.731922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e73fde-c8b5-4f8b-b967-66507b5bd817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:27.733003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e73fde-c8b5-4f8b-b967-66507b5bd817 None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=703c2c40fe434402817a8824c2756ee7) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:27.733527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e73fde-c8b5-4f8b-b967-66507b5bd817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:27.735165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e73fde-c8b5-4f8b-b967-66507b5bd817 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:27.742212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 420/832] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:27 2022] GET /identity/v3/role_assignments?user.id=703c2c40fe434402817a8824c2756ee7&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:28.144536 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddfc86-d62a-44ca-8f1c-2c0acb80e691 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:28.144936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddfc86-d62a-44ca-8f1c-2c0acb80e691 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:28.145160 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ddfc86-d62a-44ca-8f1c-2c0acb80e691 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:28.146760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 413/833] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:28.151940 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98533535-cff6-4f24-bd7e-99507ef6e379 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:28.152241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98533535-cff6-4f24-bd7e-99507ef6e379 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:28.152528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98533535-cff6-4f24-bd7e-99507ef6e379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:28.170743 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-98533535-cff6-4f24-bd7e-99507ef6e379 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:28.171949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-98533535-cff6-4f24-bd7e-99507ef6e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:28.174896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:28.244441 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 421/834] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:28.268560 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddfc86-d62a-44ca-8f1c-2c0acb80e691 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:28.380527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ddfc86-d62a-44ca-8f1c-2c0acb80e691 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:28.417769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20823f-b574-407a-b938-3173d80d297f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:28.419181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20823f-b574-407a-b938-3173d80d297f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:28.419692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20823f-b574-407a-b938-3173d80d297f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:28.420170 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20823f-b574-407a-b938-3173d80d297f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:28.432607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20823f-b574-407a-b938-3173d80d297f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-4b20823f-b574-407a-b938-3173d80d297f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:28.441754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:28.442769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:28.443596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:28.443596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:28.443596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:28.443596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:28.443596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:28.443596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:28.443596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:28.443596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:28.443596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:28.443596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:28.443596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:28.443596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:28.446430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 414/835] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:28.453182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98533535-cff6-4f24-bd7e-99507ef6e379 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:28.565660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98533535-cff6-4f24-bd7e-99507ef6e379 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:28.601876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc72b76-3ccb-449a-9645-fec3b0f48ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:28.602896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc72b76-3ccb-449a-9645-fec3b0f48ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:28.603416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc72b76-3ccb-449a-9645-fec3b0f48ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:28.603897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc72b76-3ccb-449a-9645-fec3b0f48ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:28.604864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc72b76-3ccb-449a-9645-fec3b0f48ce8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:28.605380 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc72b76-3ccb-449a-9645-fec3b0f48ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:28.607516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc72b76-3ccb-449a-9645-fec3b0f48ce8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:28.616554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 422/836] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:28.625841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20823f-b574-407a-b938-3173d80d297f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:28.638172 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27930913-58c6-471b-84bd-eae3fd76f3f1 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:28.638453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27930913-58c6-471b-84bd-eae3fd76f3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:28.638992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27930913-58c6-471b-84bd-eae3fd76f3f1 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:28.640594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 423/837] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:28.645403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b5d5d-5696-4947-8b33-2af1ebfded44 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:28.645696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b5d5d-5696-4947-8b33-2af1ebfded44 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:28.646304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b5d5d-5696-4947-8b33-2af1ebfded44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:28.651103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:28.663273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2c7b5d5d-5696-4947-8b33-2af1ebfded44 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:28.667999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2c7b5d5d-5696-4947-8b33-2af1ebfded44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:28.701070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:28.741078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 424/838] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:28.760267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20823f-b574-407a-b938-3173d80d297f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:28.762454 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b5d5d-5696-4947-8b33-2af1ebfded44 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:28.800847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236491c-9263-456d-b552-8844cd9341c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:28.801975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236491c-9263-456d-b552-8844cd9341c5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:28.802441 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236491c-9263-456d-b552-8844cd9341c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:28.802975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236491c-9263-456d-b552-8844cd9341c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:28.814898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236491c-9263-456d-b552-8844cd9341c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:28.816623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236491c-9263-456d-b552-8844cd9341c5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-f236491c-9263-456d-b552-8844cd9341c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:28.836690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:28.837654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:28.838544 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:28.838544 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:28.838544 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:28.838544 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:28.841111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 415/839] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:28.846257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236491c-9263-456d-b552-8844cd9341c5 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:28.872044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b5d5d-5696-4947-8b33-2af1ebfded44 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:28.911978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:28.924634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5f47a-62c9-462b-9ed8-b8576c68553b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:28.924634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5f47a-62c9-462b-9ed8-b8576c68553b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:28.924634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5f47a-62c9-462b-9ed8-b8576c68553b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:28.924634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5f47a-62c9-462b-9ed8-b8576c68553b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:28.938059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5f47a-62c9-462b-9ed8-b8576c68553b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-d5c5f47a-62c9-462b-9ed8-b8576c68553b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:28.947562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:28.948525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:28.949385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 425/840] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:52:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:28.956498 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5f47a-62c9-462b-9ed8-b8576c68553b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:28.976875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236491c-9263-456d-b552-8844cd9341c5 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:28.980393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:29.015902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631db04-da98-4c2c-9612-48cb326fb998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:29.017024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631db04-da98-4c2c-9612-48cb326fb998 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.017518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631db04-da98-4c2c-9612-48cb326fb998 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.018002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631db04-da98-4c2c-9612-48cb326fb998 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.018950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631db04-da98-4c2c-9612-48cb326fb998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:29.019585 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631db04-da98-4c2c-9612-48cb326fb998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:29.021413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631db04-da98-4c2c-9612-48cb326fb998 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:29.034432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 416/841] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:29.039800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631db04-da98-4c2c-9612-48cb326fb998 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:29.084388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5f47a-62c9-462b-9ed8-b8576c68553b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:29.122270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74ed1e-a344-4923-97d9-d5773ca0a795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:29.123041 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74ed1e-a344-4923-97d9-d5773ca0a795 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.123333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74ed1e-a344-4923-97d9-d5773ca0a795 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.123614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74ed1e-a344-4923-97d9-d5773ca0a795 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.124366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74ed1e-a344-4923-97d9-d5773ca0a795 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:29.124676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74ed1e-a344-4923-97d9-d5773ca0a795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:29.126098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74ed1e-a344-4923-97d9-d5773ca0a795 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:29.140056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 426/842] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:52:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:29.140975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74ed1e-a344-4923-97d9-d5773ca0a795 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:29.171525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631db04-da98-4c2c-9612-48cb326fb998 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:29.207112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a570-39ef-47b2-b688-74e387037baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:29.207934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a570-39ef-47b2-b688-74e387037baa None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.208162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:29.208268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a570-39ef-47b2-b688-74e387037baa None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.208491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a570-39ef-47b2-b688-74e387037baa None admin] PATH_INFO: `/v3/users/swift` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.217306 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138a570-39ef-47b2-b688-74e387037baa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:29.218824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138a570-39ef-47b2-b688-74e387037baa None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-4138a570-39ef-47b2-b688-74e387037baa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:29.233977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:29.239512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:29.240728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:29.240728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:29.240728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:29.240728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:29.240728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:29.240728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:29.240728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:29.240728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:29.240728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 12:52:29.240728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:29.240728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 417/843] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:29.242636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a570-39ef-47b2-b688-74e387037baa None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:29.265512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74ed1e-a344-4923-97d9-d5773ca0a795 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:29.277156 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:29.309958 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dff114-5214-45a9-a94e-b0ad4cf190ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:29.310928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dff114-5214-45a9-a94e-b0ad4cf190ac None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.311329 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dff114-5214-45a9-a94e-b0ad4cf190ac None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.311756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dff114-5214-45a9-a94e-b0ad4cf190ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.326151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dff114-5214-45a9-a94e-b0ad4cf190ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:29.328362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dff114-5214-45a9-a94e-b0ad4cf190ac None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-83dff114-5214-45a9-a94e-b0ad4cf190ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:29.349930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:29.351016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:29.351931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:29.351931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:29.351931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:29.351931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:29.352875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 427/844] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:29.357875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dff114-5214-45a9-a94e-b0ad4cf190ac None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:29.372097 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a570-39ef-47b2-b688-74e387037baa None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:29.408700 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa0d89-76f1-48cd-952e-3a8760cb7d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:29.409410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa0d89-76f1-48cd-952e-3a8760cb7d40 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.409693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa0d89-76f1-48cd-952e-3a8760cb7d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.409974 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa0d89-76f1-48cd-952e-3a8760cb7d40 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.410817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa0d89-76f1-48cd-952e-3a8760cb7d40 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:29.411129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa0d89-76f1-48cd-952e-3a8760cb7d40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:29.412566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa0d89-76f1-48cd-952e-3a8760cb7d40 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:29.435754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 418/845] 10.222.0.16 () {56 vars in 1135 bytes} [Thu Jun 23 12:52:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:29.437015 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e711082-26e8-41cb-b6e1-98ebadab8de2 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.437309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e711082-26e8-41cb-b6e1-98ebadab8de2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.437588 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e711082-26e8-41cb-b6e1-98ebadab8de2 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.438965 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 419/846] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:29.442037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e711082-26e8-41cb-b6e1-98ebadab8de2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:29.479289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dff114-5214-45a9-a94e-b0ad4cf190ac None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:29.487886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:29.516816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89022f42-a4b8-4664-bb14-eb3d63aab379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:29.517528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89022f42-a4b8-4664-bb14-eb3d63aab379 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.517869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89022f42-a4b8-4664-bb14-eb3d63aab379 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.518149 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89022f42-a4b8-4664-bb14-eb3d63aab379 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.518997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89022f42-a4b8-4664-bb14-eb3d63aab379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:29.519311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89022f42-a4b8-4664-bb14-eb3d63aab379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:29.520730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89022f42-a4b8-4664-bb14-eb3d63aab379 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:29.535466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 428/847] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:29.536830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c87354-15bd-4122-9b36-aa6bdc35951a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.537202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c87354-15bd-4122-9b36-aa6bdc35951a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.537494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c87354-15bd-4122-9b36-aa6bdc35951a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.540303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:29.554714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-66c87354-15bd-4122-9b36-aa6bdc35951a None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:29.555915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-66c87354-15bd-4122-9b36-aa6bdc35951a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:29.562009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e711082-26e8-41cb-b6e1-98ebadab8de2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:29.597606 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0397ed-64bb-4bb5-9024-e3e6c245fd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:29.598254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0397ed-64bb-4bb5-9024-e3e6c245fd06 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.598534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0397ed-64bb-4bb5-9024-e3e6c245fd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.598810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0397ed-64bb-4bb5-9024-e3e6c245fd06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.630112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 429/848] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:29.631286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c87354-15bd-4122-9b36-aa6bdc35951a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:29.685665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0397ed-64bb-4bb5-9024-e3e6c245fd06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:29.687536 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0397ed-64bb-4bb5-9024-e3e6c245fd06 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:29.732366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:29.738886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c87354-15bd-4122-9b36-aa6bdc35951a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:29.772934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:29.774490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c503bb-b537-4ca3-9e86-c87a8c610edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:29.775339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c503bb-b537-4ca3-9e86-c87a8c610edd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.775626 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c503bb-b537-4ca3-9e86-c87a8c610edd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.775903 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c503bb-b537-4ca3-9e86-c87a8c610edd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.783799 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c503bb-b537-4ca3-9e86-c87a8c610edd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:29.785282 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c503bb-b537-4ca3-9e86-c87a8c610edd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:29.793447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 420/849] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:29 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:52:29.794607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0397ed-64bb-4bb5-9024-e3e6c245fd06 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-f8c503bb-b537-4ca3-9e86-c87a8c610edd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:29.800280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:29.801446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:29.802862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:29.802862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:29.802862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:29.802862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:29.802862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:29.802862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:29.802862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:29.802862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:29.802862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:52:29.802862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:29.802862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 430/850] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 23 12:52:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:29.802862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c503bb-b537-4ca3-9e86-c87a8c610edd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:29.911903 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c503bb-b537-4ca3-9e86-c87a8c610edd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:29.912128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0397ed-64bb-4bb5-9024-e3e6c245fd06 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:29.945284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17266635-c0a4-462a-be2b-0dd8bdec45a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:29.945661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6963f-0ba2-4b3c-9ec1-17172c093120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:29.946080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266635-c0a4-462a-be2b-0dd8bdec45a1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.946366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266635-c0a4-462a-be2b-0dd8bdec45a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.946471 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6963f-0ba2-4b3c-9ec1-17172c093120 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.946644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17266635-c0a4-462a-be2b-0dd8bdec45a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.946735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6963f-0ba2-4b3c-9ec1-17172c093120 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.946988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6963f-0ba2-4b3c-9ec1-17172c093120 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.947641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6963f-0ba2-4b3c-9ec1-17172c093120 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:29.949059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6963f-0ba2-4b3c-9ec1-17172c093120 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:29.957982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17266635-c0a4-462a-be2b-0dd8bdec45a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:29.959408 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17266635-c0a4-462a-be2b-0dd8bdec45a1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-04d6963f-0ba2-4b3c-9ec1-17172c093120 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:29.961521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:29.962573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:29.963497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 421/851] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:29.964341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6963f-0ba2-4b3c-9ec1-17172c093120 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-17266635-c0a4-462a-be2b-0dd8bdec45a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:29.978242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:29.979630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:29.981169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:29.981169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:29.981169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:29.981169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:29.984074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 431/852] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:29.985381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb0b2c-41ed-4f2c-b376-e1093eb0ec09 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:29.985671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb0b2c-41ed-4f2c-b376-e1093eb0ec09 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:29.985951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb0b2c-41ed-4f2c-b376-e1093eb0ec09 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:29.987231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 432/853] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:29.987922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb0b2c-41ed-4f2c-b376-e1093eb0ec09 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:29.999943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:30.013921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:30.065902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6963f-0ba2-4b3c-9ec1-17172c093120 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:30.089426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb0b2c-41ed-4f2c-b376-e1093eb0ec09 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:30.100504 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f5e65-cc6d-44a1-ada3-1f1622cf3c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:30.101195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f5e65-cc6d-44a1-ada3-1f1622cf3c6d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:30.101482 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f5e65-cc6d-44a1-ada3-1f1622cf3c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:30.101766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f5e65-cc6d-44a1-ada3-1f1622cf3c6d None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:30.102609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f5e65-cc6d-44a1-ada3-1f1622cf3c6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:30.102922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f5e65-cc6d-44a1-ada3-1f1622cf3c6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:30.104384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913f5e65-cc6d-44a1-ada3-1f1622cf3c6d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:30.122525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 422/854] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jun 23 12:52:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:30.122748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4658a20-2958-4986-8258-1ec214666696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:30.123319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f5e65-cc6d-44a1-ada3-1f1622cf3c6d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:30.123420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4658a20-2958-4986-8258-1ec214666696 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:30.123718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4658a20-2958-4986-8258-1ec214666696 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:30.124061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4658a20-2958-4986-8258-1ec214666696 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:30.124706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4658a20-2958-4986-8258-1ec214666696 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:30.125042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4658a20-2958-4986-8258-1ec214666696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:30.126410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4658a20-2958-4986-8258-1ec214666696 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:30.135453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 433/855] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:30.135453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb11fe9-dbc4-45c5-94d4-c81517653c65 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:30.135453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb11fe9-dbc4-45c5-94d4-c81517653c65 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:30.135453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb11fe9-dbc4-45c5-94d4-c81517653c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:30.150444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6fb11fe9-dbc4-45c5-94d4-c81517653c65 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:30.151648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6fb11fe9-dbc4-45c5-94d4-c81517653c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:30.218116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 434/856] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:30.218947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb11fe9-dbc4-45c5-94d4-c81517653c65 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:30.221093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:30.224901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f5e65-cc6d-44a1-ada3-1f1622cf3c6d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:30.227938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:30.262391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdc351-3075-49c3-b085-23c15728276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:30.263111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdc351-3075-49c3-b085-23c15728276d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:30.263400 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdc351-3075-49c3-b085-23c15728276d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:30.263930 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdc351-3075-49c3-b085-23c15728276d None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:30.264687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdc351-3075-49c3-b085-23c15728276d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:30.265028 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdc351-3075-49c3-b085-23c15728276d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:30.266414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdc351-3075-49c3-b085-23c15728276d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:30.282927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 423/857] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:30.282927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdc351-3075-49c3-b085-23c15728276d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:30.334824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb11fe9-dbc4-45c5-94d4-c81517653c65 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:30.368318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cdc43-c125-41d2-ad48-0ea3cb064773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:30.368994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cdc43-c125-41d2-ad48-0ea3cb064773 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:30.369286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cdc43-c125-41d2-ad48-0ea3cb064773 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:30.369564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cdc43-c125-41d2-ad48-0ea3cb064773 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:30.381393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdc351-3075-49c3-b085-23c15728276d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:30.414723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b6042-0a5b-444f-b897-b3e5cac043c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:30.415438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b6042-0a5b-444f-b897-b3e5cac043c5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:30.415723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b6042-0a5b-444f-b897-b3e5cac043c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:30.416001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b6042-0a5b-444f-b897-b3e5cac043c5 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:30.416709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b6042-0a5b-444f-b897-b3e5cac043c5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:30.417051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b6042-0a5b-444f-b897-b3e5cac043c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:30.418954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b6042-0a5b-444f-b897-b3e5cac043c5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:30.423479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 424/858] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:30 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:30.424420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b6042-0a5b-444f-b897-b3e5cac043c5 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:30.439491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cdc43-c125-41d2-ad48-0ea3cb064773 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:30.441014 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cdc43-c125-41d2-ad48-0ea3cb064773 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:30.443342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:30.457750 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:30.539850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b6042-0a5b-444f-b897-b3e5cac043c5 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:30.559393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 435/859] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:52:30.560278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cdc43-c125-41d2-ad48-0ea3cb064773 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:30.587025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e792c-2f77-41ae-bd25-cdbde9a0fbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:30.587846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e792c-2f77-41ae-bd25-cdbde9a0fbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:30.588127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e792c-2f77-41ae-bd25-cdbde9a0fbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:30.588420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e792c-2f77-41ae-bd25-cdbde9a0fbd9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:30.589095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e792c-2f77-41ae-bd25-cdbde9a0fbd9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:30.591043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e792c-2f77-41ae-bd25-cdbde9a0fbd9 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-e41e792c-2f77-41ae-bd25-cdbde9a0fbd9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:30.603323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:30.604295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:30.605682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 425/860] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Jun 23 12:52:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:30.606677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e792c-2f77-41ae-bd25-cdbde9a0fbd9 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:30.675384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cdc43-c125-41d2-ad48-0ea3cb064773 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:30.677165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:30.712813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759d29c-e279-49b3-8aee-25024bd2530f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:30.713630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759d29c-e279-49b3-8aee-25024bd2530f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:30.713912 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759d29c-e279-49b3-8aee-25024bd2530f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:30.714188 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759d29c-e279-49b3-8aee-25024bd2530f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:30.721214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759d29c-e279-49b3-8aee-25024bd2530f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:30.722663 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759d29c-e279-49b3-8aee-25024bd2530f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:30.732457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-8759d29c-e279-49b3-8aee-25024bd2530f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:30.737440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:30.738487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:30.744247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:30.744247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:30.744247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:30.744247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:30.744247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:30.744247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:30.744247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:30.744247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:30.744247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 436/861] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:30.744247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759d29c-e279-49b3-8aee-25024bd2530f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:30.749466 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e792c-2f77-41ae-bd25-cdbde9a0fbd9 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:30.785769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01862c8c-2397-4cd2-9903-797a208d75d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:30.786722 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862c8c-2397-4cd2-9903-797a208d75d4 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:30.787105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862c8c-2397-4cd2-9903-797a208d75d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:30.787481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862c8c-2397-4cd2-9903-797a208d75d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:30.798520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01862c8c-2397-4cd2-9903-797a208d75d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:30.799906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01862c8c-2397-4cd2-9903-797a208d75d4 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-01862c8c-2397-4cd2-9903-797a208d75d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:30.818085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:30.818995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:30.819917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:30.819917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:30.819917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:30.819917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:30.819917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 426/862] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:30.820622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01862c8c-2397-4cd2-9903-797a208d75d4 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:30.852654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759d29c-e279-49b3-8aee-25024bd2530f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:30.896590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4769e-b0b4-46d5-be09-c8d614dfc5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:30.897293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4769e-b0b4-46d5-be09-c8d614dfc5ee None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:30.897580 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4769e-b0b4-46d5-be09-c8d614dfc5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:30.897861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f4769e-b0b4-46d5-be09-c8d614dfc5ee None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:30.898574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4769e-b0b4-46d5-be09-c8d614dfc5ee None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:30.898887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4769e-b0b4-46d5-be09-c8d614dfc5ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:30.900253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f4769e-b0b4-46d5-be09-c8d614dfc5ee None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:30.905523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 437/863] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 23 12:52:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:30.907484 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4769e-b0b4-46d5-be09-c8d614dfc5ee None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:30.929379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01862c8c-2397-4cd2-9903-797a208d75d4 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:30.938913 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:30.966680 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926535da-0065-4044-a210-5837e5a56af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:30.967448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926535da-0065-4044-a210-5837e5a56af2 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:30.967746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926535da-0065-4044-a210-5837e5a56af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:30.968023 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926535da-0065-4044-a210-5837e5a56af2 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:30.968951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926535da-0065-4044-a210-5837e5a56af2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:30.969263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926535da-0065-4044-a210-5837e5a56af2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:30.970801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926535da-0065-4044-a210-5837e5a56af2 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:30.987917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 427/864] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:30.987917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926535da-0065-4044-a210-5837e5a56af2 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:30.988701 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:31.029701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f4769e-b0b4-46d5-be09-c8d614dfc5ee None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:31.071394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b57bc-6935-4759-81e1-7bc6b1db9ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:31.071982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b57bc-6935-4759-81e1-7bc6b1db9ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.072266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b57bc-6935-4759-81e1-7bc6b1db9ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.072959 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b57bc-6935-4759-81e1-7bc6b1db9ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.073700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b57bc-6935-4759-81e1-7bc6b1db9ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:31.074891 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b57bc-6935-4759-81e1-7bc6b1db9ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:31.076610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b57bc-6935-4759-81e1-7bc6b1db9ef3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:31.088708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 438/865] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:31.089537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b57bc-6935-4759-81e1-7bc6b1db9ef3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:31.101499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926535da-0065-4044-a210-5837e5a56af2 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:31.143717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0489484-7408-4a7a-bba2-3594943e5cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:31.144383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0489484-7408-4a7a-bba2-3594943e5cde None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.144672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0489484-7408-4a7a-bba2-3594943e5cde None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.144984 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0489484-7408-4a7a-bba2-3594943e5cde None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.145706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0489484-7408-4a7a-bba2-3594943e5cde None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:31.146015 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0489484-7408-4a7a-bba2-3594943e5cde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:31.147392 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0489484-7408-4a7a-bba2-3594943e5cde None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:31.152233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 428/866] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 23 12:52:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:31.153075 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0489484-7408-4a7a-bba2-3594943e5cde None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:31.207253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:31.229835 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b57bc-6935-4759-81e1-7bc6b1db9ef3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:31.233357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:31.270769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0489484-7408-4a7a-bba2-3594943e5cde None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:31.282355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c227345-a085-43c6-bb4e-630aa9384aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:31.283947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c227345-a085-43c6-bb4e-630aa9384aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.284901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c227345-a085-43c6-bb4e-630aa9384aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.285574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c227345-a085-43c6-bb4e-630aa9384aa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.286751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c227345-a085-43c6-bb4e-630aa9384aa5 None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=599a53720ecd4e729a6720a85b653eb0) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:31.287549 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c227345-a085-43c6-bb4e-630aa9384aa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:31.290135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c227345-a085-43c6-bb4e-630aa9384aa5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:31.300433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 439/867] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:31 2022] GET /identity/v3/role_assignments?user.id=599a53720ecd4e729a6720a85b653eb0&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:31.312129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b1d62-f873-412c-81e2-e749914ff0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:31.313125 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b1d62-f873-412c-81e2-e749914ff0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.313483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b1d62-f873-412c-81e2-e749914ff0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.313836 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b1d62-f873-412c-81e2-e749914ff0c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.322724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b1d62-f873-412c-81e2-e749914ff0c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:31.323850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b1d62-f873-412c-81e2-e749914ff0c4 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-732b1d62-f873-412c-81e2-e749914ff0c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:31.342370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:31.343590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:31.345666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:31.345666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:31.345666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:31.345666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:31.345666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:31.345666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:31.345666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:31.345666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:31.346370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 429/868] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:31.352708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c227345-a085-43c6-bb4e-630aa9384aa5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:31.470810 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c227345-a085-43c6-bb4e-630aa9384aa5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:31.511434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb34545-19f0-436d-929a-61afb416f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:31.522038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb34545-19f0-436d-929a-61afb416f263 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.522038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb34545-19f0-436d-929a-61afb416f263 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.522038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb34545-19f0-436d-929a-61afb416f263 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.522038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb34545-19f0-436d-929a-61afb416f263 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:31.522038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb34545-19f0-436d-929a-61afb416f263 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:31.522038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb34545-19f0-436d-929a-61afb416f263 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:31.528955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 440/869] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:31.535310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b1d62-f873-412c-81e2-e749914ff0c4 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:31.644765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b1d62-f873-412c-81e2-e749914ff0c4 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:31.672761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:31.680846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb263fd-021c-404f-8b24-dbbd8f46e199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:31.681591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb263fd-021c-404f-8b24-dbbd8f46e199 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:31.681882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb263fd-021c-404f-8b24-dbbd8f46e199 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:31.682157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb263fd-021c-404f-8b24-dbbd8f46e199 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:31.682992 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb263fd-021c-404f-8b24-dbbd8f46e199 None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=6af4358779f947acade2ed0293893b89) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:31.687839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb263fd-021c-404f-8b24-dbbd8f46e199 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:31.687839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb263fd-021c-404f-8b24-dbbd8f46e199 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:31.691880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 430/870] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:31 2022] GET /identity/v3/role_assignments?user.id=6af4358779f947acade2ed0293893b89&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:32.507741 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969287-7d56-4ea0-a49f-406d4292262b None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:32.513710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969287-7d56-4ea0-a49f-406d4292262b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:32.513710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f969287-7d56-4ea0-a49f-406d4292262b None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:32.513710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 441/871] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:32.516319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c02df-8db6-4867-b13e-ed64265247d4 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:32.516793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c02df-8db6-4867-b13e-ed64265247d4 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:32.516917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c02df-8db6-4867-b13e-ed64265247d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:32.535814 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-070c02df-8db6-4867-b13e-ed64265247d4 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:32.537038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-070c02df-8db6-4867-b13e-ed64265247d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:32.612913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 431/872] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:32.630959 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f969287-7d56-4ea0-a49f-406d4292262b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:32.644584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:32.741351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f969287-7d56-4ea0-a49f-406d4292262b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:32.778004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16368397-fa9c-47d0-9a55-ac6be56d455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:32.778867 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368397-fa9c-47d0-9a55-ac6be56d455d None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:32.779163 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368397-fa9c-47d0-9a55-ac6be56d455d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:32.779442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16368397-fa9c-47d0-9a55-ac6be56d455d None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:32.780482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16368397-fa9c-47d0-9a55-ac6be56d455d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:32.781906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16368397-fa9c-47d0-9a55-ac6be56d455d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:32.860669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 442/873] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:52:32 2022] POST /identity/v3/services => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:33.314473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08903d4d-df95-4539-9c74-686d2446f31f None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:33.314777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08903d4d-df95-4539-9c74-686d2446f31f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:33.315048 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08903d4d-df95-4539-9c74-686d2446f31f None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:33.316655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 432/874] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:33.321782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e1c7a-94cc-46cf-bbc0-4023884cf028 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:33.322070 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e1c7a-94cc-46cf-bbc0-4023884cf028 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:33.322346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e1c7a-94cc-46cf-bbc0-4023884cf028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:33.339490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ff2e1c7a-94cc-46cf-bbc0-4023884cf028 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:33.341029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ff2e1c7a-94cc-46cf-bbc0-4023884cf028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:33.406067 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:33.417531 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 443/875] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:33.440507 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08903d4d-df95-4539-9c74-686d2446f31f None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:33.514210 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574480d-f2c1-4d1c-8e47-aab37fa2703d None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:33.514779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574480d-f2c1-4d1c-8e47-aab37fa2703d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:33.514997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574480d-f2c1-4d1c-8e47-aab37fa2703d None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:33.516995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 444/876] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:33.522223 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc730d2-7c59-4f80-9872-8792a684315e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:33.522615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc730d2-7c59-4f80-9872-8792a684315e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:33.522992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc730d2-7c59-4f80-9872-8792a684315e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:33.540732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8cc730d2-7c59-4f80-9872-8792a684315e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:33.542069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8cc730d2-7c59-4f80-9872-8792a684315e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:33.562368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08903d4d-df95-4539-9c74-686d2446f31f None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:33.586107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:33.599143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f15ec1-27bb-4e5f-958c-008e28a6bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:33.600973 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f15ec1-27bb-4e5f-958c-008e28a6bd8d None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:33.600973 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f15ec1-27bb-4e5f-958c-008e28a6bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:33.600973 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f15ec1-27bb-4e5f-958c-008e28a6bd8d None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:33.601235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f15ec1-27bb-4e5f-958c-008e28a6bd8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:33.602571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f15ec1-27bb-4e5f-958c-008e28a6bd8d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:33.614183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 445/877] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:33.639160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc730d2-7c59-4f80-9872-8792a684315e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:33.681244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 433/878] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:52:33 2022] POST /identity/v3/services => generated 269 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:33.750370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc730d2-7c59-4f80-9872-8792a684315e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:33.780715 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:33.795958 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a996e-a353-4f7c-89d2-08be14bed787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:33.796784 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a996e-a353-4f7c-89d2-08be14bed787 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:33.797089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a996e-a353-4f7c-89d2-08be14bed787 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:33.797368 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a996e-a353-4f7c-89d2-08be14bed787 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:33.805170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a996e-a353-4f7c-89d2-08be14bed787 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:33.805170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a996e-a353-4f7c-89d2-08be14bed787 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-4a9a996e-a353-4f7c-89d2-08be14bed787 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:33.813243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:33.814292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:33.815129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 446/879] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 23 12:52:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:33.820991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f15ec1-27bb-4e5f-958c-008e28a6bd8d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:33.932647 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417a04b-05d2-49a5-a7fa-36578982bd1d None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:33.933014 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417a04b-05d2-49a5-a7fa-36578982bd1d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:33.933248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417a04b-05d2-49a5-a7fa-36578982bd1d None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:33.935118 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 447/880] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:33.938777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f15ec1-27bb-4e5f-958c-008e28a6bd8d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:33.940230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a97899-70ab-4494-8a18-4bc239c08e06 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:33.940616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a97899-70ab-4494-8a18-4bc239c08e06 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:33.941034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a97899-70ab-4494-8a18-4bc239c08e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:33.966592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f2a97899-70ab-4494-8a18-4bc239c08e06 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:33.968690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f2a97899-70ab-4494-8a18-4bc239c08e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:33.975452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11eeadf-97e1-42f5-a116-bdad770c2302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:33.976127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eeadf-97e1-42f5-a116-bdad770c2302 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:33.976414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eeadf-97e1-42f5-a116-bdad770c2302 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:33.976695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11eeadf-97e1-42f5-a116-bdad770c2302 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:33.977448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11eeadf-97e1-42f5-a116-bdad770c2302 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:33.977763 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11eeadf-97e1-42f5-a116-bdad770c2302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:33.979161 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11eeadf-97e1-42f5-a116-bdad770c2302 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:33.984916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 434/881] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 23 12:52:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:33.991100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11eeadf-97e1-42f5-a116-bdad770c2302 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:34.053463 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 448/882] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:34.065278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:34.076989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a97899-70ab-4494-8a18-4bc239c08e06 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:34.133228 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11eeadf-97e1-42f5-a116-bdad770c2302 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:34.182125 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515cc5a-dde5-4d6e-8146-96c72ee1e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:34.183280 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515cc5a-dde5-4d6e-8146-96c72ee1e4ac None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.184958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515cc5a-dde5-4d6e-8146-96c72ee1e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.185736 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515cc5a-dde5-4d6e-8146-96c72ee1e4ac None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.186632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515cc5a-dde5-4d6e-8146-96c72ee1e4ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:34.187080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515cc5a-dde5-4d6e-8146-96c72ee1e4ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:34.187661 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a97899-70ab-4494-8a18-4bc239c08e06 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:34.188753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515cc5a-dde5-4d6e-8146-96c72ee1e4ac None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:34.201435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 435/883] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 23 12:52:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:34.216835 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:34.235492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d201ec-e172-4d6d-bda7-3b2a421bc8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:34.236384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d201ec-e172-4d6d-bda7-3b2a421bc8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.236674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d201ec-e172-4d6d-bda7-3b2a421bc8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.236985 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d201ec-e172-4d6d-bda7-3b2a421bc8e0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.249406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d201ec-e172-4d6d-bda7-3b2a421bc8e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-52d201ec-e172-4d6d-bda7-3b2a421bc8e0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:34.257900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:34.258909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:34.259736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:34.259736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:34.259736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:34.259736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:34.259736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:34.259736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:34.259736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:34.259736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:34.259736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:34.259736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:34.259736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:52:34.259736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:34.260375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 449/884] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jun 23 12:52:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:34.266541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515cc5a-dde5-4d6e-8146-96c72ee1e4ac None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:34.377485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515cc5a-dde5-4d6e-8146-96c72ee1e4ac None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:34.392488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:34.414303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44b56c-d5f0-4020-a9d3-07eeb0e1bf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:34.414967 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44b56c-d5f0-4020-a9d3-07eeb0e1bf31 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.415249 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44b56c-d5f0-4020-a9d3-07eeb0e1bf31 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.415531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44b56c-d5f0-4020-a9d3-07eeb0e1bf31 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.416282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44b56c-d5f0-4020-a9d3-07eeb0e1bf31 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:34.416589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44b56c-d5f0-4020-a9d3-07eeb0e1bf31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:34.418491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44b56c-d5f0-4020-a9d3-07eeb0e1bf31 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:34.427347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 436/885] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 23 12:52:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:34.432871 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d201ec-e172-4d6d-bda7-3b2a421bc8e0 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:34.545222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d201ec-e172-4d6d-bda7-3b2a421bc8e0 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:34.581451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1232a-2e5e-4b6f-bb63-8b2fd916cff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:34.582600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1232a-2e5e-4b6f-bb63-8b2fd916cff3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.583089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1232a-2e5e-4b6f-bb63-8b2fd916cff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.583567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1232a-2e5e-4b6f-bb63-8b2fd916cff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.595532 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1232a-2e5e-4b6f-bb63-8b2fd916cff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:34.597344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1232a-2e5e-4b6f-bb63-8b2fd916cff3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-bce1232a-2e5e-4b6f-bb63-8b2fd916cff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:34.614947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:34.615857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:34.616709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:34.616709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:34.616709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:34.616709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:34.619033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 450/886] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:34.627273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44b56c-d5f0-4020-a9d3-07eeb0e1bf31 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:34.743385 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44b56c-d5f0-4020-a9d3-07eeb0e1bf31 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:34.783607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c54637-51d7-4886-8c30-68b01ed39f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:34.784285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c54637-51d7-4886-8c30-68b01ed39f9f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.784572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c54637-51d7-4886-8c30-68b01ed39f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.784879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c54637-51d7-4886-8c30-68b01ed39f9f None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.785663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c54637-51d7-4886-8c30-68b01ed39f9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:34.785978 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c54637-51d7-4886-8c30-68b01ed39f9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:34.787447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c54637-51d7-4886-8c30-68b01ed39f9f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:34.800481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 437/887] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:34.808153 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1232a-2e5e-4b6f-bb63-8b2fd916cff3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:34.842887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:34.928924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1232a-2e5e-4b6f-bb63-8b2fd916cff3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:34.966397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de3cb9-9594-4b90-9024-794e77e88279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:34.967224 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de3cb9-9594-4b90-9024-794e77e88279 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:34.967511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de3cb9-9594-4b90-9024-794e77e88279 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:34.967797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de3cb9-9594-4b90-9024-794e77e88279 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:34.975547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de3cb9-9594-4b90-9024-794e77e88279 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:34.977017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de3cb9-9594-4b90-9024-794e77e88279 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-07de3cb9-9594-4b90-9024-794e77e88279 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:34.992374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:34.993353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:34.994310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:34.994310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:34.994310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:34.994310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:34.994310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:34.994310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:34.994310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:34.994310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:34.994310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:52:34.994310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:34.994310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 451/888] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 23 12:52:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:35.001903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c54637-51d7-4886-8c30-68b01ed39f9f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.036486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.043537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e5367-ae56-4a1e-9d64-830201256304 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.043794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e5367-ae56-4a1e-9d64-830201256304 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.043955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e5367-ae56-4a1e-9d64-830201256304 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.046939 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 452/889] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:35.051957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969eb96-8182-46b9-900e-3c8c3a3bb7d7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.052693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969eb96-8182-46b9-900e-3c8c3a3bb7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.052693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1969eb96-8182-46b9-900e-3c8c3a3bb7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.078491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1969eb96-8182-46b9-900e-3c8c3a3bb7d7 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:35.080036 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1969eb96-8182-46b9-900e-3c8c3a3bb7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:35.139543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c54637-51d7-4886-8c30-68b01ed39f9f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.181045 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 453/890] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:35.184041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122d733-2440-4f20-a1fe-ba20972d75d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.184591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122d733-2440-4f20-a1fe-ba20972d75d4 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.184983 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122d733-2440-4f20-a1fe-ba20972d75d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.185333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122d733-2440-4f20-a1fe-ba20972d75d4 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.186304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122d733-2440-4f20-a1fe-ba20972d75d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:35.186690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122d733-2440-4f20-a1fe-ba20972d75d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.188246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122d733-2440-4f20-a1fe-ba20972d75d4 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.195479 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969eb96-8182-46b9-900e-3c8c3a3bb7d7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.208561 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 438/891] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:35.213948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122d733-2440-4f20-a1fe-ba20972d75d4 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.219476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.318312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1969eb96-8182-46b9-900e-3c8c3a3bb7d7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.326951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.337707 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122d733-2440-4f20-a1fe-ba20972d75d4 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.362587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc1e4f-975c-42a0-aa5b-e2d04ab0e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.363785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc1e4f-975c-42a0-aa5b-e2d04ab0e214 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.364289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc1e4f-975c-42a0-aa5b-e2d04ab0e214 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.364777 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc1e4f-975c-42a0-aa5b-e2d04ab0e214 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.365706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc1e4f-975c-42a0-aa5b-e2d04ab0e214 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.367411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc1e4f-975c-42a0-aa5b-e2d04ab0e214 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.379767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ae4e-18f9-4989-858d-638acdad34b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.380426 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ae4e-18f9-4989-858d-638acdad34b1 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.380707 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ae4e-18f9-4989-858d-638acdad34b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.381009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ae4e-18f9-4989-858d-638acdad34b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-8acc1e4f-975c-42a0-aa5b-e2d04ab0e214 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:35.381219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:35.382264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:52:35.383151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:35.391461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 454/892] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:35.392982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc1e4f-975c-42a0-aa5b-e2d04ab0e214 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.481734 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ae4e-18f9-4989-858d-638acdad34b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.483213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ae4e-18f9-4989-858d-638acdad34b1 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.489533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.516619 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc1e4f-975c-42a0-aa5b-e2d04ab0e214 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.561948 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bf8f0-0c2d-4193-9a55-488ee5675bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.563807 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bf8f0-0c2d-4193-9a55-488ee5675bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.564318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bf8f0-0c2d-4193-9a55-488ee5675bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.565138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bf8f0-0c2d-4193-9a55-488ee5675bf1 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.566073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bf8f0-0c2d-4193-9a55-488ee5675bf1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:35.566850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bf8f0-0c2d-4193-9a55-488ee5675bf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.568775 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bf8f0-0c2d-4193-9a55-488ee5675bf1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.576126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 455/893] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:35.583998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bf8f0-0c2d-4193-9a55-488ee5675bf1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.585276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.601730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 439/894] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 12:52:35.602742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ae4e-18f9-4989-858d-638acdad34b1 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.703838 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bf8f0-0c2d-4193-9a55-488ee5675bf1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.731218 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ae4e-18f9-4989-858d-638acdad34b1 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.740514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c5d08-10a2-4145-8a9f-55a6b0ea4600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.741221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c5d08-10a2-4145-8a9f-55a6b0ea4600 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.741908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c5d08-10a2-4145-8a9f-55a6b0ea4600 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.741908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c5d08-10a2-4145-8a9f-55a6b0ea4600 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.742572 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c5d08-10a2-4145-8a9f-55a6b0ea4600 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:35.742876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c5d08-10a2-4145-8a9f-55a6b0ea4600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.744514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c5d08-10a2-4145-8a9f-55a6b0ea4600 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.755596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 456/895] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:35.757392 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c5d08-10a2-4145-8a9f-55a6b0ea4600 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.773756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.779422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40628b51-e365-4e6f-911c-3cab49754638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.786946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40628b51-e365-4e6f-911c-3cab49754638 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.786946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40628b51-e365-4e6f-911c-3cab49754638 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.786946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40628b51-e365-4e6f-911c-3cab49754638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.791891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40628b51-e365-4e6f-911c-3cab49754638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.793775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40628b51-e365-4e6f-911c-3cab49754638 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-40628b51-e365-4e6f-911c-3cab49754638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:35.814663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:35.815632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:35.816503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:35.816503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:35.816503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:35.816503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:35.820660 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 440/896] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:35.821975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40628b51-e365-4e6f-911c-3cab49754638 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.869683 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:35.892570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c5d08-10a2-4145-8a9f-55a6b0ea4600 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.930001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaae407-0240-4470-b47e-c844afad66de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.930651 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae407-0240-4470-b47e-c844afad66de None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.931038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae407-0240-4470-b47e-c844afad66de None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.931302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaae407-0240-4470-b47e-c844afad66de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.931998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaae407-0240-4470-b47e-c844afad66de None admin] RBAC: Adding query filter params (interface=public, service_id=8d013ca3344348aeb1671286462ab831, region_id=RegionOne) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:35.932311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaae407-0240-4470-b47e-c844afad66de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.933154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40628b51-e365-4e6f-911c-3cab49754638 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:35.934515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaae407-0240-4470-b47e-c844afad66de None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.940649 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 457/897] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/endpoints?service_id=8d013ca3344348aeb1671286462ab831&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:35.941929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcd527-0b78-4456-a271-6d2e75d2c814 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.942221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcd527-0b78-4456-a271-6d2e75d2c814 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.942498 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcd527-0b78-4456-a271-6d2e75d2c814 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.943834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 458/898] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:35.948065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcd527-0b78-4456-a271-6d2e75d2c814 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:35.975342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa025a-d6d7-4ce3-b8d0-e433af598252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:35.976014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa025a-d6d7-4ce3-b8d0-e433af598252 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.976300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa025a-d6d7-4ce3-b8d0-e433af598252 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.976577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa025a-d6d7-4ce3-b8d0-e433af598252 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:35.977452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa025a-d6d7-4ce3-b8d0-e433af598252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:35.977882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa025a-d6d7-4ce3-b8d0-e433af598252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:35.979258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa025a-d6d7-4ce3-b8d0-e433af598252 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:35.996566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 441/899] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:35.996566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21aeca-79ea-4823-8206-8e841a18e2c0 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:35.996566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21aeca-79ea-4823-8206-8e841a18e2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:35.996566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21aeca-79ea-4823-8206-8e841a18e2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.011456 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-0e21aeca-79ea-4823-8206-8e841a18e2c0 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:36.013310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0e21aeca-79ea-4823-8206-8e841a18e2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:36.032901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:36.058174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcd527-0b78-4456-a271-6d2e75d2c814 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.084568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 442/900] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:36.085663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21aeca-79ea-4823-8206-8e841a18e2c0 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.104009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e16bd-12be-4a4f-85b0-48fba5a98aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.105860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e16bd-12be-4a4f-85b0-48fba5a98aff None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.106489 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e16bd-12be-4a4f-85b0-48fba5a98aff None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.106961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172e16bd-12be-4a4f-85b0-48fba5a98aff None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.107829 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e16bd-12be-4a4f-85b0-48fba5a98aff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.110248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172e16bd-12be-4a4f-85b0-48fba5a98aff None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.116679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 459/901] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 23 12:52:35 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:52:36.117358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e16bd-12be-4a4f-85b0-48fba5a98aff None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.126500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:36.218351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21aeca-79ea-4823-8206-8e841a18e2c0 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.242068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172e16bd-12be-4a4f-85b0-48fba5a98aff None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.259331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb87b62-db78-47b1-bcbd-111e124c2907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.260543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb87b62-db78-47b1-bcbd-111e124c2907 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.261070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb87b62-db78-47b1-bcbd-111e124c2907 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.262271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb87b62-db78-47b1-bcbd-111e124c2907 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.270772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb87b62-db78-47b1-bcbd-111e124c2907 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.272553 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb87b62-db78-47b1-bcbd-111e124c2907 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.281121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc924d23-9c9d-49f3-be8e-9e162efd42cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.281955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc924d23-9c9d-49f3-be8e-9e162efd42cc None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.282242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc924d23-9c9d-49f3-be8e-9e162efd42cc None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.282521 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc924d23-9c9d-49f3-be8e-9e162efd42cc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.283184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc924d23-9c9d-49f3-be8e-9e162efd42cc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.284546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc924d23-9c9d-49f3-be8e-9e162efd42cc None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-3bb87b62-db78-47b1-bcbd-111e124c2907 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:36.290274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:36.291193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:36.292050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:36.292050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:36.292050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:36.292050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:36.292050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:36.292050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:36.292050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:36.292050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:36.292486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 443/902] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:36.297964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb87b62-db78-47b1-bcbd-111e124c2907 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-bc924d23-9c9d-49f3-be8e-9e162efd42cc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:36.301275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:36.302207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:36.303342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 460/903] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Jun 23 12:52:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:36.308432 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc924d23-9c9d-49f3-be8e-9e162efd42cc None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.311418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:36.403982 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:36.414397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb87b62-db78-47b1-bcbd-111e124c2907 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.434870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc924d23-9c9d-49f3-be8e-9e162efd42cc None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.450985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e40463-204a-4771-a21c-be18dc592a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.451655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e40463-204a-4771-a21c-be18dc592a82 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.451941 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e40463-204a-4771-a21c-be18dc592a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.452219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e40463-204a-4771-a21c-be18dc592a82 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.453037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e40463-204a-4771-a21c-be18dc592a82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:36.453351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e40463-204a-4771-a21c-be18dc592a82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.454785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e40463-204a-4771-a21c-be18dc592a82 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.467348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 444/904] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:36.468719 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87398ce0-4832-498e-982d-4a6398889919 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.469037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87398ce0-4832-498e-982d-4a6398889919 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.469313 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87398ce0-4832-498e-982d-4a6398889919 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.470677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 445/905] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:36.475570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87398ce0-4832-498e-982d-4a6398889919 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.475874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82033f2-79ef-42bd-91aa-bfefaacf9aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.476543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82033f2-79ef-42bd-91aa-bfefaacf9aae None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.476843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82033f2-79ef-42bd-91aa-bfefaacf9aae None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.477117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82033f2-79ef-42bd-91aa-bfefaacf9aae None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.477828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82033f2-79ef-42bd-91aa-bfefaacf9aae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:36.478135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82033f2-79ef-42bd-91aa-bfefaacf9aae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.479484 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82033f2-79ef-42bd-91aa-bfefaacf9aae None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.484860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 461/906] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 23 12:52:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:36.485949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62d229-8d1c-4d60-90f1-ea4484674660 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.486235 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62d229-8d1c-4d60-90f1-ea4484674660 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.486509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62d229-8d1c-4d60-90f1-ea4484674660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.503096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ab62d229-8d1c-4d60-90f1-ea4484674660 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:36.505862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ab62d229-8d1c-4d60-90f1-ea4484674660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:36.564256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:36.576839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 462/907] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:36.576839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62d229-8d1c-4d60-90f1-ea4484674660 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.612055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87398ce0-4832-498e-982d-4a6398889919 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.647632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eff14a-bd95-45a2-8ba7-0c5fecb0a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.648387 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eff14a-bd95-45a2-8ba7-0c5fecb0a504 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.648735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eff14a-bd95-45a2-8ba7-0c5fecb0a504 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.649101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eff14a-bd95-45a2-8ba7-0c5fecb0a504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.650007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eff14a-bd95-45a2-8ba7-0c5fecb0a504 None admin] RBAC: Adding query filter params (role.id=be5e149a2c4b4be79c9dbb018b5975d4, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=6af4358779f947acade2ed0293893b89) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:36.650322 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eff14a-bd95-45a2-8ba7-0c5fecb0a504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.651767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eff14a-bd95-45a2-8ba7-0c5fecb0a504 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.659310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 446/908] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:36 2022] GET /identity/v3/role_assignments?user.id=6af4358779f947acade2ed0293893b89&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=be5e149a2c4b4be79c9dbb018b5975d4 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:36.660025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eff14a-bd95-45a2-8ba7-0c5fecb0a504 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.689878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:36.692029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62d229-8d1c-4d60-90f1-ea4484674660 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.737793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14af2e-e8fa-465e-b3d3-d965383e5cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.738483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14af2e-e8fa-465e-b3d3-d965383e5cdd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.738770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14af2e-e8fa-465e-b3d3-d965383e5cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.739048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14af2e-e8fa-465e-b3d3-d965383e5cdd None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.739780 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14af2e-e8fa-465e-b3d3-d965383e5cdd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:36.740094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14af2e-e8fa-465e-b3d3-d965383e5cdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.741646 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd14af2e-e8fa-465e-b3d3-d965383e5cdd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.753381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 463/909] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 23 12:52:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:36.754475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14af2e-e8fa-465e-b3d3-d965383e5cdd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:36.811171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eff14a-bd95-45a2-8ba7-0c5fecb0a504 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.842079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:36.858528 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d130d71-44e9-4eab-8f8f-8471d4b05d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.859205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d130d71-44e9-4eab-8f8f-8471d4b05d9d None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.859607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d130d71-44e9-4eab-8f8f-8471d4b05d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.862977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d130d71-44e9-4eab-8f8f-8471d4b05d9d None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.866802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d130d71-44e9-4eab-8f8f-8471d4b05d9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.876831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d130d71-44e9-4eab-8f8f-8471d4b05d9d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.885111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd14af2e-e8fa-465e-b3d3-d965383e5cdd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:36.923541 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bcb40-f26d-4fcd-98c7-cafa8793636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:36.924121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bcb40-f26d-4fcd-98c7-cafa8793636d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:36.924412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bcb40-f26d-4fcd-98c7-cafa8793636d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:36.924694 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bcb40-f26d-4fcd-98c7-cafa8793636d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:36.925548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bcb40-f26d-4fcd-98c7-cafa8793636d None admin] RBAC: Adding query filter params (interface=public, service_id=da0b76abfc5c46ca91ed02bd051a6c29, region_id=RegionOne) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:36.929886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bcb40-f26d-4fcd-98c7-cafa8793636d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:36.929886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bcb40-f26d-4fcd-98c7-cafa8793636d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:36.930260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 447/910] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:52:36 2022] POST /identity/v3/services => generated 241 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:36.938786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 464/911] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 23 12:52:36 2022] GET /identity/v3/endpoints?service_id=da0b76abfc5c46ca91ed02bd051a6c29&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:36.944910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d130d71-44e9-4eab-8f8f-8471d4b05d9d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:37.036380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:37.072903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d130d71-44e9-4eab-8f8f-8471d4b05d9d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:37.111141 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd8abc-c5ff-403d-8a64-915a6f265c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:37.112158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd8abc-c5ff-403d-8a64-915a6f265c64 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:37.112590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd8abc-c5ff-403d-8a64-915a6f265c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:37.113045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd8abc-c5ff-403d-8a64-915a6f265c64 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:37.113944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd8abc-c5ff-403d-8a64-915a6f265c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:37.115595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd8abc-c5ff-403d-8a64-915a6f265c64 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:37.123331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 448/912] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 23 12:52:36 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:52:38.249568 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3de39c-9504-472f-9522-fb86aaa39243 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:38.250095 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3de39c-9504-472f-9522-fb86aaa39243 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:38.250173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3de39c-9504-472f-9522-fb86aaa39243 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:38.251785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 465/913] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:38.257394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63202021-b48b-493b-b327-77358711b2f3 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:38.257817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63202021-b48b-493b-b327-77358711b2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:38.258009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63202021-b48b-493b-b327-77358711b2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:38.276490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-63202021-b48b-493b-b327-77358711b2f3 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:38.277733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-63202021-b48b-493b-b327-77358711b2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:38.351643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 449/914] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:38.375879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3de39c-9504-472f-9522-fb86aaa39243 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:38.483216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3de39c-9504-472f-9522-fb86aaa39243 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:38.511908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:38.520790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78441c-702b-4942-bac0-82e85be4985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:38.521636 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78441c-702b-4942-bac0-82e85be4985b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:38.521923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78441c-702b-4942-bac0-82e85be4985b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:38.522258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78441c-702b-4942-bac0-82e85be4985b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:38.522918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78441c-702b-4942-bac0-82e85be4985b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:38.524293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78441c-702b-4942-bac0-82e85be4985b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-8a78441c-702b-4942-bac0-82e85be4985b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:38.536294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:38.541422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:38.542255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 466/915] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:38.546367 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63202021-b48b-493b-b327-77358711b2f3 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:38.613095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:38.648489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63202021-b48b-493b-b327-77358711b2f3 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:38.686708 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2e428-4d9b-4e00-b958-6eee16498514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:38.687383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2e428-4d9b-4e00-b958-6eee16498514 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:38.687668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2e428-4d9b-4e00-b958-6eee16498514 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:38.687949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2e428-4d9b-4e00-b958-6eee16498514 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:38.688674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2e428-4d9b-4e00-b958-6eee16498514 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:38.689012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2e428-4d9b-4e00-b958-6eee16498514 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:38.690403 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d2e428-4d9b-4e00-b958-6eee16498514 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:38.695735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 450/916] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:38.701435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78441c-702b-4942-bac0-82e85be4985b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:38.744574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da80f8-4cad-4468-893a-70dd1e6607ed None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:38.744910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da80f8-4cad-4468-893a-70dd1e6607ed None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:38.745169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da80f8-4cad-4468-893a-70dd1e6607ed None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:38.747456 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 451/917] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:38.752673 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef2c4-beeb-42cf-812b-2459f3f582db None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:38.753069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef2c4-beeb-42cf-812b-2459f3f582db None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:38.753354 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef2c4-beeb-42cf-812b-2459f3f582db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:38.771965 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e84ef2c4-beeb-42cf-812b-2459f3f582db None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:38.773123 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e84ef2c4-beeb-42cf-812b-2459f3f582db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:38.815322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78441c-702b-4942-bac0-82e85be4985b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:38.850197 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702386e-f6d9-4b67-879d-0ebc8ff0b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:38.851216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702386e-f6d9-4b67-879d-0ebc8ff0b156 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:38.851818 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702386e-f6d9-4b67-879d-0ebc8ff0b156 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:38.852308 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702386e-f6d9-4b67-879d-0ebc8ff0b156 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:38.853507 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702386e-f6d9-4b67-879d-0ebc8ff0b156 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:38.854151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702386e-f6d9-4b67-879d-0ebc8ff0b156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:38.856023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d702386e-f6d9-4b67-879d-0ebc8ff0b156 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:38.856150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 452/918] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:38.872128 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 467/919] 10.222.0.16 () {56 vars in 1114 bytes} [Thu Jun 23 12:52:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:38.877923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ef2c4-beeb-42cf-812b-2459f3f582db None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:38.882581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702386e-f6d9-4b67-879d-0ebc8ff0b156 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:38.939347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:38.947764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:38.988523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702386e-f6d9-4b67-879d-0ebc8ff0b156 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:38.993644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ef2c4-beeb-42cf-812b-2459f3f582db None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.023697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe74a24-fa08-4304-a2ac-b86341f1a9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.024437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe74a24-fa08-4304-a2ac-b86341f1a9bc None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.024720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe74a24-fa08-4304-a2ac-b86341f1a9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.025035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe74a24-fa08-4304-a2ac-b86341f1a9bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.034428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650b16a6-7026-4925-a502-40efe02fba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.035431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b16a6-7026-4925-a502-40efe02fba31 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.035941 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b16a6-7026-4925-a502-40efe02fba31 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.036454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650b16a6-7026-4925-a502-40efe02fba31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.036561 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe74a24-fa08-4304-a2ac-b86341f1a9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:39.037561 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b16a6-7026-4925-a502-40efe02fba31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.039154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650b16a6-7026-4925-a502-40efe02fba31 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6fe74a24-fa08-4304-a2ac-b86341f1a9bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:39.045907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:39.046887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:39.047724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:39.047724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:39.047724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:39.047724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:39.047724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:39.047724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:39.047724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:39.047724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:39.047724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:39.047724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:39.047724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:52:39.047724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:39.052243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 468/920] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jun 23 12:52:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:39.053675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a814cb-227d-496c-ab5e-3ad4955bd020 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.053967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a814cb-227d-496c-ab5e-3ad4955bd020 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.054248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a814cb-227d-496c-ab5e-3ad4955bd020 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.055677 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 469/921] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:39.056386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a814cb-227d-496c-ab5e-3ad4955bd020 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.148335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 453/922] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 23 12:52:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:52:39.149690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636419b4-3b54-4aff-bb26-7d42f3910870 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.150006 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636419b4-3b54-4aff-bb26-7d42f3910870 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.150267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636419b4-3b54-4aff-bb26-7d42f3910870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.169519 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-636419b4-3b54-4aff-bb26-7d42f3910870 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:39.170760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-636419b4-3b54-4aff-bb26-7d42f3910870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:39.179130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a814cb-227d-496c-ab5e-3ad4955bd020 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.195340 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:39.226023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c8e2f-48cf-4093-ba73-a3a7ba0a33b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.227118 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c8e2f-48cf-4093-ba73-a3a7ba0a33b6 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.227616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c8e2f-48cf-4093-ba73-a3a7ba0a33b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.228106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c8e2f-48cf-4093-ba73-a3a7ba0a33b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.229118 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c8e2f-48cf-4093-ba73-a3a7ba0a33b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:39.229647 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c8e2f-48cf-4093-ba73-a3a7ba0a33b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.232555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c8e2f-48cf-4093-ba73-a3a7ba0a33b6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.242635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 470/923] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:39.248774 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c8e2f-48cf-4093-ba73-a3a7ba0a33b6 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.255093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 454/924] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:39.278801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636419b4-3b54-4aff-bb26-7d42f3910870 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.334937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:39.369921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c8e2f-48cf-4093-ba73-a3a7ba0a33b6 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.396235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636419b4-3b54-4aff-bb26-7d42f3910870 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.406184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb97be-2179-4dcb-9536-529be24aa916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.406987 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb97be-2179-4dcb-9536-529be24aa916 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.407274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb97be-2179-4dcb-9536-529be24aa916 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.407553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb97be-2179-4dcb-9536-529be24aa916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.419272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb97be-2179-4dcb-9536-529be24aa916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.420861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb97be-2179-4dcb-9536-529be24aa916 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.434354 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b53439-716c-4ebd-b510-1171b8a6e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.435155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b53439-716c-4ebd-b510-1171b8a6e391 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.435439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b53439-716c-4ebd-b510-1171b8a6e391 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.435715 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b53439-716c-4ebd-b510-1171b8a6e391 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.436374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b53439-716c-4ebd-b510-1171b8a6e391 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.437770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b53439-716c-4ebd-b510-1171b8a6e391 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-efeb97be-2179-4dcb-9536-529be24aa916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:39.439856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:39.440732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:39.441686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:39.441686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:39.441686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:39.441686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:39.441686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 471/925] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:39.442650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e74c6-3a38-4da9-a988-7cea1acaa3a8 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.442755 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e74c6-3a38-4da9-a988-7cea1acaa3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.442951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e74c6-3a38-4da9-a988-7cea1acaa3a8 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.444344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 472/926] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:39.449443 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e74c6-3a38-4da9-a988-7cea1acaa3a8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-f5b53439-716c-4ebd-b510-1171b8a6e391 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:39.459040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:39.460130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:39.460991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 455/927] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:39.462393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5225ed-09bb-4c31-96ce-6949b1b44234 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.462505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5225ed-09bb-4c31-96ce-6949b1b44234 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.462751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5225ed-09bb-4c31-96ce-6949b1b44234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.480998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:39.481948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ed5225ed-09bb-4c31-96ce-6949b1b44234 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:39.483098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ed5225ed-09bb-4c31-96ce-6949b1b44234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:39.563322 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 456/928] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:39.564474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5225ed-09bb-4c31-96ce-6949b1b44234 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.576270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e74c6-3a38-4da9-a988-7cea1acaa3a8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.612250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:39.617012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a419be4-3d33-4122-af55-5a8bbc9f1329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.618209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419be4-3d33-4122-af55-5a8bbc9f1329 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.618638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419be4-3d33-4122-af55-5a8bbc9f1329 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.618916 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419be4-3d33-4122-af55-5a8bbc9f1329 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.619800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a419be4-3d33-4122-af55-5a8bbc9f1329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:39.620111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a419be4-3d33-4122-af55-5a8bbc9f1329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.621921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a419be4-3d33-4122-af55-5a8bbc9f1329 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.641354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 473/929] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:39.641354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a419be4-3d33-4122-af55-5a8bbc9f1329 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.675409 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5225ed-09bb-4c31-96ce-6949b1b44234 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.711091 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5f606-c7db-4e76-9852-16bc72e51b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.711902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5f606-c7db-4e76-9852-16bc72e51b70 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.712273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5f606-c7db-4e76-9852-16bc72e51b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.712623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5f606-c7db-4e76-9852-16bc72e51b70 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.713444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5f606-c7db-4e76-9852-16bc72e51b70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:39.713826 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5f606-c7db-4e76-9852-16bc72e51b70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.715989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5f606-c7db-4e76-9852-16bc72e51b70 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.724868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 457/930] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:39.724868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5f606-c7db-4e76-9852-16bc72e51b70 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.741846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:39.761981 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a419be4-3d33-4122-af55-5a8bbc9f1329 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.802222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68011da7-3fe3-4fe4-a588-a34211767b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.803193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68011da7-3fe3-4fe4-a588-a34211767b93 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.803958 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68011da7-3fe3-4fe4-a588-a34211767b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.804477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68011da7-3fe3-4fe4-a588-a34211767b93 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.805397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68011da7-3fe3-4fe4-a588-a34211767b93 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.807589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68011da7-3fe3-4fe4-a588-a34211767b93 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-68011da7-3fe3-4fe4-a588-a34211767b93 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:39.825216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:39.826328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 12:52:39.827338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:39.832855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 474/931] 10.222.0.16 () {56 vars in 1132 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:39.832855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68011da7-3fe3-4fe4-a588-a34211767b93 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.833085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5f606-c7db-4e76-9852-16bc72e51b70 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.835093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:39.875309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14fff-dce2-4c9e-8846-51c08319495c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.876121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14fff-dce2-4c9e-8846-51c08319495c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.876399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14fff-dce2-4c9e-8846-51c08319495c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.876673 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b14fff-dce2-4c9e-8846-51c08319495c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.883917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b14fff-dce2-4c9e-8846-51c08319495c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.885402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b14fff-dce2-4c9e-8846-51c08319495c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-e7b14fff-dce2-4c9e-8846-51c08319495c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:39.900998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:39.902421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:39.903521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:39.903521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:39.903521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:39.903521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:39.903521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:39.903521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:39.903521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:39.903521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:39.903521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:52:39.903521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:39.903521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 458/932] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:39.904128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14fff-dce2-4c9e-8846-51c08319495c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:39.956346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68011da7-3fe3-4fe4-a588-a34211767b93 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:39.993882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b466b5-aeec-4877-8367-2573bd4021e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:39.994552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b466b5-aeec-4877-8367-2573bd4021e2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:39.994842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b466b5-aeec-4877-8367-2573bd4021e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:39.995121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b466b5-aeec-4877-8367-2573bd4021e2 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:39.996513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b466b5-aeec-4877-8367-2573bd4021e2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:39.996844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b466b5-aeec-4877-8367-2573bd4021e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:39.998221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b466b5-aeec-4877-8367-2573bd4021e2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:40.003553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 475/933] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:40.004164 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b466b5-aeec-4877-8367-2573bd4021e2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:40.014311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b14fff-dce2-4c9e-8846-51c08319495c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:40.017135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:40.049720 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed2539-c2dc-48a5-9b84-356aa8b74db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:40.050378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed2539-c2dc-48a5-9b84-356aa8b74db1 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:40.050660 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed2539-c2dc-48a5-9b84-356aa8b74db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:40.051185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed2539-c2dc-48a5-9b84-356aa8b74db1 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:40.051627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed2539-c2dc-48a5-9b84-356aa8b74db1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:40.051928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed2539-c2dc-48a5-9b84-356aa8b74db1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:40.053324 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed2539-c2dc-48a5-9b84-356aa8b74db1 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:40.063108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 459/934] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 23 12:52:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:40.063954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed2539-c2dc-48a5-9b84-356aa8b74db1 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:40.093332 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:40.112747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b466b5-aeec-4877-8367-2573bd4021e2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:40.151130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2d179-9e8a-433a-81ba-88283e657696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:40.152511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2d179-9e8a-433a-81ba-88283e657696 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:40.152964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2d179-9e8a-433a-81ba-88283e657696 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:40.153377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2d179-9e8a-433a-81ba-88283e657696 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:40.154684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2d179-9e8a-433a-81ba-88283e657696 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:40.155225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2d179-9e8a-433a-81ba-88283e657696 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:40.157462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2d179-9e8a-433a-81ba-88283e657696 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:40.170113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed2539-c2dc-48a5-9b84-356aa8b74db1 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:40.187909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 476/935] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jun 23 12:52:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:40.188101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2d179-9e8a-433a-81ba-88283e657696 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:40.213304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf95d12-a742-4649-afd9-497b4daaf573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:40.213964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf95d12-a742-4649-afd9-497b4daaf573 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:40.214349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf95d12-a742-4649-afd9-497b4daaf573 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:40.214775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf95d12-a742-4649-afd9-497b4daaf573 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:40.215758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf95d12-a742-4649-afd9-497b4daaf573 None admin] RBAC: Adding query filter params (interface=public, service_id=4321d7f66a9746df946d52aba8fd6c7e, region_id=RegionOne) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:40.216072 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf95d12-a742-4649-afd9-497b4daaf573 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:40.217492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf95d12-a742-4649-afd9-497b4daaf573 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:40.227132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 460/936] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 23 12:52:40 2022] GET /identity/v3/endpoints?service_id=4321d7f66a9746df946d52aba8fd6c7e&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:40.227132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf95d12-a742-4649-afd9-497b4daaf573 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:40.267087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:40.302126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2d179-9e8a-433a-81ba-88283e657696 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:40.326204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:40.336333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf95d12-a742-4649-afd9-497b4daaf573 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:40.340236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663d4a4-583f-4255-8c8e-81e613e25140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:40.340938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663d4a4-583f-4255-8c8e-81e613e25140 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:40.341224 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663d4a4-583f-4255-8c8e-81e613e25140 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:40.341500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663d4a4-583f-4255-8c8e-81e613e25140 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:40.342208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663d4a4-583f-4255-8c8e-81e613e25140 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:40.342515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663d4a4-583f-4255-8c8e-81e613e25140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:40.343923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663d4a4-583f-4255-8c8e-81e613e25140 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:40.353656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 477/937] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 23 12:52:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:40.353656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663d4a4-583f-4255-8c8e-81e613e25140 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:40.378888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712696ed-dd9d-4a0e-a943-5dfd49d7d0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:40.379688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712696ed-dd9d-4a0e-a943-5dfd49d7d0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:40.379969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712696ed-dd9d-4a0e-a943-5dfd49d7d0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:40.380388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712696ed-dd9d-4a0e-a943-5dfd49d7d0e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:40.391784 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712696ed-dd9d-4a0e-a943-5dfd49d7d0e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:40.393289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712696ed-dd9d-4a0e-a943-5dfd49d7d0e4 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-712696ed-dd9d-4a0e-a943-5dfd49d7d0e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:40.411979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:40.413204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:40.414114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:40.414114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:40.414114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:40.414114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:40.414114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 461/938] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:40.414114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712696ed-dd9d-4a0e-a943-5dfd49d7d0e4 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:40.463435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663d4a4-583f-4255-8c8e-81e613e25140 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:40.500513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:40.506084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22669db3-489d-4715-91cb-1711b4c62cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:40.508849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22669db3-489d-4715-91cb-1711b4c62cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:40.508849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22669db3-489d-4715-91cb-1711b4c62cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:40.508849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22669db3-489d-4715-91cb-1711b4c62cd2 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:40.508849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22669db3-489d-4715-91cb-1711b4c62cd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:40.510229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22669db3-489d-4715-91cb-1711b4c62cd2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:40.517269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 478/939] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 23 12:52:40 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:52:40.518031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22669db3-489d-4715-91cb-1711b4c62cd2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:40.533942 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712696ed-dd9d-4a0e-a943-5dfd49d7d0e4 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:40.584169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77a900-a651-4725-b4fd-478962b4c8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:40.584890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77a900-a651-4725-b4fd-478962b4c8f3 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:40.585176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77a900-a651-4725-b4fd-478962b4c8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:40.585453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f77a900-a651-4725-b4fd-478962b4c8f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:40.586221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77a900-a651-4725-b4fd-478962b4c8f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:40.588281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f77a900-a651-4725-b4fd-478962b4c8f3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:40.645720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22669db3-489d-4715-91cb-1711b4c62cd2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:40.661303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:40.676859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 462/940] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 23 12:52:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:40.699314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9373918-bdf9-4f9c-942c-03c26dfc67d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:40.700614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373918-bdf9-4f9c-942c-03c26dfc67d1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:40.700939 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373918-bdf9-4f9c-942c-03c26dfc67d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:40.701205 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9373918-bdf9-4f9c-942c-03c26dfc67d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:40.701947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9373918-bdf9-4f9c-942c-03c26dfc67d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:40.702318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9373918-bdf9-4f9c-942c-03c26dfc67d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:40.703737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9373918-bdf9-4f9c-942c-03c26dfc67d1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:40.721055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 479/941] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:40.726624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77a900-a651-4725-b4fd-478962b4c8f3 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:40.845631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f77a900-a651-4725-b4fd-478962b4c8f3 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:40.881503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999287c-9074-4799-8a83-9c8f3ff28334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:40.882301 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999287c-9074-4799-8a83-9c8f3ff28334 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:40.882583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999287c-9074-4799-8a83-9c8f3ff28334 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:40.882859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999287c-9074-4799-8a83-9c8f3ff28334 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:40.890265 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999287c-9074-4799-8a83-9c8f3ff28334 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:40.891797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999287c-9074-4799-8a83-9c8f3ff28334 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-c999287c-9074-4799-8a83-9c8f3ff28334 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:40.906757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:40.907672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:40.908531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:40.908531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:40.908531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:40.908531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:40.908531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:40.908531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:40.908531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:40.908531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:40.908531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 463/942] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:40.913835 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9373918-bdf9-4f9c-942c-03c26dfc67d1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:40.970553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:41.020106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9373918-bdf9-4f9c-942c-03c26dfc67d1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:41.054661 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e09ef-27cf-45ea-9af5-f128320880da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:41.055326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e09ef-27cf-45ea-9af5-f128320880da None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:41.055615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e09ef-27cf-45ea-9af5-f128320880da None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:41.055870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e09ef-27cf-45ea-9af5-f128320880da None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:41.056712 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e09ef-27cf-45ea-9af5-f128320880da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:41.057046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e09ef-27cf-45ea-9af5-f128320880da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:41.059262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e09ef-27cf-45ea-9af5-f128320880da None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:41.071541 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 480/943] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:41.077898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999287c-9074-4799-8a83-9c8f3ff28334 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:41.149199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:41.184620 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999287c-9074-4799-8a83-9c8f3ff28334 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:41.219423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d3acf-1fcc-489c-a419-1a9d36face2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:41.220317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d3acf-1fcc-489c-a419-1a9d36face2a None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:41.220598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d3acf-1fcc-489c-a419-1a9d36face2a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:41.220913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d3acf-1fcc-489c-a419-1a9d36face2a None admin] PATH_INFO: `/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/6af4358779f947acade2ed0293893b89/roles/be5e149a2c4b4be79c9dbb018b5975d4` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:41.223119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d3acf-1fcc-489c-a419-1a9d36face2a None admin] RBAC: Authorizing `identity:create_grant(project_id=66de76d7ea7a45a6b698f8b1295c66c3, user_id=6af4358779f947acade2ed0293893b89, role_id=be5e149a2c4b4be79c9dbb018b5975d4)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:41.224578 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5d3acf-1fcc-489c-a419-1a9d36face2a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:41.271554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630f7e4-ed4f-4db1-a8d5-34b76826835e None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:41.271877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630f7e4-ed4f-4db1-a8d5-34b76826835e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:41.272115 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630f7e4-ed4f-4db1-a8d5-34b76826835e None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:41.273639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 481/944] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:41.278648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc57b-825f-4f18-8687-d29c5c6d5c67 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:41.278931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc57b-825f-4f18-8687-d29c5c6d5c67 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:41.279203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eecc57b-825f-4f18-8687-d29c5c6d5c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:41.296610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 464/945] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:52:41 2022] PUT /identity/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/6af4358779f947acade2ed0293893b89/roles/be5e149a2c4b4be79c9dbb018b5975d4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:52:41.302056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7eecc57b-825f-4f18-8687-d29c5c6d5c67 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:41.304004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7eecc57b-825f-4f18-8687-d29c5c6d5c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:41.387269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 482/946] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:41.408376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d3acf-1fcc-489c-a419-1a9d36face2a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:41.533025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d3acf-1fcc-489c-a419-1a9d36face2a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:41.555358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:41.570706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87781a27-982c-457c-aeb8-400e754647ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:41.571371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87781a27-982c-457c-aeb8-400e754647ac None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:41.571656 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87781a27-982c-457c-aeb8-400e754647ac None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:41.571992 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87781a27-982c-457c-aeb8-400e754647ac None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:41.572727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87781a27-982c-457c-aeb8-400e754647ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:41.574361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87781a27-982c-457c-aeb8-400e754647ac None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:41.575736 dv-cinder-847335-1-smb devstack@keystone.service[80298]: WARNING keystone.server.flask.common [None req-87781a27-982c-457c-aeb8-400e754647ac None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 12:52:41.626368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.sql.core [None req-87781a27-982c-457c-aeb8-400e754647ac None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 12:52:41.626368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 12:52:41.626368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [parameters: {'id': 'ddfff0a2afca433b8b2d6e816251787f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 12:52:41.626368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80298) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-87781a27-982c-457c-aeb8-400e754647ac None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ddfff0a2afca433b8b2d6e816251787f.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ddfff0a2afca433b8b2d6e816251787f. Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application conn.query(q) Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 12:52:41.634563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application result.read() Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 12:52:41.635490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application next(self.gen) Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application yield resource Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application next(self.gen) Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise self.value Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application session.commit() Jun 23 12:52:41.637073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self.session.flush() Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application compat.raise_( Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 12:52:41.637964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 12:52:41.639119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application conn.query(q) Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application result.read() Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 12:52:41.639907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [parameters: {'id': 'ddfff0a2afca433b8b2d6e816251787f', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:41.640751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:41.643549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:41.645746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:41.645746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 12:52:41.645746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 12:52:41.645746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:41.645746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:41.645746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 12:52:41.645746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 12:52:41.645746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ddfff0a2afca433b8b2d6e816251787f. Jun 23 12:52:41.645746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:41.645746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 465/947] 10.222.0.16 () {60 vars in 1140 bytes} [Thu Jun 23 12:52:41 2022] POST /identity/v3/projects => generated 262 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:41.647006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecc57b-825f-4f18-8687-d29c5c6d5c67 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:41.689129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:41.750370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eecc57b-825f-4f18-8687-d29c5c6d5c67 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:41.786269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1669ea7e-8249-4df4-81ad-508b4e1d8096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:41.786984 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ea7e-8249-4df4-81ad-508b4e1d8096 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:41.787269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ea7e-8249-4df4-81ad-508b4e1d8096 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:41.787551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1669ea7e-8249-4df4-81ad-508b4e1d8096 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:41.795155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669ea7e-8249-4df4-81ad-508b4e1d8096 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:41.796608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1669ea7e-8249-4df4-81ad-508b4e1d8096 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-1669ea7e-8249-4df4-81ad-508b4e1d8096 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:41.812010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:41.814161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:41.816316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:41.816316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:41.816316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:41.816316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:41.816316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:41.816316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:41.816316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:41.816316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:41.820617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 483/948] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:41.820830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87781a27-982c-457c-aeb8-400e754647ac None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:41.929275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87781a27-982c-457c-aeb8-400e754647ac None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:41.971179 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55bc14-3587-4071-ac42-e5b60cfcdecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:41.971851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55bc14-3587-4071-ac42-e5b60cfcdecd None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:41.972431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55bc14-3587-4071-ac42-e5b60cfcdecd None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:41.972712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55bc14-3587-4071-ac42-e5b60cfcdecd None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:41.973515 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55bc14-3587-4071-ac42-e5b60cfcdecd None admin] RBAC: Adding query filter params (name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:41.973825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55bc14-3587-4071-ac42-e5b60cfcdecd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:41.975478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55bc14-3587-4071-ac42-e5b60cfcdecd None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:42.000927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 466/949] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:42.698043 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe59eb-f712-460e-a08c-23d0b99adf43 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:42.698998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe59eb-f712-460e-a08c-23d0b99adf43 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:42.698998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe59eb-f712-460e-a08c-23d0b99adf43 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:42.700281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 484/950] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:42.705778 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ea2f1-393b-484b-a274-b8285c583cef None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:42.706241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ea2f1-393b-484b-a274-b8285c583cef None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:42.706398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ea2f1-393b-484b-a274-b8285c583cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:42.724427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-1a6ea2f1-393b-484b-a274-b8285c583cef None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:42.725998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1a6ea2f1-393b-484b-a274-b8285c583cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:42.757143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:42.804920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 467/951] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:42.824212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe59eb-f712-460e-a08c-23d0b99adf43 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:42.928054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da61986-d40c-454c-99f4-34abca491a32 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:42.928382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da61986-d40c-454c-99f4-34abca491a32 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:42.928625 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da61986-d40c-454c-99f4-34abca491a32 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:42.930575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 468/952] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:42.936632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cab0d-e76a-46d5-a0c5-e16f78cddc48 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:42.937346 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cab0d-e76a-46d5-a0c5-e16f78cddc48 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:42.937834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296cab0d-e76a-46d5-a0c5-e16f78cddc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:42.941156 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe59eb-f712-460e-a08c-23d0b99adf43 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:42.942674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:42.960396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-296cab0d-e76a-46d5-a0c5-e16f78cddc48 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:42.960643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-296cab0d-e76a-46d5-a0c5-e16f78cddc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:42.979916 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ca1b8-89ed-432a-bf02-b90d16c4d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:42.981674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ca1b8-89ed-432a-bf02-b90d16c4d94c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:42.982441 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ca1b8-89ed-432a-bf02-b90d16c4d94c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:42.983261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ca1b8-89ed-432a-bf02-b90d16c4d94c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:42.983981 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ca1b8-89ed-432a-bf02-b90d16c4d94c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:42.985430 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ca1b8-89ed-432a-bf02-b90d16c4d94c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-992ca1b8-89ed-432a-bf02-b90d16c4d94c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:43.002791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:43.003995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:43.010068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 485/953] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 23 12:52:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:43.013115 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ca1b8-89ed-432a-bf02-b90d16c4d94c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:43.041231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 469/954] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:43.068547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cab0d-e76a-46d5-a0c5-e16f78cddc48 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:43.159330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ca1b8-89ed-432a-bf02-b90d16c4d94c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:43.181697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:43.188629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296cab0d-e76a-46d5-a0c5-e16f78cddc48 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:43.196612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db44b5-13d6-41b5-97ee-8aed95e488d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:43.197500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db44b5-13d6-41b5-97ee-8aed95e488d8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:43.197887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db44b5-13d6-41b5-97ee-8aed95e488d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:43.198266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db44b5-13d6-41b5-97ee-8aed95e488d8 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:43.199170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db44b5-13d6-41b5-97ee-8aed95e488d8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:43.199647 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db44b5-13d6-41b5-97ee-8aed95e488d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:43.201155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db44b5-13d6-41b5-97ee-8aed95e488d8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:43.211113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 486/955] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 23 12:52:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:43.212295 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db44b5-13d6-41b5-97ee-8aed95e488d8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:43.228144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a174a0a-8c27-4e1c-ac44-276970da3971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:43.229349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a174a0a-8c27-4e1c-ac44-276970da3971 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:43.230091 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a174a0a-8c27-4e1c-ac44-276970da3971 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:43.230727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a174a0a-8c27-4e1c-ac44-276970da3971 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:43.231592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a174a0a-8c27-4e1c-ac44-276970da3971 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:43.233243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a174a0a-8c27-4e1c-ac44-276970da3971 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-7a174a0a-8c27-4e1c-ac44-276970da3971 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:43.246124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:43.247275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:52:43.248135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:43.248901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:43.251110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 470/956] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:43.259527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a174a0a-8c27-4e1c-ac44-276970da3971 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:43.327689 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db44b5-13d6-41b5-97ee-8aed95e488d8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:43.375638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d62bc1-fcda-434b-b2ed-faf9207acfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:43.376974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d62bc1-fcda-434b-b2ed-faf9207acfd4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:43.377273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d62bc1-fcda-434b-b2ed-faf9207acfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:43.377823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d62bc1-fcda-434b-b2ed-faf9207acfd4 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:43.378908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d62bc1-fcda-434b-b2ed-faf9207acfd4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:43.379226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d62bc1-fcda-434b-b2ed-faf9207acfd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:43.379517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a174a0a-8c27-4e1c-ac44-276970da3971 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:43.380599 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d62bc1-fcda-434b-b2ed-faf9207acfd4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:43.388051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 487/957] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 23 12:52:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:43.396826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d62bc1-fcda-434b-b2ed-faf9207acfd4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:43.427454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2367c9-b2da-4eb4-b069-3efe77a02ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:43.428791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2367c9-b2da-4eb4-b069-3efe77a02ffa None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:43.429110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2367c9-b2da-4eb4-b069-3efe77a02ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:43.429660 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2367c9-b2da-4eb4-b069-3efe77a02ffa None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:43.430385 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2367c9-b2da-4eb4-b069-3efe77a02ffa None admin] RBAC: Adding query filter params (name=compute) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:43.430701 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2367c9-b2da-4eb4-b069-3efe77a02ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:43.432374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2367c9-b2da-4eb4-b069-3efe77a02ffa None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:43.444906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 471/958] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:43.447984 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2367c9-b2da-4eb4-b069-3efe77a02ffa None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:43.485336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:43.510321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:43.517373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d62bc1-fcda-434b-b2ed-faf9207acfd4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:43.553773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286e34a-29d8-457a-8c18-74e8a4b90002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:43.554447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286e34a-29d8-457a-8c18-74e8a4b90002 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:43.554730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286e34a-29d8-457a-8c18-74e8a4b90002 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:43.555009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7286e34a-29d8-457a-8c18-74e8a4b90002 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:43.556414 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286e34a-29d8-457a-8c18-74e8a4b90002 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:43.558074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7286e34a-29d8-457a-8c18-74e8a4b90002 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:43.575586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2367c9-b2da-4eb4-b069-3efe77a02ffa None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:43.610016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf76dc8-d811-46e6-91f6-326b9c731a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:43.610686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf76dc8-d811-46e6-91f6-326b9c731a79 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:43.610974 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf76dc8-d811-46e6-91f6-326b9c731a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:43.611253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf76dc8-d811-46e6-91f6-326b9c731a79 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:43.611968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf76dc8-d811-46e6-91f6-326b9c731a79 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:43.612278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf76dc8-d811-46e6-91f6-326b9c731a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:43.613756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf76dc8-d811-46e6-91f6-326b9c731a79 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:43.618543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 472/959] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:43.619733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94967ea0-5910-43c0-9c86-1ce495c89d45 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:43.620020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94967ea0-5910-43c0-9c86-1ce495c89d45 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:43.620348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94967ea0-5910-43c0-9c86-1ce495c89d45 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:43.624863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 473/960] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:43.627708 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26eee2-5b43-4704-aeac-be282d46b62e None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:43.628186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26eee2-5b43-4704-aeac-be282d46b62e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:43.628615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26eee2-5b43-4704-aeac-be282d46b62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:43.649504 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ed26eee2-5b43-4704-aeac-be282d46b62e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:43.651249 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ed26eee2-5b43-4704-aeac-be282d46b62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:43.665062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 488/961] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 23 12:52:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:52:43.748386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 474/962] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:43.773615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286e34a-29d8-457a-8c18-74e8a4b90002 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:43.893420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7286e34a-29d8-457a-8c18-74e8a4b90002 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:43.929859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3946b-2fa0-4837-baa9-47a43bd64277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:43.930686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3946b-2fa0-4837-baa9-47a43bd64277 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:43.930970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3946b-2fa0-4837-baa9-47a43bd64277 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:43.931248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3946b-2fa0-4837-baa9-47a43bd64277 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:43.943598 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3946b-2fa0-4837-baa9-47a43bd64277 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-eaa3946b-2fa0-4837-baa9-47a43bd64277 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:43.952300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:43.953254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:43.954245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 489/963] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jun 23 12:52:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:43.961887 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26eee2-5b43-4704-aeac-be282d46b62e None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:43.978945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:44.069590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26eee2-5b43-4704-aeac-be282d46b62e None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:44.106098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a4711-6343-4efd-a53a-1e07b652d875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:44.107135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a4711-6343-4efd-a53a-1e07b652d875 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:44.107623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a4711-6343-4efd-a53a-1e07b652d875 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:44.108119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a4711-6343-4efd-a53a-1e07b652d875 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:44.109130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a4711-6343-4efd-a53a-1e07b652d875 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:44.109640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a4711-6343-4efd-a53a-1e07b652d875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:44.111221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a4711-6343-4efd-a53a-1e07b652d875 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:44.125148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 475/964] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 23 12:52:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:44.126875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548b14-1c7c-424c-9c68-574ae5fb765f None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:44.127166 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548b14-1c7c-424c-9c68-574ae5fb765f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:44.127449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62548b14-1c7c-424c-9c68-574ae5fb765f None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:44.127743 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a4711-6343-4efd-a53a-1e07b652d875 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:44.128965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 490/965] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:44.134044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04825582-2eb6-45e6-a878-f63b78917def None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:44.134335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04825582-2eb6-45e6-a878-f63b78917def None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:44.134617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04825582-2eb6-45e6-a878-f63b78917def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:44.152242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-04825582-2eb6-45e6-a878-f63b78917def None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:44.153558 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-04825582-2eb6-45e6-a878-f63b78917def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:44.157639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:44.233662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 491/966] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:44.236710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:44.251513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04825582-2eb6-45e6-a878-f63b78917def None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:44.257172 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a4711-6343-4efd-a53a-1e07b652d875 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:44.307145 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a294f1-0ad3-42b6-9cd6-43172a3bf5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:44.308263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a294f1-0ad3-42b6-9cd6-43172a3bf5bf None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:44.308643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a294f1-0ad3-42b6-9cd6-43172a3bf5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:44.309609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a294f1-0ad3-42b6-9cd6-43172a3bf5bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:44.325085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a294f1-0ad3-42b6-9cd6-43172a3bf5bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:44.327093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a294f1-0ad3-42b6-9cd6-43172a3bf5bf None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-16a294f1-0ad3-42b6-9cd6-43172a3bf5bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:44.349508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:44.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:44.351422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:44.351422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:44.351422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:44.351422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:44.351422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 476/967] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:44.358655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a294f1-0ad3-42b6-9cd6-43172a3bf5bf None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:44.368883 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04825582-2eb6-45e6-a878-f63b78917def None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:44.412971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5e9a3-f0c5-4892-820e-769141a036cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:44.413828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e9a3-f0c5-4892-820e-769141a036cb None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:44.414388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e9a3-f0c5-4892-820e-769141a036cb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:44.414685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e9a3-f0c5-4892-820e-769141a036cb None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:44.415398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5e9a3-f0c5-4892-820e-769141a036cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:44.416851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5e9a3-f0c5-4892-820e-769141a036cb None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:44.418804 dv-cinder-847335-1-smb devstack@keystone.service[80299]: WARNING keystone.server.flask.common [None req-15a5e9a3-f0c5-4892-820e-769141a036cb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 12:52:44.460752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.sql.core [None req-15a5e9a3-f0c5-4892-820e-769141a036cb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 12:52:44.460752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 12:52:44.460752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [parameters: {'user_id': '747375bc7d424005a8fb1ee1cc3efe85', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 12:52:44.460752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80299) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 12:52:44.467789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a294f1-0ad3-42b6-9cd6-43172a3bf5bf None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-15a5e9a3-f0c5-4892-820e-769141a036cb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application conn.query(q) Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result.read() Jun 23 12:52:44.484971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 12:52:44.486763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application next(self.gen) Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application yield resource Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application next(self.gen) Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise self.value Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application session.commit() Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 12:52:44.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.session.flush() Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application compat.raise_( Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 12:52:44.489200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 12:52:44.490300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application conn.query(q) Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application result.read() Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 12:52:44.491497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [parameters: {'user_id': '747375bc7d424005a8fb1ee1cc3efe85', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:44.493455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 12:52:44.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 12:52:44.495241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 12:52:44.495241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 12:52:44.495241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 12:52:44.495241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 12:52:44.495241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 12:52:44.495241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:44.495241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 492/968] 10.222.0.16 () {60 vars in 1131 bytes} [Thu Jun 23 12:52:44 2022] POST /identity/v3/users => generated 160 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:44.495241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5e9a3-f0c5-4892-820e-769141a036cb None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:44.497142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:44.507746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:44.517439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283a282-09bf-428a-aab6-313df7d017c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:44.518389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283a282-09bf-428a-aab6-313df7d017c8 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:44.518901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283a282-09bf-428a-aab6-313df7d017c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:44.519386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283a282-09bf-428a-aab6-313df7d017c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:44.520348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283a282-09bf-428a-aab6-313df7d017c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:44.520894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283a282-09bf-428a-aab6-313df7d017c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:44.522474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283a282-09bf-428a-aab6-313df7d017c8 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:44.541099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 477/969] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:44.542803 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283a282-09bf-428a-aab6-313df7d017c8 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:44.607426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5e9a3-f0c5-4892-820e-769141a036cb None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:44.642673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502759a-9b7c-459e-a125-9ac35e4c6b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:44.643522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502759a-9b7c-459e-a125-9ac35e4c6b54 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:44.644038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502759a-9b7c-459e-a125-9ac35e4c6b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:44.644150 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502759a-9b7c-459e-a125-9ac35e4c6b54 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:44.650158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283a282-09bf-428a-aab6-313df7d017c8 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:44.652464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502759a-9b7c-459e-a125-9ac35e4c6b54 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:44.654251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502759a-9b7c-459e-a125-9ac35e4c6b54 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-f502759a-9b7c-459e-a125-9ac35e4c6b54 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:44.669266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:44.670228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:44.671169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:44.671169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:44.671169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:44.671169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:44.671169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:44.671169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:44.671169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:44.671169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:44.671169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 12:52:44.671169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:44.675428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 493/970] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:44.676352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502759a-9b7c-459e-a125-9ac35e4c6b54 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:44.690911 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6089f98-d642-4704-9342-060a083733b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:44.692042 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6089f98-d642-4704-9342-060a083733b7 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:44.692643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6089f98-d642-4704-9342-060a083733b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:44.693286 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6089f98-d642-4704-9342-060a083733b7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:44.701801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6089f98-d642-4704-9342-060a083733b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:44.703732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6089f98-d642-4704-9342-060a083733b7 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-e6089f98-d642-4704-9342-060a083733b7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:44.720144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:44.721127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:44.722079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:44.722079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:44.722079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:44.722079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:44.722079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:44.722079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:44.722079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:44.722079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:44.722079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 12:52:44.722079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:44.729227 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 478/971] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 23 12:52:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:44.730585 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6089f98-d642-4704-9342-060a083733b7 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:44.741008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:44.782624 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502759a-9b7c-459e-a125-9ac35e4c6b54 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:44.817222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:44.819760 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90547a-13de-4e76-8660-ce89d8850669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:44.820176 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90547a-13de-4e76-8660-ce89d8850669 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:44.820455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90547a-13de-4e76-8660-ce89d8850669 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:44.820745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90547a-13de-4e76-8660-ce89d8850669 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:44.821609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90547a-13de-4e76-8660-ce89d8850669 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:44.821925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90547a-13de-4e76-8660-ce89d8850669 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:44.823476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa90547a-13de-4e76-8660-ce89d8850669 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:44.845954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6089f98-d642-4704-9342-060a083733b7 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:44.872612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 494/972] 10.222.0.16 () {56 vars in 1101 bytes} [Thu Jun 23 12:52:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:44.885068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596211cc-9e6a-4c7e-bfa3-94b9a9aa4288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:44.886069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596211cc-9e6a-4c7e-bfa3-94b9a9aa4288 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:44.886463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596211cc-9e6a-4c7e-bfa3-94b9a9aa4288 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:44.886851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596211cc-9e6a-4c7e-bfa3-94b9a9aa4288 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:44.887842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596211cc-9e6a-4c7e-bfa3-94b9a9aa4288 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:44.888527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596211cc-9e6a-4c7e-bfa3-94b9a9aa4288 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:44.890147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596211cc-9e6a-4c7e-bfa3-94b9a9aa4288 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:44.911632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 479/973] 10.222.0.16 () {56 vars in 1149 bytes} [Thu Jun 23 12:52:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:44.918147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90547a-13de-4e76-8660-ce89d8850669 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:45.034537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa90547a-13de-4e76-8660-ce89d8850669 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:45.058018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:45.072878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242665b-8b29-4bde-9e97-4a3b1bcbcec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:45.076404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242665b-8b29-4bde-9e97-4a3b1bcbcec5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.076404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242665b-8b29-4bde-9e97-4a3b1bcbcec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.076404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242665b-8b29-4bde-9e97-4a3b1bcbcec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.144092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242665b-8b29-4bde-9e97-4a3b1bcbcec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:45.145911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242665b-8b29-4bde-9e97-4a3b1bcbcec5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:45.244571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 495/974] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:44 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:52:45.250066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596211cc-9e6a-4c7e-bfa3-94b9a9aa4288 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:45.353237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596211cc-9e6a-4c7e-bfa3-94b9a9aa4288 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:45.361512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:45.388833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b370e6f-432b-47b0-8ed4-cd23be4c97e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:45.389627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b370e6f-432b-47b0-8ed4-cd23be4c97e6 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.389915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b370e6f-432b-47b0-8ed4-cd23be4c97e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.390200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b370e6f-432b-47b0-8ed4-cd23be4c97e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.400378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b370e6f-432b-47b0-8ed4-cd23be4c97e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:45.402491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b370e6f-432b-47b0-8ed4-cd23be4c97e6 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-8b370e6f-432b-47b0-8ed4-cd23be4c97e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:45.422476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:45.423433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:45.424327 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:45.424327 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:45.424327 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:45.424327 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:45.428373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 480/975] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:45.429672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242665b-8b29-4bde-9e97-4a3b1bcbcec5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:45.452294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:45.535491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242665b-8b29-4bde-9e97-4a3b1bcbcec5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:45.571965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9763d-2616-4e68-94dc-528c7d7e9195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:45.572654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9763d-2616-4e68-94dc-528c7d7e9195 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.573006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9763d-2616-4e68-94dc-528c7d7e9195 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.573374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9763d-2616-4e68-94dc-528c7d7e9195 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.574145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9763d-2616-4e68-94dc-528c7d7e9195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:45.574475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9763d-2616-4e68-94dc-528c7d7e9195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:45.575844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9763d-2616-4e68-94dc-528c7d7e9195 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:45.592308 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 496/976] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:45.593583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b370e6f-432b-47b0-8ed4-cd23be4c97e6 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:45.699292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b370e6f-432b-47b0-8ed4-cd23be4c97e6 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:45.734005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e2056-966d-4da9-a79b-a3dc6fa4e2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:45.734800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e2056-966d-4da9-a79b-a3dc6fa4e2bd None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.735084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e2056-966d-4da9-a79b-a3dc6fa4e2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.735373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e2056-966d-4da9-a79b-a3dc6fa4e2bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.742431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e2056-966d-4da9-a79b-a3dc6fa4e2bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:45.743894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e2056-966d-4da9-a79b-a3dc6fa4e2bd None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-400e2056-966d-4da9-a79b-a3dc6fa4e2bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:45.758351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:45.759246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:45.760144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:45.760144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:45.760144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:45.760144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:45.760144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:45.760144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:45.760144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:45.760144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:45.760144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 481/977] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:45.768148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9763d-2616-4e68-94dc-528c7d7e9195 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:45.770905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a90bc1-9bad-440a-b786-79165696d0b7 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.771196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a90bc1-9bad-440a-b786-79165696d0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.771471 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a90bc1-9bad-440a-b786-79165696d0b7 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.772963 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 482/978] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:45.778155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36094f9b-097b-4279-8851-37d0628cc980 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.778440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36094f9b-097b-4279-8851-37d0628cc980 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.778719 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36094f9b-097b-4279-8851-37d0628cc980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.796627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-36094f9b-097b-4279-8851-37d0628cc980 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:45.797862 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-36094f9b-097b-4279-8851-37d0628cc980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:45.812355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:45.863751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:45.872850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 483/979] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:45.886229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9763d-2616-4e68-94dc-528c7d7e9195 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:45.894453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36094f9b-097b-4279-8851-37d0628cc980 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:45.926519 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37931736-c471-49b7-b8e5-700b5060d17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:45.927198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37931736-c471-49b7-b8e5-700b5060d17e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.927533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37931736-c471-49b7-b8e5-700b5060d17e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.927844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37931736-c471-49b7-b8e5-700b5060d17e None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.928678 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37931736-c471-49b7-b8e5-700b5060d17e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:45.929027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37931736-c471-49b7-b8e5-700b5060d17e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:45.930457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37931736-c471-49b7-b8e5-700b5060d17e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:45.946750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 497/980] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:45.946750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e545810-b0dc-4873-a261-04619973c98c None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:45.946750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e545810-b0dc-4873-a261-04619973c98c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:45.946750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e545810-b0dc-4873-a261-04619973c98c None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:45.946750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 498/981] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:45.949429 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e545810-b0dc-4873-a261-04619973c98c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:45.998780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36094f9b-097b-4279-8851-37d0628cc980 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.033242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752014f-7e5d-4162-8861-fe91d4896389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.033900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752014f-7e5d-4162-8861-fe91d4896389 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.034188 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752014f-7e5d-4162-8861-fe91d4896389 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.034464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752014f-7e5d-4162-8861-fe91d4896389 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.035175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752014f-7e5d-4162-8861-fe91d4896389 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.036550 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752014f-7e5d-4162-8861-fe91d4896389 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.050820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e545810-b0dc-4873-a261-04619973c98c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.083701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f228dea-e51c-471f-b60b-0e247442a1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.084363 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f228dea-e51c-471f-b60b-0e247442a1da None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.084679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f228dea-e51c-471f-b60b-0e247442a1da None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.085015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f228dea-e51c-471f-b60b-0e247442a1da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.085861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f228dea-e51c-471f-b60b-0e247442a1da None admin] RBAC: Adding query filter params (role.id=be5e149a2c4b4be79c9dbb018b5975d4, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=6af4358779f947acade2ed0293893b89) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:46.086184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f228dea-e51c-471f-b60b-0e247442a1da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.087624 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f228dea-e51c-471f-b60b-0e247442a1da None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.093573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 499/982] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:45 2022] GET /identity/v3/role_assignments?user.id=6af4358779f947acade2ed0293893b89&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=be5e149a2c4b4be79c9dbb018b5975d4 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:46.094718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5f545-13b5-4a61-8f56-94fb731b7a05 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.095038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5f545-13b5-4a61-8f56-94fb731b7a05 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.095350 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5f545-13b5-4a61-8f56-94fb731b7a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.107793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 484/983] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:52:45 2022] POST /identity/v3/services => generated 242 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:46.110172 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.123322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bfc5f545-13b5-4a61-8f56-94fb731b7a05 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:46.125048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bfc5f545-13b5-4a61-8f56-94fb731b7a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:46.215620 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 500/984] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:46.239824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752014f-7e5d-4162-8861-fe91d4896389 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.253577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.365912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752014f-7e5d-4162-8861-fe91d4896389 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.400794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76ee8f-198d-4a4c-995d-22f69bd49538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.401855 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ee8f-198d-4a4c-995d-22f69bd49538 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.402144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ee8f-198d-4a4c-995d-22f69bd49538 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.402422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76ee8f-198d-4a4c-995d-22f69bd49538 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.403080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76ee8f-198d-4a4c-995d-22f69bd49538 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.404464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76ee8f-198d-4a4c-995d-22f69bd49538 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-5a76ee8f-198d-4a4c-995d-22f69bd49538 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:46.416624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:46.417753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:46.418603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 485/985] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:46.425403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5f545-13b5-4a61-8f56-94fb731b7a05 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.530349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc5f545-13b5-4a61-8f56-94fb731b7a05 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.560456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.566656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f61b2-ab38-4a2e-ac57-5c3f4b9b31fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.567366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f61b2-ab38-4a2e-ac57-5c3f4b9b31fd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.567791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f61b2-ab38-4a2e-ac57-5c3f4b9b31fd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.568071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f61b2-ab38-4a2e-ac57-5c3f4b9b31fd None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.568830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f61b2-ab38-4a2e-ac57-5c3f4b9b31fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:46.569177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f61b2-ab38-4a2e-ac57-5c3f4b9b31fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.570556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f61b2-ab38-4a2e-ac57-5c3f4b9b31fd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.580408 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 501/986] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:46.582181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76ee8f-198d-4a4c-995d-22f69bd49538 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.669059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:46.704211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76ee8f-198d-4a4c-995d-22f69bd49538 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.738006 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dcbee-1c66-46bd-8776-2af71ffbfb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.738670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dcbee-1c66-46bd-8776-2af71ffbfb12 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.738952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dcbee-1c66-46bd-8776-2af71ffbfb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.739228 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853dcbee-1c66-46bd-8776-2af71ffbfb12 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.739936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dcbee-1c66-46bd-8776-2af71ffbfb12 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:46.740241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dcbee-1c66-46bd-8776-2af71ffbfb12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.741645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853dcbee-1c66-46bd-8776-2af71ffbfb12 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.751864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 486/987] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:46.753147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f61b2-ab38-4a2e-ac57-5c3f4b9b31fd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:46.880958 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f61b2-ab38-4a2e-ac57-5c3f4b9b31fd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:46.918397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13114c-b434-4327-ada5-ced7ed15ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:46.919063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13114c-b434-4327-ada5-ced7ed15ea96 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:46.919343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13114c-b434-4327-ada5-ced7ed15ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:46.919614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13114c-b434-4327-ada5-ced7ed15ea96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:46.920412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13114c-b434-4327-ada5-ced7ed15ea96 None admin] RBAC: Adding query filter params (interface=admin, service_id=4321d7f66a9746df946d52aba8fd6c7e, region_id=RegionOne) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:46.920724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13114c-b434-4327-ada5-ced7ed15ea96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:46.922115 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13114c-b434-4327-ada5-ced7ed15ea96 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:46.931705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 502/988] 10.222.0.16 () {56 vars in 1249 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/endpoints?service_id=4321d7f66a9746df946d52aba8fd6c7e&interface=admin®ion_id=RegionOne => generated 193 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:46.933406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dcbee-1c66-46bd-8776-2af71ffbfb12 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:47.037821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853dcbee-1c66-46bd-8776-2af71ffbfb12 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:47.072254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2d45d-d6dc-4386-91a9-bd5f01a6d098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:47.072946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2d45d-d6dc-4386-91a9-bd5f01a6d098 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:47.073488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2d45d-d6dc-4386-91a9-bd5f01a6d098 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:47.073779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2d45d-d6dc-4386-91a9-bd5f01a6d098 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:47.074463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2d45d-d6dc-4386-91a9-bd5f01a6d098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:47.075833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2d45d-d6dc-4386-91a9-bd5f01a6d098 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:47.077601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:47.089332 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 487/989] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 23 12:52:46 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:52:48.228274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735b366-1fe7-4694-919a-dec97167407e None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.228798 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735b366-1fe7-4694-919a-dec97167407e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.228798 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735b366-1fe7-4694-919a-dec97167407e None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.230814 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 503/990] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:48.235995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70022ef7-e3ab-4a64-850d-46e1c591bca2 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.236386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70022ef7-e3ab-4a64-850d-46e1c591bca2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.236568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70022ef7-e3ab-4a64-850d-46e1c591bca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.253231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-70022ef7-e3ab-4a64-850d-46e1c591bca2 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:48.254416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-70022ef7-e3ab-4a64-850d-46e1c591bca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:48.268455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c710-a1e3-48d4-8c97-b20696df084d None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.268751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c710-a1e3-48d4-8c97-b20696df084d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.269039 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c710-a1e3-48d4-8c97-b20696df084d None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.270655 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 504/991] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:48.275361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e762-29e8-4f83-aa07-58fc87a539a3 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.275673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e762-29e8-4f83-aa07-58fc87a539a3 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.275935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930e762-29e8-4f83-aa07-58fc87a539a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.294221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e930e762-29e8-4f83-aa07-58fc87a539a3 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:48.295413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e930e762-29e8-4f83-aa07-58fc87a539a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:48.330782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 488/992] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:48.353158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70022ef7-e3ab-4a64-850d-46e1c591bca2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:48.369188 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:48.388846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 505/993] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:48.411605 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e762-29e8-4f83-aa07-58fc87a539a3 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:48.466578 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70022ef7-e3ab-4a64-850d-46e1c591bca2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:48.499375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:48.505225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e02f62-f8ba-4d50-8b6f-27824ac34fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:48.508123 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e02f62-f8ba-4d50-8b6f-27824ac34fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.508123 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e02f62-f8ba-4d50-8b6f-27824ac34fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.508123 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e02f62-f8ba-4d50-8b6f-27824ac34fb5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.508123 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e02f62-f8ba-4d50-8b6f-27824ac34fb5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:48.508565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e02f62-f8ba-4d50-8b6f-27824ac34fb5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:48.516147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930e762-29e8-4f83-aa07-58fc87a539a3 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-08e02f62-f8ba-4d50-8b6f-27824ac34fb5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:48.520444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:48.521640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:48.522502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 489/994] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Jun 23 12:52:48 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:48.529424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e02f62-f8ba-4d50-8b6f-27824ac34fb5 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:48.556474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45f761-e051-4d37-bbb9-519e672f9e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:48.557324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45f761-e051-4d37-bbb9-519e672f9e7d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.557640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45f761-e051-4d37-bbb9-519e672f9e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.557925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45f761-e051-4d37-bbb9-519e672f9e7d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.558582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45f761-e051-4d37-bbb9-519e672f9e7d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:48.560101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45f761-e051-4d37-bbb9-519e672f9e7d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-1d45f761-e051-4d37-bbb9-519e672f9e7d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:48.571899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:48.572896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:48.573906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 506/995] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:48.578965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45f761-e051-4d37-bbb9-519e672f9e7d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:48.631912 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:48.638310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e02f62-f8ba-4d50-8b6f-27824ac34fb5 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:48.674390 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4c8b5-2834-4b25-84e3-f4d749fcdaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:48.675409 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4c8b5-2834-4b25-84e3-f4d749fcdaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.675992 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4c8b5-2834-4b25-84e3-f4d749fcdaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.676277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4c8b5-2834-4b25-84e3-f4d749fcdaf1 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.677020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4c8b5-2834-4b25-84e3-f4d749fcdaf1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:48.677332 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4c8b5-2834-4b25-84e3-f4d749fcdaf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:48.678931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4c8b5-2834-4b25-84e3-f4d749fcdaf1 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:48.681461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45f761-e051-4d37-bbb9-519e672f9e7d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:48.684583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 490/996] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:48.689989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4c8b5-2834-4b25-84e3-f4d749fcdaf1 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:48.717335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709625b9-0b2d-45b8-992a-fd9ae3e3188f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:48.718016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709625b9-0b2d-45b8-992a-fd9ae3e3188f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.718298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709625b9-0b2d-45b8-992a-fd9ae3e3188f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.718678 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709625b9-0b2d-45b8-992a-fd9ae3e3188f None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.720023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709625b9-0b2d-45b8-992a-fd9ae3e3188f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:48.720566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709625b9-0b2d-45b8-992a-fd9ae3e3188f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:48.723212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709625b9-0b2d-45b8-992a-fd9ae3e3188f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:48.728668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 507/997] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:48.734959 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709625b9-0b2d-45b8-992a-fd9ae3e3188f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:48.757614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:48.802481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4c8b5-2834-4b25-84e3-f4d749fcdaf1 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:48.836526 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2be4dd-982c-458b-929a-c0705330c0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:48.837227 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2be4dd-982c-458b-929a-c0705330c0ea None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.837511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2be4dd-982c-458b-929a-c0705330c0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.837795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2be4dd-982c-458b-929a-c0705330c0ea None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.838506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2be4dd-982c-458b-929a-c0705330c0ea None admin] RBAC: Adding query filter params (type=image) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:48.839424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2be4dd-982c-458b-929a-c0705330c0ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:48.840788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2be4dd-982c-458b-929a-c0705330c0ea None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:48.845425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 491/998] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:48.847627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709625b9-0b2d-45b8-992a-fd9ae3e3188f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:48.873804 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:48.894812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285eaf-4701-4c3f-8d51-e178b75006d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:48.895505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285eaf-4701-4c3f-8d51-e178b75006d0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:48.895787 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285eaf-4701-4c3f-8d51-e178b75006d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:48.896063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285eaf-4701-4c3f-8d51-e178b75006d0 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:48.896789 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6285eaf-4701-4c3f-8d51-e178b75006d0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:48.897175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6285eaf-4701-4c3f-8d51-e178b75006d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:48.898684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6285eaf-4701-4c3f-8d51-e178b75006d0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:48.905550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 508/999] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:48.912921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2be4dd-982c-458b-929a-c0705330c0ea None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:49.025729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2be4dd-982c-458b-929a-c0705330c0ea None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:49.050152 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:49.062553 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f0df4-ae0f-49c9-81ce-48d927622a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:49.063226 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f0df4-ae0f-49c9-81ce-48d927622a1f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:49.066348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f0df4-ae0f-49c9-81ce-48d927622a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:49.066348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f0df4-ae0f-49c9-81ce-48d927622a1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:49.066348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f0df4-ae0f-49c9-81ce-48d927622a1f None admin] RBAC: Adding query filter params (interface=public, service_id=b40a1fa828df4e648dc67ea685ed01d7, region_id=RegionOne) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:49.066348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f0df4-ae0f-49c9-81ce-48d927622a1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:49.066348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f0df4-ae0f-49c9-81ce-48d927622a1f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:49.078461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 492/1000] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 23 12:52:48 2022] GET /identity/v3/endpoints?service_id=b40a1fa828df4e648dc67ea685ed01d7&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:49.079445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285eaf-4701-4c3f-8d51-e178b75006d0 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:49.186241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285eaf-4701-4c3f-8d51-e178b75006d0 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:49.206243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3835edb-e5ca-486b-ac29-7765b9c070e7 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:49.206532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3835edb-e5ca-486b-ac29-7765b9c070e7 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:49.206817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3835edb-e5ca-486b-ac29-7765b9c070e7 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:49.208347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 493/1001] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:49.213214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1502a-4c42-401c-b547-116a99486c9f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:49.213509 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1502a-4c42-401c-b547-116a99486c9f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:49.214323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1502a-4c42-401c-b547-116a99486c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:49.221386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631cc0b-cbd4-4247-a567-9c4fa83c2320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:49.222056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631cc0b-cbd4-4247-a567-9c4fa83c2320 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:49.222338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631cc0b-cbd4-4247-a567-9c4fa83c2320 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:49.222612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631cc0b-cbd4-4247-a567-9c4fa83c2320 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:49.223290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631cc0b-cbd4-4247-a567-9c4fa83c2320 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:49.224649 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631cc0b-cbd4-4247-a567-9c4fa83c2320 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:49.231737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ebe1502a-4c42-401c-b547-116a99486c9f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:49.232360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 509/1002] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 23 12:52:49 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:52:49.232972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ebe1502a-4c42-401c-b547-116a99486c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:49.317267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 494/1003] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:49.332431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631cc0b-cbd4-4247-a567-9c4fa83c2320 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:49.385731 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:49.446285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631cc0b-cbd4-4247-a567-9c4fa83c2320 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:49.481947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226610a-0608-409c-b8a7-48558bd022f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:49.483056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226610a-0608-409c-b8a7-48558bd022f5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:49.483545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226610a-0608-409c-b8a7-48558bd022f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:49.483994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226610a-0608-409c-b8a7-48558bd022f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:49.484841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226610a-0608-409c-b8a7-48558bd022f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:49.486411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226610a-0608-409c-b8a7-48558bd022f5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-3226610a-0608-409c-b8a7-48558bd022f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:49.498877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:49.500080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 12:52:49.501112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:49.507071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 510/1004] 10.222.0.16 () {56 vars in 1126 bytes} [Thu Jun 23 12:52:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:49.508278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1502a-4c42-401c-b547-116a99486c9f None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:49.624663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1502a-4c42-401c-b547-116a99486c9f None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:49.641966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:49.659519 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9109-620f-4981-b479-5ec8d893d947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:49.660379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9109-620f-4981-b479-5ec8d893d947 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:49.660824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9109-620f-4981-b479-5ec8d893d947 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:49.661263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a9109-620f-4981-b479-5ec8d893d947 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:49.662118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a9109-620f-4981-b479-5ec8d893d947 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:49.662562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a9109-620f-4981-b479-5ec8d893d947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:49.664066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a9109-620f-4981-b479-5ec8d893d947 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:49.673684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 495/1005] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 23 12:52:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:49.674877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226610a-0608-409c-b8a7-48558bd022f5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:49.777926 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226610a-0608-409c-b8a7-48558bd022f5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:49.787010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:49.811975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a461d2-fdac-4c4f-87bc-5cfb8092f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:49.812648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a461d2-fdac-4c4f-87bc-5cfb8092f0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:49.812967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a461d2-fdac-4c4f-87bc-5cfb8092f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:49.813247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a461d2-fdac-4c4f-87bc-5cfb8092f0b9 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:49.813955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a461d2-fdac-4c4f-87bc-5cfb8092f0b9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:49.814264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a461d2-fdac-4c4f-87bc-5cfb8092f0b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:49.815736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a461d2-fdac-4c4f-87bc-5cfb8092f0b9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:49.825071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 511/1006] 10.222.0.16 () {56 vars in 1122 bytes} [Thu Jun 23 12:52:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:49.827539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9109-620f-4981-b479-5ec8d893d947 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:49.948039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a9109-620f-4981-b479-5ec8d893d947 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:49.984995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb6e67-056b-4d8a-8c03-63abb2bd7ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:49.985661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb6e67-056b-4d8a-8c03-63abb2bd7ac5 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:49.985944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb6e67-056b-4d8a-8c03-63abb2bd7ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:49.986218 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb6e67-056b-4d8a-8c03-63abb2bd7ac5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:49.986955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb6e67-056b-4d8a-8c03-63abb2bd7ac5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:49.988337 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb6e67-056b-4d8a-8c03-63abb2bd7ac5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:50.072827 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 496/1007] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 23 12:52:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:50.934997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263b45-4904-4715-a96b-4b05d304a88b None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:50.935501 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263b45-4904-4715-a96b-4b05d304a88b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:50.935577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6263b45-4904-4715-a96b-4b05d304a88b None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:50.937094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 512/1008] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:50.942056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498c024-a14c-494a-b074-c35a030e30e5 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:50.942449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498c024-a14c-494a-b074-c35a030e30e5 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:50.942613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498c024-a14c-494a-b074-c35a030e30e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:50.959251 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-f498c024-a14c-494a-b074-c35a030e30e5 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:50.960432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f498c024-a14c-494a-b074-c35a030e30e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:50.995553 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:51.036243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 497/1009] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:50 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:51.059634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6263b45-4904-4715-a96b-4b05d304a88b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.174845 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6263b45-4904-4715-a96b-4b05d304a88b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.211390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd195ea5-f97b-4e9d-b76a-bae32378c5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.212073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd195ea5-f97b-4e9d-b76a-bae32378c5be None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.212357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd195ea5-f97b-4e9d-b76a-bae32378c5be None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.212638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd195ea5-f97b-4e9d-b76a-bae32378c5be None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.213415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd195ea5-f97b-4e9d-b76a-bae32378c5be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:51.215395 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd195ea5-f97b-4e9d-b76a-bae32378c5be None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:51.313173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 513/1010] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:52:51 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:52:51.342955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775f098-221e-4abf-a42f-5c9200fe8ae2 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.343241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775f098-221e-4abf-a42f-5c9200fe8ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.343523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775f098-221e-4abf-a42f-5c9200fe8ae2 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.344956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 498/1011] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:51.350675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70300-52db-453e-bf71-47e7f11c1a56 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.350958 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70300-52db-453e-bf71-47e7f11c1a56 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.351271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70300-52db-453e-bf71-47e7f11c1a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.370266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6ab70300-52db-453e-bf71-47e7f11c1a56 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:51.372126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6ab70300-52db-453e-bf71-47e7f11c1a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:51.403571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:51.454789 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 514/1012] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:51 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:51.478023 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775f098-221e-4abf-a42f-5c9200fe8ae2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.591887 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775f098-221e-4abf-a42f-5c9200fe8ae2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.630910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15888b2c-23ac-4846-a75a-928cc3502354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.631716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15888b2c-23ac-4846-a75a-928cc3502354 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.632005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15888b2c-23ac-4846-a75a-928cc3502354 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.632283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15888b2c-23ac-4846-a75a-928cc3502354 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.632964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15888b2c-23ac-4846-a75a-928cc3502354 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:51.634398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15888b2c-23ac-4846-a75a-928cc3502354 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-15888b2c-23ac-4846-a75a-928cc3502354 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:51.646802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:51.647772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:51.648615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 499/1013] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:51.656449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab70300-52db-453e-bf71-47e7f11c1a56 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.757739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab70300-52db-453e-bf71-47e7f11c1a56 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.792690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77b4d5-ac24-4c6f-a9c8-efbd0e720f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.793401 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77b4d5-ac24-4c6f-a9c8-efbd0e720f99 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.793684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77b4d5-ac24-4c6f-a9c8-efbd0e720f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.793962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77b4d5-ac24-4c6f-a9c8-efbd0e720f99 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.794665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77b4d5-ac24-4c6f-a9c8-efbd0e720f99 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:51.794971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77b4d5-ac24-4c6f-a9c8-efbd0e720f99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:51.796333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77b4d5-ac24-4c6f-a9c8-efbd0e720f99 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:51.805943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 515/1014] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:51.808166 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15888b2c-23ac-4846-a75a-928cc3502354 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.842227 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:51.919818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15888b2c-23ac-4846-a75a-928cc3502354 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:51.954417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df2a1-bb8b-4bd1-b7a9-db3a6f8ba0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:51.955168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df2a1-bb8b-4bd1-b7a9-db3a6f8ba0da None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:51.955362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df2a1-bb8b-4bd1-b7a9-db3a6f8ba0da None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:51.955639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df2a1-bb8b-4bd1-b7a9-db3a6f8ba0da None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:51.956352 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df2a1-bb8b-4bd1-b7a9-db3a6f8ba0da None admin] RBAC: Adding query filter params (type=compute) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:51.956660 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df2a1-bb8b-4bd1-b7a9-db3a6f8ba0da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:51.958071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df2a1-bb8b-4bd1-b7a9-db3a6f8ba0da None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:51.963282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 500/1015] 10.222.0.16 () {56 vars in 1112 bytes} [Thu Jun 23 12:52:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:51.969022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77b4d5-ac24-4c6f-a9c8-efbd0e720f99 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:51.995850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:52.071488 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77b4d5-ac24-4c6f-a9c8-efbd0e720f99 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.105880 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275bcaf-d28e-4452-9c19-5cff37ef3bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.106546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275bcaf-d28e-4452-9c19-5cff37ef3bd2 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.106830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275bcaf-d28e-4452-9c19-5cff37ef3bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.107109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275bcaf-d28e-4452-9c19-5cff37ef3bd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.107860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275bcaf-d28e-4452-9c19-5cff37ef3bd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:52.109249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275bcaf-d28e-4452-9c19-5cff37ef3bd2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:52.160099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec600c-a090-4ed8-9467-dfaa4dee81f3 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.160404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec600c-a090-4ed8-9467-dfaa4dee81f3 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.160686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec600c-a090-4ed8-9467-dfaa4dee81f3 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.162139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 501/1016] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:52.167594 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6fa3f-566c-4cc1-9ebc-d5e75cdd6475 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.167964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6fa3f-566c-4cc1-9ebc-d5e75cdd6475 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.168247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6fa3f-566c-4cc1-9ebc-d5e75cdd6475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.175723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 516/1017] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 23 12:52:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:52.186854 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-9af6fa3f-566c-4cc1-9ebc-d5e75cdd6475 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:52.188112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9af6fa3f-566c-4cc1-9ebc-d5e75cdd6475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:52.271093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 502/1018] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:52.295736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275bcaf-d28e-4452-9c19-5cff37ef3bd2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.382842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:52.406847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275bcaf-d28e-4452-9c19-5cff37ef3bd2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.443890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6b8a6-8732-4932-bc85-3c4390bab17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.444997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6b8a6-8732-4932-bc85-3c4390bab17e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.445435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6b8a6-8732-4932-bc85-3c4390bab17e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.445715 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6b8a6-8732-4932-bc85-3c4390bab17e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.446913 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6b8a6-8732-4932-bc85-3c4390bab17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:52.448583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6b8a6-8732-4932-bc85-3c4390bab17e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:52.453091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 517/1019] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:52.456395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6fa3f-566c-4cc1-9ebc-d5e75cdd6475 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:52.481235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:52.562803 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6fa3f-566c-4cc1-9ebc-d5e75cdd6475 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:52.597086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99322afc-e73f-4803-8af7-2aa93eac2ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:52.597752 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322afc-e73f-4803-8af7-2aa93eac2ec0 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:52.598036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322afc-e73f-4803-8af7-2aa93eac2ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:52.598315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322afc-e73f-4803-8af7-2aa93eac2ec0 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:52.599019 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99322afc-e73f-4803-8af7-2aa93eac2ec0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:52.600458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99322afc-e73f-4803-8af7-2aa93eac2ec0 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:52.688134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 503/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:52:52 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:52:53.507665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dbf44-82ef-48df-b3e3-5ecdecd622fc None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.508194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dbf44-82ef-48df-b3e3-5ecdecd622fc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.508305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762dbf44-82ef-48df-b3e3-5ecdecd622fc None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.509822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 518/1021] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:53.515461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c0efa-c5be-4cfb-9e54-26ce26b7c38c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.515920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c0efa-c5be-4cfb-9e54-26ce26b7c38c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.516098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c0efa-c5be-4cfb-9e54-26ce26b7c38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.534367 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-b17c0efa-c5be-4cfb-9e54-26ce26b7c38c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:53.535709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b17c0efa-c5be-4cfb-9e54-26ce26b7c38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:53.614298 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 504/1022] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:53.637134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dbf44-82ef-48df-b3e3-5ecdecd622fc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:53.739179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762dbf44-82ef-48df-b3e3-5ecdecd622fc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:53.773698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b91c2-36c2-4cb0-9c8e-b11d9f622ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:53.774419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b91c2-36c2-4cb0-9c8e-b11d9f622ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.774705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b91c2-36c2-4cb0-9c8e-b11d9f622ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.774982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b91c2-36c2-4cb0-9c8e-b11d9f622ae7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.775631 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b91c2-36c2-4cb0-9c8e-b11d9f622ae7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:53.777096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b91c2-36c2-4cb0-9c8e-b11d9f622ae7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-f71b91c2-36c2-4cb0-9c8e-b11d9f622ae7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:53.788438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:53.789591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:52:53.790506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:53.793144 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 519/1023] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Jun 23 12:52:53 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:53.795570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c0efa-c5be-4cfb-9e54-26ce26b7c38c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:53.797820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:53.903948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c0efa-c5be-4cfb-9e54-26ce26b7c38c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:53.939649 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa7180-0968-408c-aee4-b0814daa37c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:53.940330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa7180-0968-408c-aee4-b0814daa37c7 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:53.940618 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa7180-0968-408c-aee4-b0814daa37c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:53.940923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa7180-0968-408c-aee4-b0814daa37c7 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:53.941645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa7180-0968-408c-aee4-b0814daa37c7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:53.941958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa7180-0968-408c-aee4-b0814daa37c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:53.943406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aa7180-0968-408c-aee4-b0814daa37c7 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:53.948876 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 505/1024] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:53.954692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b91c2-36c2-4cb0-9c8e-b11d9f622ae7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:53.970288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:54.059003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b91c2-36c2-4cb0-9c8e-b11d9f622ae7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:54.091855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c393c2-a8e5-4e7e-b267-7bc86a6fe3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:54.092526 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c393c2-a8e5-4e7e-b267-7bc86a6fe3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:54.092834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c393c2-a8e5-4e7e-b267-7bc86a6fe3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:54.093111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c393c2-a8e5-4e7e-b267-7bc86a6fe3e9 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:54.093819 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c393c2-a8e5-4e7e-b267-7bc86a6fe3e9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:54.094126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c393c2-a8e5-4e7e-b267-7bc86a6fe3e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:54.095480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c393c2-a8e5-4e7e-b267-7bc86a6fe3e9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:54.105706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 520/1025] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:53 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:54.106942 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa7180-0968-408c-aee4-b0814daa37c7 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:54.177615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:54.212728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa7180-0968-408c-aee4-b0814daa37c7 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:54.246431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01442c-8b43-4cbc-ba84-a4cefed92963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:54.247096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01442c-8b43-4cbc-ba84-a4cefed92963 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:54.247384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01442c-8b43-4cbc-ba84-a4cefed92963 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:54.247662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01442c-8b43-4cbc-ba84-a4cefed92963 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:54.248458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01442c-8b43-4cbc-ba84-a4cefed92963 None admin] RBAC: Adding query filter params (interface=public, service_id=9f2dca9634ca4774ab8765082ae9df44, region_id=RegionOne) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:54.248774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01442c-8b43-4cbc-ba84-a4cefed92963 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:54.250176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01442c-8b43-4cbc-ba84-a4cefed92963 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:54.255380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 506/1026] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 23 12:52:54 2022] GET /identity/v3/endpoints?service_id=9f2dca9634ca4774ab8765082ae9df44&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:54.261263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c393c2-a8e5-4e7e-b267-7bc86a6fe3e9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:54.337887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:54.362590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c393c2-a8e5-4e7e-b267-7bc86a6fe3e9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:54.397902 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f701a-f25c-4ec7-9556-69229d298ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:54.398574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f701a-f25c-4ec7-9556-69229d298ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:54.398849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f701a-f25c-4ec7-9556-69229d298ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:54.399124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f701a-f25c-4ec7-9556-69229d298ba5 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:54.399798 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f701a-f25c-4ec7-9556-69229d298ba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:54.401292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f701a-f25c-4ec7-9556-69229d298ba5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:54.408675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 521/1027] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 23 12:52:54 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 12:52:54.479309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37878a-7af7-40eb-99ed-58589455a37f None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:54.479631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37878a-7af7-40eb-99ed-58589455a37f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:54.479988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37878a-7af7-40eb-99ed-58589455a37f None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:54.481545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 507/1028] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:54.487044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2de1d8-2d26-4ebb-ba1d-47a85847256d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:54.487351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2de1d8-2d26-4ebb-ba1d-47a85847256d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:54.487619 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2de1d8-2d26-4ebb-ba1d-47a85847256d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:54.506299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2b2de1d8-2d26-4ebb-ba1d-47a85847256d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:54.512432 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2b2de1d8-2d26-4ebb-ba1d-47a85847256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:54.584200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 522/1029] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:54.610086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37878a-7af7-40eb-99ed-58589455a37f None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:54.716214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37878a-7af7-40eb-99ed-58589455a37f None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:54.745597 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:54.751896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8fa65-8e5e-4a8a-83d2-63fa2ea1b5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:54.752707 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8fa65-8e5e-4a8a-83d2-63fa2ea1b5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:54.753020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8fa65-8e5e-4a8a-83d2-63fa2ea1b5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:54.753294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8fa65-8e5e-4a8a-83d2-63fa2ea1b5d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:54.763791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8fa65-8e5e-4a8a-83d2-63fa2ea1b5d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-edd8fa65-8e5e-4a8a-83d2-63fa2ea1b5d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:54.775558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:54.776747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:54.777922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 508/1030] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jun 23 12:52:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:54.779565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2de1d8-2d26-4ebb-ba1d-47a85847256d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:54.847634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:54.888494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2de1d8-2d26-4ebb-ba1d-47a85847256d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:54.924157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aac98e-bb01-4631-af4f-0d1a798064b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:54.925127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aac98e-bb01-4631-af4f-0d1a798064b5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:54.925411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aac98e-bb01-4631-af4f-0d1a798064b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:54.925685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aac98e-bb01-4631-af4f-0d1a798064b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:54.926013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3178b5a-8355-4794-ac82-15cbe236e405 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:54.926307 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3178b5a-8355-4794-ac82-15cbe236e405 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:54.926474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aac98e-bb01-4631-af4f-0d1a798064b5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:54.926645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3178b5a-8355-4794-ac82-15cbe236e405 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:54.926739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aac98e-bb01-4631-af4f-0d1a798064b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:54.927982 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 509/1031] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:54.928098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aac98e-bb01-4631-af4f-0d1a798064b5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:54.935261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1801a52-8f33-4e8a-8c0d-90606e893c6e None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:54.935563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1801a52-8f33-4e8a-8c0d-90606e893c6e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:54.935829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1801a52-8f33-4e8a-8c0d-90606e893c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:54.939274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 523/1032] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 23 12:52:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:54.944537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aac98e-bb01-4631-af4f-0d1a798064b5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:54.953631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d1801a52-8f33-4e8a-8c0d-90606e893c6e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:54.954822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d1801a52-8f33-4e8a-8c0d-90606e893c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:55.023443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 510/1033] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:55.048650 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1801a52-8f33-4e8a-8c0d-90606e893c6e None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:55.062076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aac98e-bb01-4631-af4f-0d1a798064b5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:55.098832 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:55.107366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95948eb-bc04-4f8c-b81f-eea2e98f9ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:55.108539 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95948eb-bc04-4f8c-b81f-eea2e98f9ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:55.109216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95948eb-bc04-4f8c-b81f-eea2e98f9ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:55.112686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95948eb-bc04-4f8c-b81f-eea2e98f9ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:55.125032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95948eb-bc04-4f8c-b81f-eea2e98f9ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:55.126427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95948eb-bc04-4f8c-b81f-eea2e98f9ed1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-a95948eb-bc04-4f8c-b81f-eea2e98f9ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:55.144923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:55.145836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:55.146726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:55.146726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:55.146726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:55.146726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:55.146726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 524/1034] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:55.152178 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95948eb-bc04-4f8c-b81f-eea2e98f9ed1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:55.155389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1801a52-8f33-4e8a-8c0d-90606e893c6e None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:55.177271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:55.195061 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602afcc-e94e-4af7-bd98-33a27f3f2bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:55.195854 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602afcc-e94e-4af7-bd98-33a27f3f2bdc None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:55.196453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602afcc-e94e-4af7-bd98-33a27f3f2bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:55.196739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602afcc-e94e-4af7-bd98-33a27f3f2bdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:55.198309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602afcc-e94e-4af7-bd98-33a27f3f2bdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:55.200528 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602afcc-e94e-4af7-bd98-33a27f3f2bdc None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:55.204961 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 511/1035] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:55.207920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602afcc-e94e-4af7-bd98-33a27f3f2bdc None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:55.259216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95948eb-bc04-4f8c-b81f-eea2e98f9ed1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:55.292718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc4d9f-c9e2-4f0d-8418-dd39b4f6c599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:55.293404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc4d9f-c9e2-4f0d-8418-dd39b4f6c599 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:55.293690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc4d9f-c9e2-4f0d-8418-dd39b4f6c599 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:55.293967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc4d9f-c9e2-4f0d-8418-dd39b4f6c599 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:55.294690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc4d9f-c9e2-4f0d-8418-dd39b4f6c599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:55.294997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc4d9f-c9e2-4f0d-8418-dd39b4f6c599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:55.296361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc4d9f-c9e2-4f0d-8418-dd39b4f6c599 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:55.308681 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 525/1036] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:55.314041 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc4d9f-c9e2-4f0d-8418-dd39b4f6c599 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:55.319566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602afcc-e94e-4af7-bd98-33a27f3f2bdc None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:55.355731 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7473878-71e1-4fe1-8777-8df630d3358c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:55.356397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7473878-71e1-4fe1-8777-8df630d3358c None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:55.356676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7473878-71e1-4fe1-8777-8df630d3358c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:55.356977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7473878-71e1-4fe1-8777-8df630d3358c None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:55.357799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7473878-71e1-4fe1-8777-8df630d3358c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:55.358757 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:55.359988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7473878-71e1-4fe1-8777-8df630d3358c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:55.415609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc4d9f-c9e2-4f0d-8418-dd39b4f6c599 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:55.460835 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af88c00-60d5-4105-96f4-0dab65920205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:55.461096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 512/1037] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:52:55 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:52:55.461196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af88c00-60d5-4105-96f4-0dab65920205 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:55.461196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af88c00-60d5-4105-96f4-0dab65920205 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:55.461196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af88c00-60d5-4105-96f4-0dab65920205 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:55.469071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af88c00-60d5-4105-96f4-0dab65920205 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:55.470665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af88c00-60d5-4105-96f4-0dab65920205 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-7af88c00-60d5-4105-96f4-0dab65920205 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:55.487941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:55.489971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:55.490942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:55.490942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:55.490942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:55.490942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:55.490942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:55.490942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:55.490942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:55.490942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:55.490942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:52:55.490942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:55.490942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 526/1038] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 23 12:52:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:55.497046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7473878-71e1-4fe1-8777-8df630d3358c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:55.557391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:55.627891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7473878-71e1-4fe1-8777-8df630d3358c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:55.671428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71459cf-7af1-4d7a-b3f5-4b1fa3854236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:55.672034 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71459cf-7af1-4d7a-b3f5-4b1fa3854236 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:55.672320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71459cf-7af1-4d7a-b3f5-4b1fa3854236 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:55.672602 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71459cf-7af1-4d7a-b3f5-4b1fa3854236 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:55.673476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71459cf-7af1-4d7a-b3f5-4b1fa3854236 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:55.673790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71459cf-7af1-4d7a-b3f5-4b1fa3854236 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:55.675238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71459cf-7af1-4d7a-b3f5-4b1fa3854236 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:55.693543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 513/1039] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 23 12:52:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:55.699903 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af88c00-60d5-4105-96f4-0dab65920205 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:55.802487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af88c00-60d5-4105-96f4-0dab65920205 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:55.804003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:55.837727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef90a4-961d-4a56-9d1e-5363d20570a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:55.839003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef90a4-961d-4a56-9d1e-5363d20570a1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:55.839290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef90a4-961d-4a56-9d1e-5363d20570a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:55.839571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef90a4-961d-4a56-9d1e-5363d20570a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:55.916058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef90a4-961d-4a56-9d1e-5363d20570a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:55.918135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef90a4-961d-4a56-9d1e-5363d20570a1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:56.024389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 527/1040] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:52:56.026207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71459cf-7af1-4d7a-b3f5-4b1fa3854236 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.132569 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71459cf-7af1-4d7a-b3f5-4b1fa3854236 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.134131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:56.169191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56180a20-e29e-4287-98b9-385ec0d7d021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.169980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56180a20-e29e-4287-98b9-385ec0d7d021 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.170254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56180a20-e29e-4287-98b9-385ec0d7d021 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.170523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56180a20-e29e-4287-98b9-385ec0d7d021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.183264 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56180a20-e29e-4287-98b9-385ec0d7d021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:56.184742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56180a20-e29e-4287-98b9-385ec0d7d021 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-56180a20-e29e-4287-98b9-385ec0d7d021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:56.203926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:56.204916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:56.205815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:56.205815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:56.205815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:56.205815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:56.205815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 514/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:56.211236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef90a4-961d-4a56-9d1e-5363d20570a1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.213482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:56.310763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef90a4-961d-4a56-9d1e-5363d20570a1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.343980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e70d42-42de-4f83-9f46-b20529f86240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.344647 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e70d42-42de-4f83-9f46-b20529f86240 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.345250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e70d42-42de-4f83-9f46-b20529f86240 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.345533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e70d42-42de-4f83-9f46-b20529f86240 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.346256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e70d42-42de-4f83-9f46-b20529f86240 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:56.346560 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e70d42-42de-4f83-9f46-b20529f86240 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:56.347917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e70d42-42de-4f83-9f46-b20529f86240 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:56.364536 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 528/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:56.365687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56180a20-e29e-4287-98b9-385ec0d7d021 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.466154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56180a20-e29e-4287-98b9-385ec0d7d021 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.500403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8040d70-a411-437f-a17c-5838c094c2cf None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.500704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8040d70-a411-437f-a17c-5838c094c2cf None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.500969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8040d70-a411-437f-a17c-5838c094c2cf None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.501067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c264bac-b25c-4706-a2d2-694fa990415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.501835 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c264bac-b25c-4706-a2d2-694fa990415d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.502124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c264bac-b25c-4706-a2d2-694fa990415d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.504847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c264bac-b25c-4706-a2d2-694fa990415d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.504998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 529/1043] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:56.507180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172274a-a1d5-4bf5-96e2-ea11ecd1c23e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.507465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172274a-a1d5-4bf5-96e2-ea11ecd1c23e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.507744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172274a-a1d5-4bf5-96e2-ea11ecd1c23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.512762 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c264bac-b25c-4706-a2d2-694fa990415d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:56.518738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c264bac-b25c-4706-a2d2-694fa990415d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:56.525325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3172274a-a1d5-4bf5-96e2-ea11ecd1c23e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:56.527051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3172274a-a1d5-4bf5-96e2-ea11ecd1c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-4c264bac-b25c-4706-a2d2-694fa990415d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:52:56.529712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:56.530595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:56.531635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:52:56.531635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:52:56.531635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:52:56.531635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:52:56.531635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:52:56.531635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:52:56.531635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:52:56.531635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:56.531635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 515/1044] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:52:56.536429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c264bac-b25c-4706-a2d2-694fa990415d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.556577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:56.590942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:56.603607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 530/1045] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:52:56.626802 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172274a-a1d5-4bf5-96e2-ea11ecd1c23e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.645906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c264bac-b25c-4706-a2d2-694fa990415d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.685644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2405ab4-90c2-44e7-b6d6-86c3f5826dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.686308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2405ab4-90c2-44e7-b6d6-86c3f5826dac None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.686591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2405ab4-90c2-44e7-b6d6-86c3f5826dac None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.686868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2405ab4-90c2-44e7-b6d6-86c3f5826dac None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.687656 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2405ab4-90c2-44e7-b6d6-86c3f5826dac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:56.687969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2405ab4-90c2-44e7-b6d6-86c3f5826dac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:56.689443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2405ab4-90c2-44e7-b6d6-86c3f5826dac None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:56.707449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 516/1046] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:56.709243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2405ab4-90c2-44e7-b6d6-86c3f5826dac None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.737221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172274a-a1d5-4bf5-96e2-ea11ecd1c23e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.772206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297d4b9-0922-4239-92e7-31da55d2b29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.773009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297d4b9-0922-4239-92e7-31da55d2b29e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.773290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297d4b9-0922-4239-92e7-31da55d2b29e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.773581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297d4b9-0922-4239-92e7-31da55d2b29e None admin] PATH_INFO: `/v3/services/image` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.774220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297d4b9-0922-4239-92e7-31da55d2b29e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:56.776162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297d4b9-0922-4239-92e7-31da55d2b29e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6297d4b9-0922-4239-92e7-31da55d2b29e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:56.788147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:56.789177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:52:56.790098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 531/1047] 10.222.0.16 () {56 vars in 1105 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:56.795764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297d4b9-0922-4239-92e7-31da55d2b29e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:56.796287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:56.823435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2405ab4-90c2-44e7-b6d6-86c3f5826dac None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.854383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:56.859498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3b8e1-61fd-40e3-9b45-9f5ab26c463e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.860165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3b8e1-61fd-40e3-9b45-9f5ab26c463e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.860454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3b8e1-61fd-40e3-9b45-9f5ab26c463e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.860737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3b8e1-61fd-40e3-9b45-9f5ab26c463e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.861677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3b8e1-61fd-40e3-9b45-9f5ab26c463e None admin] RBAC: Adding query filter params (role.id=be5e149a2c4b4be79c9dbb018b5975d4, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=703c2c40fe434402817a8824c2756ee7) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:56.861999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3b8e1-61fd-40e3-9b45-9f5ab26c463e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:56.863450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3b8e1-61fd-40e3-9b45-9f5ab26c463e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:56.872347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 517/1048] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/role_assignments?user.id=703c2c40fe434402817a8824c2756ee7&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=be5e149a2c4b4be79c9dbb018b5975d4 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:56.920547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297d4b9-0922-4239-92e7-31da55d2b29e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:56.957345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc059f3-4336-4bdc-a601-4f04a782a5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:56.958026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc059f3-4336-4bdc-a601-4f04a782a5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:56.958311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc059f3-4336-4bdc-a601-4f04a782a5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:56.958584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc059f3-4336-4bdc-a601-4f04a782a5a7 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:56.959305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc059f3-4336-4bdc-a601-4f04a782a5a7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:56.959610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc059f3-4336-4bdc-a601-4f04a782a5a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:56.961091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc059f3-4336-4bdc-a601-4f04a782a5a7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:56.967648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 532/1049] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:56.973305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3b8e1-61fd-40e3-9b45-9f5ab26c463e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:57.082269 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3b8e1-61fd-40e3-9b45-9f5ab26c463e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:57.116903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c2493-0883-4183-8000-287021baefc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:57.117894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c2493-0883-4183-8000-287021baefc8 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.118483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c2493-0883-4183-8000-287021baefc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.118990 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c2493-0883-4183-8000-287021baefc8 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.119936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c2493-0883-4183-8000-287021baefc8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:57.120450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c2493-0883-4183-8000-287021baefc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:57.122059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c2493-0883-4183-8000-287021baefc8 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:57.127587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 518/1050] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:57.132932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc059f3-4336-4bdc-a601-4f04a782a5a7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:57.237182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc059f3-4336-4bdc-a601-4f04a782a5a7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:57.256694 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:57.272203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb40fba-a6de-420a-b152-81952d799b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:57.272995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40fba-a6de-420a-b152-81952d799b2f None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.275671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40fba-a6de-420a-b152-81952d799b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.275671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb40fba-a6de-420a-b152-81952d799b2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.275671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb40fba-a6de-420a-b152-81952d799b2f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:57.275904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb40fba-a6de-420a-b152-81952d799b2f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:57.352337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 533/1051] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 23 12:52:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:52:57.652425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a513d4-a499-42e5-a056-34e5142e29ee None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.652975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a513d4-a499-42e5-a056-34e5142e29ee None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.653053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a513d4-a499-42e5-a056-34e5142e29ee None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.654558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 519/1052] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:57.659613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e98ba-bfa3-4210-8691-99b4393fd57c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.659990 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e98ba-bfa3-4210-8691-99b4393fd57c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.660339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e98ba-bfa3-4210-8691-99b4393fd57c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.677767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d84e98ba-bfa3-4210-8691-99b4393fd57c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:57.678944 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d84e98ba-bfa3-4210-8691-99b4393fd57c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:57.754395 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 534/1053] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:57.779562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a513d4-a499-42e5-a056-34e5142e29ee None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:57.782731 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:57.887632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a513d4-a499-42e5-a056-34e5142e29ee None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:57.922714 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce2d29-0b15-47f3-a07b-a9f405651045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:57.923426 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce2d29-0b15-47f3-a07b-a9f405651045 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:57.923705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce2d29-0b15-47f3-a07b-a9f405651045 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:57.923974 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce2d29-0b15-47f3-a07b-a9f405651045 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:57.935492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce2d29-0b15-47f3-a07b-a9f405651045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-05ce2d29-0b15-47f3-a07b-a9f405651045 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:57.943016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:57.943931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:57.944774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:57.944774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:57.944774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:57.944774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:57.944774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:57.944774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:57.944774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:57.944774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:57.944774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:57.944774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:57.944774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:52:57.944774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:57.948887 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 520/1054] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:52:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:57.951069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e98ba-bfa3-4210-8691-99b4393fd57c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.054839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e98ba-bfa3-4210-8691-99b4393fd57c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.056385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:58.090066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b014f-afdd-4ab1-91aa-ed802b0a03bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.090744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b014f-afdd-4ab1-91aa-ed802b0a03bd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.091025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b014f-afdd-4ab1-91aa-ed802b0a03bd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.091299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b014f-afdd-4ab1-91aa-ed802b0a03bd None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.092050 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b014f-afdd-4ab1-91aa-ed802b0a03bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:58.092353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b014f-afdd-4ab1-91aa-ed802b0a03bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:58.093825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b014f-afdd-4ab1-91aa-ed802b0a03bd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:58.107370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 535/1055] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:52:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:58.109149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce2d29-0b15-47f3-a07b-a9f405651045 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.173785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:58.211521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce2d29-0b15-47f3-a07b-a9f405651045 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.245279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2476f9-853c-4a95-bf27-764fff8e33ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.246152 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2476f9-853c-4a95-bf27-764fff8e33ab None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.246433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2476f9-853c-4a95-bf27-764fff8e33ab None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.246706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2476f9-853c-4a95-bf27-764fff8e33ab None admin] PATH_INFO: `/v3/users/d3d7006548284947a73c96ca66f22f35` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.259653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2476f9-853c-4a95-bf27-764fff8e33ab None admin] RBAC: Authorizing `identity:get_user(user_id=d3d7006548284947a73c96ca66f22f35)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:58.261358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2476f9-853c-4a95-bf27-764fff8e33ab None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:58.268215 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 521/1056] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:52:58 2022] GET /identity/v3/users/d3d7006548284947a73c96ca66f22f35 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:58.269482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b014f-afdd-4ab1-91aa-ed802b0a03bd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.383730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b014f-afdd-4ab1-91aa-ed802b0a03bd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.420945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e0218-a96d-4f8a-83f5-87b6f3c162f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.421685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e0218-a96d-4f8a-83f5-87b6f3c162f7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.422040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e0218-a96d-4f8a-83f5-87b6f3c162f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.422389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e0218-a96d-4f8a-83f5-87b6f3c162f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.452945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:58.492027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e0218-a96d-4f8a-83f5-87b6f3c162f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:58.493510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e0218-a96d-4f8a-83f5-87b6f3c162f7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:58.600209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 536/1057] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:52:58.601503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2476f9-853c-4a95-bf27-764fff8e33ab None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.703229 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2476f9-853c-4a95-bf27-764fff8e33ab None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.722862 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:58.737389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da12e8-42a0-4c19-98ff-e6f9f69bc9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.747415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da12e8-42a0-4c19-98ff-e6f9f69bc9ad None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.747415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da12e8-42a0-4c19-98ff-e6f9f69bc9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.747415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da12e8-42a0-4c19-98ff-e6f9f69bc9ad None admin] PATH_INFO: `/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.747415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da12e8-42a0-4c19-98ff-e6f9f69bc9ad None admin] RBAC: Authorizing `identity:get_project(project_id=ac4e7c64a3a14364bb3a32cd16678ead)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:58.747415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da12e8-42a0-4c19-98ff-e6f9f69bc9ad None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:58.747415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 522/1058] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:52:58 2022] GET /identity/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:58.750047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e0218-a96d-4f8a-83f5-87b6f3c162f7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:58.812589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:58.851971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e0218-a96d-4f8a-83f5-87b6f3c162f7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:58.892187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc75c2-f86b-46fd-9ac6-a177d2b54d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:58.892881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc75c2-f86b-46fd-9ac6-a177d2b54d49 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.893169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc75c2-f86b-46fd-9ac6-a177d2b54d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.893447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc75c2-f86b-46fd-9ac6-a177d2b54d49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.894282 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc75c2-f86b-46fd-9ac6-a177d2b54d49 None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=ac4e7c64a3a14364bb3a32cd16678ead, user.id=d3d7006548284947a73c96ca66f22f35) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:58.894596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc75c2-f86b-46fd-9ac6-a177d2b54d49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:58.896036 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc75c2-f86b-46fd-9ac6-a177d2b54d49 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:58.902087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 537/1059] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:52:58 2022] GET /identity/v3/role_assignments?user.id=d3d7006548284947a73c96ca66f22f35&scope.project.id=ac4e7c64a3a14364bb3a32cd16678ead&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:58.919648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a449592-e41a-450d-8db9-9192f1f6299c None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.919973 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a449592-e41a-450d-8db9-9192f1f6299c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.920209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a449592-e41a-450d-8db9-9192f1f6299c None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.921698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 523/1060] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:52:58.927596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cb088-dd49-4652-b940-74718d685be4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:58.927903 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cb088-dd49-4652-b940-74718d685be4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:58.928169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cb088-dd49-4652-b940-74718d685be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:58.946264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-204cb088-dd49-4652-b940-74718d685be4 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:58.947545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-204cb088-dd49-4652-b940-74718d685be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:59.022520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 538/1061] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:59.046130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a449592-e41a-450d-8db9-9192f1f6299c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.156223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a449592-e41a-450d-8db9-9192f1f6299c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.191712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f143b-41d6-4eb5-901a-9416fdb50f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.192946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f143b-41d6-4eb5-901a-9416fdb50f46 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.193436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f143b-41d6-4eb5-901a-9416fdb50f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.193937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f143b-41d6-4eb5-901a-9416fdb50f46 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.204397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f143b-41d6-4eb5-901a-9416fdb50f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-922f143b-41d6-4eb5-901a-9416fdb50f46 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:52:59.213513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:59.214458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:59.215304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:59.215304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:59.215304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:59.215304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:59.215304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:52:59.215304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:52:59.215304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:52:59.215304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:52:59.215304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:52:59.215304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:52:59.215304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:52:59.215304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:59.217266 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 524/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:59.223059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cb088-dd49-4652-b940-74718d685be4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.284128 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:59.325161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cb088-dd49-4652-b940-74718d685be4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.360023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1367eb-e3dc-4eb8-8c88-2167cd5a2a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.360696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1367eb-e3dc-4eb8-8c88-2167cd5a2a7d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.361078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1367eb-e3dc-4eb8-8c88-2167cd5a2a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.361357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1367eb-e3dc-4eb8-8c88-2167cd5a2a7d None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.362108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1367eb-e3dc-4eb8-8c88-2167cd5a2a7d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:59.362416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1367eb-e3dc-4eb8-8c88-2167cd5a2a7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:59.363781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1367eb-e3dc-4eb8-8c88-2167cd5a2a7d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:59.376654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 539/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:52:59.378525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f143b-41d6-4eb5-901a-9416fdb50f46 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.430735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:59.463559 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95015c9d-fdfd-43be-b91a-ebdf689be4d9 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.463860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95015c9d-fdfd-43be-b91a-ebdf689be4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.464160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95015c9d-fdfd-43be-b91a-ebdf689be4d9 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.466266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 540/1064] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:52:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:52:59.470551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0592e6-e456-46b5-a267-a9e535c45595 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.471105 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0592e6-e456-46b5-a267-a9e535c45595 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.471389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0592e6-e456-46b5-a267-a9e535c45595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.485567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f143b-41d6-4eb5-901a-9416fdb50f46 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.488471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6d0592e6-e456-46b5-a267-a9e535c45595 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:52:59.489690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6d0592e6-e456-46b5-a267-a9e535c45595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:52:59.521110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a7a63-01da-4a90-acca-b26865be4c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.521910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a7a63-01da-4a90-acca-b26865be4c6d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.522197 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a7a63-01da-4a90-acca-b26865be4c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.522481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a7a63-01da-4a90-acca-b26865be4c6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.534015 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a7a63-01da-4a90-acca-b26865be4c6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:59.535550 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1a7a63-01da-4a90-acca-b26865be4c6d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-9d1a7a63-01da-4a90-acca-b26865be4c6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:52:59.553604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:59.554541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:59.556223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:52:59.556223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:52:59.556223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:52:59.556223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:59.556223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 525/1065] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:59.560751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a7a63-01da-4a90-acca-b26865be4c6d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.562126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 541/1066] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:52:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:52:59.585263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0592e6-e456-46b5-a267-a9e535c45595 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.643032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:59.669618 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:59.673866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a7a63-01da-4a90-acca-b26865be4c6d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.699175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0592e6-e456-46b5-a267-a9e535c45595 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.709400 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5c599-1caf-4ad0-a328-7f6f41623c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.710061 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5c599-1caf-4ad0-a328-7f6f41623c75 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.710343 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5c599-1caf-4ad0-a328-7f6f41623c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.710619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5c599-1caf-4ad0-a328-7f6f41623c75 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.711342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5c599-1caf-4ad0-a328-7f6f41623c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:52:59.711645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5c599-1caf-4ad0-a328-7f6f41623c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:59.713096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5c599-1caf-4ad0-a328-7f6f41623c75 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:59.728717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 526/1067] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:52:59.729764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5c599-1caf-4ad0-a328-7f6f41623c75 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.739053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e97fa0-50e9-4074-a5a6-f06aadeecef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.739708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e97fa0-50e9-4074-a5a6-f06aadeecef0 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.739992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e97fa0-50e9-4074-a5a6-f06aadeecef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.740270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e97fa0-50e9-4074-a5a6-f06aadeecef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.813615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e97fa0-50e9-4074-a5a6-f06aadeecef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:59.815200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e97fa0-50e9-4074-a5a6-f06aadeecef0 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:59.830630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5c599-1caf-4ad0-a328-7f6f41623c75 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:52:59.870763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:52:59.872628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6191fc-a3f8-4cec-a822-cc0c0078c6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:52:59.873463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6191fc-a3f8-4cec-a822-cc0c0078c6ab None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:52:59.873828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6191fc-a3f8-4cec-a822-cc0c0078c6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:52:59.874104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6191fc-a3f8-4cec-a822-cc0c0078c6ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:52:59.883976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6191fc-a3f8-4cec-a822-cc0c0078c6ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:52:59.888701 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6191fc-a3f8-4cec-a822-cc0c0078c6ab None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-ed6191fc-a3f8-4cec-a822-cc0c0078c6ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:52:59.905893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:52:59.906868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:52:59.907851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:52:59.907851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:52:59.907851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:52:59.907851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:52:59.907851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:52:59.907851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:52:59.907851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:52:59.907851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:52:59.907851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:52:59.907851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:52:59.907851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 527/1068] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:52:59.913048 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6191fc-a3f8-4cec-a822-cc0c0078c6ab None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.928088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 542/1069] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 12:52:59.934006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e97fa0-50e9-4074-a5a6-f06aadeecef0 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:52:59.940782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.026309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6191fc-a3f8-4cec-a822-cc0c0078c6ab None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.040778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e97fa0-50e9-4074-a5a6-f06aadeecef0 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.064099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35bc67-7111-4155-a78d-5cd3d006e1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.064871 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35bc67-7111-4155-a78d-5cd3d006e1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.065159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35bc67-7111-4155-a78d-5cd3d006e1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.065438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35bc67-7111-4155-a78d-5cd3d006e1f3 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.066281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35bc67-7111-4155-a78d-5cd3d006e1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:00.066595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35bc67-7111-4155-a78d-5cd3d006e1f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.068040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35bc67-7111-4155-a78d-5cd3d006e1f3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.079723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0e696-feda-4a3e-99a3-4ee0091dcfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.080544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e696-feda-4a3e-99a3-4ee0091dcfef None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.080839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e696-feda-4a3e-99a3-4ee0091dcfef None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.081119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0e696-feda-4a3e-99a3-4ee0091dcfef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.090896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 528/1070] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:00.092881 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35bc67-7111-4155-a78d-5cd3d006e1f3 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.095202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0e696-feda-4a3e-99a3-4ee0091dcfef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.096662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0e696-feda-4a3e-99a3-4ee0091dcfef None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6ed0e696-feda-4a3e-99a3-4ee0091dcfef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:00.115390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:00.116312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:00.117854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:00.117854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:00.117854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:00.117854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:53:00.117854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 543/1071] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:00.122356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0e696-feda-4a3e-99a3-4ee0091dcfef None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.126273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.179176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.201924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35bc67-7111-4155-a78d-5cd3d006e1f3 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.228035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0e696-feda-4a3e-99a3-4ee0091dcfef None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.238126 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90baca8-6fa2-49c1-8cba-b4d78897a283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.238820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90baca8-6fa2-49c1-8cba-b4d78897a283 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.239106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90baca8-6fa2-49c1-8cba-b4d78897a283 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.239380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90baca8-6fa2-49c1-8cba-b4d78897a283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.249804 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90baca8-6fa2-49c1-8cba-b4d78897a283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.251260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90baca8-6fa2-49c1-8cba-b4d78897a283 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.263992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8231f-fa14-46c5-8ab2-5049a9571c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.264657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8231f-fa14-46c5-8ab2-5049a9571c24 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.264972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8231f-fa14-46c5-8ab2-5049a9571c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.265251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8231f-fa14-46c5-8ab2-5049a9571c24 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.265974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8231f-fa14-46c5-8ab2-5049a9571c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:00.266279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8231f-fa14-46c5-8ab2-5049a9571c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.267626 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8231f-fa14-46c5-8ab2-5049a9571c24 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-c90baca8-6fa2-49c1-8cba-b4d78897a283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:00.271525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:00.272414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:00.278648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:00.278648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:00.278648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:00.278648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:53:00.278648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 529/1072] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:00.278648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90baca8-6fa2-49c1-8cba-b4d78897a283 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.285258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 544/1073] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:00.390375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90baca8-6fa2-49c1-8cba-b4d78897a283 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.424023 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.432214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981cb72-27f3-4012-bce6-e1d40bcf5f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.432989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981cb72-27f3-4012-bce6-e1d40bcf5f11 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.433276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981cb72-27f3-4012-bce6-e1d40bcf5f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.433550 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981cb72-27f3-4012-bce6-e1d40bcf5f11 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.434531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981cb72-27f3-4012-bce6-e1d40bcf5f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:00.434636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981cb72-27f3-4012-bce6-e1d40bcf5f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.435946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981cb72-27f3-4012-bce6-e1d40bcf5f11 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.448450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 530/1074] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:00.454445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8231f-fa14-46c5-8ab2-5049a9571c24 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.524734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.566077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8231f-fa14-46c5-8ab2-5049a9571c24 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.601439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d26908-7683-4c3f-b67b-48c44c0b28db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.602244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d26908-7683-4c3f-b67b-48c44c0b28db None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.602527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d26908-7683-4c3f-b67b-48c44c0b28db None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.602805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d26908-7683-4c3f-b67b-48c44c0b28db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.610011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d26908-7683-4c3f-b67b-48c44c0b28db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.611442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d26908-7683-4c3f-b67b-48c44c0b28db None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-40d26908-7683-4c3f-b67b-48c44c0b28db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:00.624848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:00.625900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:00.627337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:00.627337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:00.627337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:00.627337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:00.627337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:00.627337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:00.627337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:00.627337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:53:00.627337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 545/1075] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:00.631776 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981cb72-27f3-4012-bce6-e1d40bcf5f11 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.732748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981cb72-27f3-4012-bce6-e1d40bcf5f11 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.765659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14824197-42c3-44aa-a023-ef7ce360caac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.766314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824197-42c3-44aa-a023-ef7ce360caac None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.766597 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824197-42c3-44aa-a023-ef7ce360caac None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.766873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14824197-42c3-44aa-a023-ef7ce360caac None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.767688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14824197-42c3-44aa-a023-ef7ce360caac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:00.768002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14824197-42c3-44aa-a023-ef7ce360caac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.769474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14824197-42c3-44aa-a023-ef7ce360caac None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.781879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 531/1076] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:00.787750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d26908-7683-4c3f-b67b-48c44c0b28db None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:00.888763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d26908-7683-4c3f-b67b-48c44c0b28db None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:00.910791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:00.922702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12831625-b6b8-4fec-a18e-28a9a9262b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:00.923596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12831625-b6b8-4fec-a18e-28a9a9262b84 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.923888 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12831625-b6b8-4fec-a18e-28a9a9262b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.929765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12831625-b6b8-4fec-a18e-28a9a9262b84 None admin] PATH_INFO: `/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/703c2c40fe434402817a8824c2756ee7/roles/be5e149a2c4b4be79c9dbb018b5975d4` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.929765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12831625-b6b8-4fec-a18e-28a9a9262b84 None admin] RBAC: Authorizing `identity:create_grant(project_id=66de76d7ea7a45a6b698f8b1295c66c3, user_id=703c2c40fe434402817a8824c2756ee7, role_id=be5e149a2c4b4be79c9dbb018b5975d4)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:00.929765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12831625-b6b8-4fec-a18e-28a9a9262b84 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:00.956607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09879d6d-6c12-4336-ad8b-7772e0683072 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.956919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09879d6d-6c12-4336-ad8b-7772e0683072 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.957656 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09879d6d-6c12-4336-ad8b-7772e0683072 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.958640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 532/1077] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:53:00.963279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a612a26-30ad-40bb-ab74-b188f325827f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:00.963557 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a612a26-30ad-40bb-ab74-b188f325827f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:00.963832 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a612a26-30ad-40bb-ab74-b188f325827f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:00.980841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-8a612a26-30ad-40bb-ab74-b188f325827f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:00.982031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-8a612a26-30ad-40bb-ab74-b188f325827f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:01.005899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 546/1078] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:00 2022] PUT /identity/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/703c2c40fe434402817a8824c2756ee7/roles/be5e149a2c4b4be79c9dbb018b5975d4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:01.031433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:01.054078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 533/1079] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:01.077804 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12831625-b6b8-4fec-a18e-28a9a9262b84 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:01.184866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12831625-b6b8-4fec-a18e-28a9a9262b84 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:01.217900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010137cf-c051-4c48-b9e0-8e916a373d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:01.218695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010137cf-c051-4c48-b9e0-8e916a373d2d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.218977 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010137cf-c051-4c48-b9e0-8e916a373d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.219248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010137cf-c051-4c48-b9e0-8e916a373d2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.229496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010137cf-c051-4c48-b9e0-8e916a373d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-010137cf-c051-4c48-b9e0-8e916a373d2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:01.237017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:01.238116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:53:01.239447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 547/1080] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:01.244437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a612a26-30ad-40bb-ab74-b188f325827f None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:01.342005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a612a26-30ad-40bb-ab74-b188f325827f None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:01.375573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a77bf7-db29-4a1a-8c0e-844c938c2619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:01.376237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a77bf7-db29-4a1a-8c0e-844c938c2619 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.376520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a77bf7-db29-4a1a-8c0e-844c938c2619 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.376797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a77bf7-db29-4a1a-8c0e-844c938c2619 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.377573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a77bf7-db29-4a1a-8c0e-844c938c2619 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:01.377881 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a77bf7-db29-4a1a-8c0e-844c938c2619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:01.379264 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a77bf7-db29-4a1a-8c0e-844c938c2619 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:01.387133 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 534/1081] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:01.393157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010137cf-c051-4c48-b9e0-8e916a373d2d None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:01.435956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:01.493781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010137cf-c051-4c48-b9e0-8e916a373d2d None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:01.528437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97462176-e597-4816-9bd6-7d4f8837a950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:01.529347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97462176-e597-4816-9bd6-7d4f8837a950 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.529632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97462176-e597-4816-9bd6-7d4f8837a950 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.530030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97462176-e597-4816-9bd6-7d4f8837a950 None admin] PATH_INFO: `/v3/users/d3d7006548284947a73c96ca66f22f35` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.531224 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97462176-e597-4816-9bd6-7d4f8837a950 None admin] RBAC: Authorizing `identity:get_user(user_id=d3d7006548284947a73c96ca66f22f35)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:01.532664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97462176-e597-4816-9bd6-7d4f8837a950 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:01.534355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 548/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:01 2022] GET /identity/v3/users/d3d7006548284947a73c96ca66f22f35 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:01.540067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a77bf7-db29-4a1a-8c0e-844c938c2619 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:01.586996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:01.645060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a77bf7-db29-4a1a-8c0e-844c938c2619 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:01.680707 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ece4e6-a19d-4a98-997f-bdc4c7056380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:01.682101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ece4e6-a19d-4a98-997f-bdc4c7056380 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.682396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ece4e6-a19d-4a98-997f-bdc4c7056380 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.682671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ece4e6-a19d-4a98-997f-bdc4c7056380 None admin] PATH_INFO: `/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.683858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ece4e6-a19d-4a98-997f-bdc4c7056380 None admin] RBAC: Authorizing `identity:get_project(project_id=ac4e7c64a3a14364bb3a32cd16678ead)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:01.685321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ece4e6-a19d-4a98-997f-bdc4c7056380 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:01.687010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 535/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:01 2022] GET /identity/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:01.692917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97462176-e597-4816-9bd6-7d4f8837a950 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:01.792168 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97462176-e597-4816-9bd6-7d4f8837a950 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:01.802011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:01.825770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef634ac-10f5-48b4-986f-cd726e157055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:01.826904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef634ac-10f5-48b4-986f-cd726e157055 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:01.827184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef634ac-10f5-48b4-986f-cd726e157055 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:01.827456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef634ac-10f5-48b4-986f-cd726e157055 None admin] PATH_INFO: `/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead/users/d3d7006548284947a73c96ca66f22f35/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:01.829709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef634ac-10f5-48b4-986f-cd726e157055 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac4e7c64a3a14364bb3a32cd16678ead, user_id=d3d7006548284947a73c96ca66f22f35, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:01.831126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef634ac-10f5-48b4-986f-cd726e157055 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:01.929346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 549/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:01 2022] PUT /identity/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead/users/d3d7006548284947a73c96ca66f22f35/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:53:03.065882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad132-0c5f-420a-ba37-358092844f92 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.066401 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad132-0c5f-420a-ba37-358092844f92 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.066489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fad132-0c5f-420a-ba37-358092844f92 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.067862 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 536/1085] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:03.073746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04770d20-8049-444f-8165-53ce40dad5e0 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.074177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04770d20-8049-444f-8165-53ce40dad5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.074308 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04770d20-8049-444f-8165-53ce40dad5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.091355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-04770d20-8049-444f-8165-53ce40dad5e0 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:03.092551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-04770d20-8049-444f-8165-53ce40dad5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:03.158096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 550/1086] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:03.181899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad132-0c5f-420a-ba37-358092844f92 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:03.280101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fad132-0c5f-420a-ba37-358092844f92 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:03.290341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:03.313349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57640-9492-4d06-9487-6aa69745a890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:03.314150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57640-9492-4d06-9487-6aa69745a890 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.314433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57640-9492-4d06-9487-6aa69745a890 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.314708 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57640-9492-4d06-9487-6aa69745a890 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.325512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57640-9492-4d06-9487-6aa69745a890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-43b57640-9492-4d06-9487-6aa69745a890 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:03.333860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:03.334801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:53:03.335641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 537/1087] 10.222.0.16 () {56 vars in 1120 bytes} [Thu Jun 23 12:53:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:03.341334 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04770d20-8049-444f-8165-53ce40dad5e0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:03.434889 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:03.437751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04770d20-8049-444f-8165-53ce40dad5e0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:03.470963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dd8ba-8551-4490-bc17-cf1ba249a726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:03.471632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dd8ba-8551-4490-bc17-cf1ba249a726 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.471918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dd8ba-8551-4490-bc17-cf1ba249a726 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.472195 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6dd8ba-8551-4490-bc17-cf1ba249a726 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.472981 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dd8ba-8551-4490-bc17-cf1ba249a726 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:03.473298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dd8ba-8551-4490-bc17-cf1ba249a726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:03.474667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6dd8ba-8551-4490-bc17-cf1ba249a726 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:03.482878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 551/1088] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 23 12:53:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:03.488442 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57640-9492-4d06-9487-6aa69745a890 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:03.589253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57640-9492-4d06-9487-6aa69745a890 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:03.623592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0667a2-bf29-4dcd-812f-f4bf636f2d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:03.624382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0667a2-bf29-4dcd-812f-f4bf636f2d68 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.624665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0667a2-bf29-4dcd-812f-f4bf636f2d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.624976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0667a2-bf29-4dcd-812f-f4bf636f2d68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.635737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0667a2-bf29-4dcd-812f-f4bf636f2d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:03.637216 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0667a2-bf29-4dcd-812f-f4bf636f2d68 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-de0667a2-bf29-4dcd-812f-f4bf636f2d68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:03.658971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:03.659985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:03.660914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:03.660914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:03.660914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:03.660914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:53:03.660914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 538/1089] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:03.667297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dd8ba-8551-4490-bc17-cf1ba249a726 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:03.769571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6dd8ba-8551-4490-bc17-cf1ba249a726 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:03.802506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465aac8-1abb-440f-8f57-d813c9c51f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:03.803162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465aac8-1abb-440f-8f57-d813c9c51f50 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.803444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465aac8-1abb-440f-8f57-d813c9c51f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.803718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465aac8-1abb-440f-8f57-d813c9c51f50 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.804436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465aac8-1abb-440f-8f57-d813c9c51f50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:03.804740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465aac8-1abb-440f-8f57-d813c9c51f50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:03.806129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465aac8-1abb-440f-8f57-d813c9c51f50 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:03.818093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 552/1090] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:03.824529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0667a2-bf29-4dcd-812f-f4bf636f2d68 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:03.849467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:03.925131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0667a2-bf29-4dcd-812f-f4bf636f2d68 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:03.959075 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c206663-4bf4-44e3-907c-d4f4a812595f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:03.959857 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c206663-4bf4-44e3-907c-d4f4a812595f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.960141 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c206663-4bf4-44e3-907c-d4f4a812595f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.960419 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c206663-4bf4-44e3-907c-d4f4a812595f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.968116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c206663-4bf4-44e3-907c-d4f4a812595f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:03.969661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c206663-4bf4-44e3-907c-d4f4a812595f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:03.976973 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fda8a-79a4-4b63-99d6-dc8956525e44 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.977260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fda8a-79a4-4b63-99d6-dc8956525e44 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.977537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fda8a-79a4-4b63-99d6-dc8956525e44 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.979028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 553/1091] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:53:03.984113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846225a1-1f63-486d-92d2-70f6e96e9ae1 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:03.984492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846225a1-1f63-486d-92d2-70f6e96e9ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:03.984772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846225a1-1f63-486d-92d2-70f6e96e9ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-9c206663-4bf4-44e3-907c-d4f4a812595f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:53:03.987335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:03.988254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:03.989293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:03.989293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:03.989293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:53:03.989293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:53:03.989293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:53:03.989293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:53:03.989293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:53:03.989293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:53:03.989293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 12:53:03.989293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:53:03.989293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 539/1092] 10.222.0.16 () {56 vars in 1093 bytes} [Thu Jun 23 12:53:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:03.994472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c206663-4bf4-44e3-907c-d4f4a812595f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.003202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-846225a1-1f63-486d-92d2-70f6e96e9ae1 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:04.004387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-846225a1-1f63-486d-92d2-70f6e96e9ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:04.021859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.071488 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 554/1093] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:53:04.079088 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.096031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846225a1-1f63-486d-92d2-70f6e96e9ae1 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.097349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c206663-4bf4-44e3-907c-d4f4a812595f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.131668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fab3d-1c40-47ee-8203-bb4e2cef8352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.132342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fab3d-1c40-47ee-8203-bb4e2cef8352 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.132627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fab3d-1c40-47ee-8203-bb4e2cef8352 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.133061 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fab3d-1c40-47ee-8203-bb4e2cef8352 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.133903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fab3d-1c40-47ee-8203-bb4e2cef8352 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:04.134213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fab3d-1c40-47ee-8203-bb4e2cef8352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.136332 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fab3d-1c40-47ee-8203-bb4e2cef8352 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.155333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 540/1094] 10.222.0.16 () {56 vars in 1133 bytes} [Thu Jun 23 12:53:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:04.160982 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fab3d-1c40-47ee-8203-bb4e2cef8352 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.194529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846225a1-1f63-486d-92d2-70f6e96e9ae1 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.227124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c2dcd-c2cd-422f-977d-9c77f052b89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.227907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c2dcd-c2cd-422f-977d-9c77f052b89e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.228736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c2dcd-c2cd-422f-977d-9c77f052b89e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.229321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c2dcd-c2cd-422f-977d-9c77f052b89e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.238795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c2dcd-c2cd-422f-977d-9c77f052b89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6a1c2dcd-c2cd-422f-977d-9c77f052b89e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:04.246355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:04.247389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:53:04.248231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 555/1095] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:04.253295 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c2dcd-c2cd-422f-977d-9c77f052b89e None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.260939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fab3d-1c40-47ee-8203-bb4e2cef8352 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.268722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.298604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6436e6f-3480-45a9-b4fd-c90ee9bdb848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.299165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436e6f-3480-45a9-b4fd-c90ee9bdb848 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.299443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436e6f-3480-45a9-b4fd-c90ee9bdb848 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.299716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436e6f-3480-45a9-b4fd-c90ee9bdb848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.311277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.359787 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c2dcd-c2cd-422f-977d-9c77f052b89e None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.376934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6436e6f-3480-45a9-b4fd-c90ee9bdb848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.378388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6436e6f-3480-45a9-b4fd-c90ee9bdb848 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.393866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69612089-31d2-42e0-9c1c-8c1bea90f702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.394573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612089-31d2-42e0-9c1c-8c1bea90f702 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.394858 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612089-31d2-42e0-9c1c-8c1bea90f702 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.395134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69612089-31d2-42e0-9c1c-8c1bea90f702 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.395892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69612089-31d2-42e0-9c1c-8c1bea90f702 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:04.396197 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69612089-31d2-42e0-9c1c-8c1bea90f702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.397574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69612089-31d2-42e0-9c1c-8c1bea90f702 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.410946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 556/1096] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:04.412045 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69612089-31d2-42e0-9c1c-8c1bea90f702 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.475690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 541/1097] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 12:53:04.481953 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6436e6f-3480-45a9-b4fd-c90ee9bdb848 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.487566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.511734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69612089-31d2-42e0-9c1c-8c1bea90f702 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.523419 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.545584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55d83e-0b65-4006-9b41-912bf8fff820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.546455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55d83e-0b65-4006-9b41-912bf8fff820 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.546739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55d83e-0b65-4006-9b41-912bf8fff820 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.547018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55d83e-0b65-4006-9b41-912bf8fff820 None admin] PATH_INFO: `/v3/users/d3d7006548284947a73c96ca66f22f35` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.548207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55d83e-0b65-4006-9b41-912bf8fff820 None admin] RBAC: Authorizing `identity:get_user(user_id=d3d7006548284947a73c96ca66f22f35)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.549752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55d83e-0b65-4006-9b41-912bf8fff820 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.551599 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 557/1098] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/users/d3d7006548284947a73c96ca66f22f35 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:04.557168 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55d83e-0b65-4006-9b41-912bf8fff820 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.581636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6436e6f-3480-45a9-b4fd-c90ee9bdb848 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.618491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b8c0e-6972-45ba-a04e-5f59e975e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.620248 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b8c0e-6972-45ba-a04e-5f59e975e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.620604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b8c0e-6972-45ba-a04e-5f59e975e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.620962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b8c0e-6972-45ba-a04e-5f59e975e8f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.634271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b8c0e-6972-45ba-a04e-5f59e975e8f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.635821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b8c0e-6972-45ba-a04e-5f59e975e8f3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-360b8c0e-6972-45ba-a04e-5f59e975e8f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:04.655415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:04.656443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:04.657695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:53:04.657695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:04.657695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:53:04.657695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:53:04.657695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 542/1099] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:04.662272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b8c0e-6972-45ba-a04e-5f59e975e8f3 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.663589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55d83e-0b65-4006-9b41-912bf8fff820 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.698043 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d492b1c-66df-4043-9212-b62638f921ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.698695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d492b1c-66df-4043-9212-b62638f921ec None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.698982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d492b1c-66df-4043-9212-b62638f921ec None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.699261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d492b1c-66df-4043-9212-b62638f921ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.710961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.752383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.761010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b8c0e-6972-45ba-a04e-5f59e975e8f3 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.766494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d492b1c-66df-4043-9212-b62638f921ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.767934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d492b1c-66df-4043-9212-b62638f921ec None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.795209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fc148-cf19-4a7a-a5e5-5bd4d99af83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.795927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fc148-cf19-4a7a-a5e5-5bd4d99af83f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.796413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fc148-cf19-4a7a-a5e5-5bd4d99af83f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.797076 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fc148-cf19-4a7a-a5e5-5bd4d99af83f None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.798492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fc148-cf19-4a7a-a5e5-5bd4d99af83f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:04.798805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fc148-cf19-4a7a-a5e5-5bd4d99af83f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.800221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fc148-cf19-4a7a-a5e5-5bd4d99af83f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.811800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 543/1100] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:04.817314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fc148-cf19-4a7a-a5e5-5bd4d99af83f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.869409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 558/1101] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 12:53:04.874932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d492b1c-66df-4043-9212-b62638f921ec None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:04.916176 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:04.921750 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fc148-cf19-4a7a-a5e5-5bd4d99af83f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.956678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db06ca-0844-4ced-8429-a652b69ee8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:04.957508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db06ca-0844-4ced-8429-a652b69ee8cc None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:04.957801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db06ca-0844-4ced-8429-a652b69ee8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:04.958077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db06ca-0844-4ced-8429-a652b69ee8cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:04.964825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db06ca-0844-4ced-8429-a652b69ee8cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:04.966356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db06ca-0844-4ced-8429-a652b69ee8cc None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:04.978268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d492b1c-66df-4043-9212-b62638f921ec None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-09db06ca-0844-4ced-8429-a652b69ee8cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:53:04.980445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:04.981472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:04.982378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:53:04.982378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:53:04.982378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:04.982378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:04.982378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:04.982378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:04.982378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:53:04.982378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:53:04.982378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 544/1102] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 12:53:04.987406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db06ca-0844-4ced-8429-a652b69ee8cc None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:05.001875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:05.013412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc19f2b-1701-4736-a7c8-e462d69ad443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:05.014282 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc19f2b-1701-4736-a7c8-e462d69ad443 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:05.016609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc19f2b-1701-4736-a7c8-e462d69ad443 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:05.016609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc19f2b-1701-4736-a7c8-e462d69ad443 None admin] PATH_INFO: `/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:05.016609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc19f2b-1701-4736-a7c8-e462d69ad443 None admin] RBAC: Authorizing `identity:get_project(project_id=ac4e7c64a3a14364bb3a32cd16678ead)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:05.017435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc19f2b-1701-4736-a7c8-e462d69ad443 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:05.023961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 559/1103] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:05.025180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc19f2b-1701-4736-a7c8-e462d69ad443 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:05.086855 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db06ca-0844-4ced-8429-a652b69ee8cc None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:05.120280 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f172e0f-17e2-4f1b-be85-785dbcf69b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:05.120967 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f172e0f-17e2-4f1b-be85-785dbcf69b75 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:05.121256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f172e0f-17e2-4f1b-be85-785dbcf69b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:05.121535 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f172e0f-17e2-4f1b-be85-785dbcf69b75 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:05.121997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc19f2b-1701-4736-a7c8-e462d69ad443 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:05.122401 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f172e0f-17e2-4f1b-be85-785dbcf69b75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:05.122620 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f172e0f-17e2-4f1b-be85-785dbcf69b75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:05.124064 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f172e0f-17e2-4f1b-be85-785dbcf69b75 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:05.133263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:05.135429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 545/1104] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:05.141657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f172e0f-17e2-4f1b-be85-785dbcf69b75 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:05.157084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1213542-808d-4d58-88e9-3d13737c26a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:05.157744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1213542-808d-4d58-88e9-3d13737c26a8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:05.158025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1213542-808d-4d58-88e9-3d13737c26a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:05.158299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1213542-808d-4d58-88e9-3d13737c26a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:05.159141 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1213542-808d-4d58-88e9-3d13737c26a8 None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=ac4e7c64a3a14364bb3a32cd16678ead, user.id=d3d7006548284947a73c96ca66f22f35) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:05.159651 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1213542-808d-4d58-88e9-3d13737c26a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:05.161627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1213542-808d-4d58-88e9-3d13737c26a8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:05.167559 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 560/1105] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:05 2022] GET /identity/v3/role_assignments?user.id=d3d7006548284947a73c96ca66f22f35&scope.project.id=ac4e7c64a3a14364bb3a32cd16678ead&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:05.213964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:05.246571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f172e0f-17e2-4f1b-be85-785dbcf69b75 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:05.282795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c5275-1304-4a8f-b7c3-c43c9d2a3dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:05.283472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c5275-1304-4a8f-b7c3-c43c9d2a3dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:05.283754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c5275-1304-4a8f-b7c3-c43c9d2a3dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:05.284032 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c5275-1304-4a8f-b7c3-c43c9d2a3dc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:05.284921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c5275-1304-4a8f-b7c3-c43c9d2a3dc9 None admin] RBAC: Adding query filter params (role.id=be5e149a2c4b4be79c9dbb018b5975d4, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=703c2c40fe434402817a8824c2756ee7) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:05.285238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c5275-1304-4a8f-b7c3-c43c9d2a3dc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:05.286748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c5275-1304-4a8f-b7c3-c43c9d2a3dc9 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:05.293745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 546/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:05 2022] GET /identity/v3/role_assignments?user.id=703c2c40fe434402817a8824c2756ee7&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=be5e149a2c4b4be79c9dbb018b5975d4 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:53:07.302077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3945ab-92bd-4f85-aac4-58268b241d97 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.302654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3945ab-92bd-4f85-aac4-58268b241d97 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.302654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3945ab-92bd-4f85-aac4-58268b241d97 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.304004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 561/1107] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:07.309948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229d7de-9a5a-4f94-9c79-b513a8d500ab None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.310388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229d7de-9a5a-4f94-9c79-b513a8d500ab None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.310490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229d7de-9a5a-4f94-9c79-b513a8d500ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.327843 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d229d7de-9a5a-4f94-9c79-b513a8d500ab None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:07.329130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d229d7de-9a5a-4f94-9c79-b513a8d500ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:07.394405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 547/1108] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:07.418713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3945ab-92bd-4f85-aac4-58268b241d97 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:07.516569 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3945ab-92bd-4f85-aac4-58268b241d97 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:07.549811 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d75dd6-f983-4432-9ef3-74faf03bde29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:07.550622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d75dd6-f983-4432-9ef3-74faf03bde29 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.550903 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d75dd6-f983-4432-9ef3-74faf03bde29 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.551174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d75dd6-f983-4432-9ef3-74faf03bde29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.552387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d75dd6-f983-4432-9ef3-74faf03bde29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:07.553794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d75dd6-f983-4432-9ef3-74faf03bde29 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:07.555433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 562/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:07.563730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229d7de-9a5a-4f94-9c79-b513a8d500ab None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:07.625896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:07.658761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229d7de-9a5a-4f94-9c79-b513a8d500ab None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:07.691845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925ed31-26c6-4919-bb23-94db7ea5905e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:07.692517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925ed31-26c6-4919-bb23-94db7ea5905e None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:07.692829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925ed31-26c6-4919-bb23-94db7ea5905e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:07.693105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925ed31-26c6-4919-bb23-94db7ea5905e None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:07.694594 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925ed31-26c6-4919-bb23-94db7ea5905e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:07.696046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925ed31-26c6-4919-bb23-94db7ea5905e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:07.802645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 548/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:53:07 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:53:09.890089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a80d9b-947e-400f-9c8a-7df7a173f333 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:09.890526 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a80d9b-947e-400f-9c8a-7df7a173f333 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:09.890637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a80d9b-947e-400f-9c8a-7df7a173f333 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:09.891994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 563/1111] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:09.897211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033caa1f-bb97-426a-9e00-d0b7a5f9edf6 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:09.897636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033caa1f-bb97-426a-9e00-d0b7a5f9edf6 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:09.897776 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033caa1f-bb97-426a-9e00-d0b7a5f9edf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:09.914144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-033caa1f-bb97-426a-9e00-d0b7a5f9edf6 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:09.915841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-033caa1f-bb97-426a-9e00-d0b7a5f9edf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:09.982088 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 549/1112] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:10.006429 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a80d9b-947e-400f-9c8a-7df7a173f333 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:10.049321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:10.104176 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a80d9b-947e-400f-9c8a-7df7a173f333 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:10.136470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385acf5-4f39-4351-9020-cbdddb34bfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:10.137277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385acf5-4f39-4351-9020-cbdddb34bfb3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:10.137817 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385acf5-4f39-4351-9020-cbdddb34bfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:10.138090 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385acf5-4f39-4351-9020-cbdddb34bfb3 None admin] PATH_INFO: `/v3/roles/d773dfde38e5426799f6b947044767bb` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:10.139548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385acf5-4f39-4351-9020-cbdddb34bfb3 None admin] RBAC: Authorizing `identity:get_role(role_id=d773dfde38e5426799f6b947044767bb)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:10.140938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385acf5-4f39-4351-9020-cbdddb34bfb3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:10.142286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 564/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:10 2022] GET /identity/v3/roles/d773dfde38e5426799f6b947044767bb => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:10.147949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033caa1f-bb97-426a-9e00-d0b7a5f9edf6 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:10.200473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:10.245449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033caa1f-bb97-426a-9e00-d0b7a5f9edf6 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:10.278492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3273c5f-3756-42d1-acb2-2191133d43b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:10.279353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3273c5f-3756-42d1-acb2-2191133d43b5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:10.279635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3273c5f-3756-42d1-acb2-2191133d43b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:10.279910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3273c5f-3756-42d1-acb2-2191133d43b5 None admin] PATH_INFO: `/v3/users/d6275a9eb7304324a50cab40d9e274a7` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:10.292906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3273c5f-3756-42d1-acb2-2191133d43b5 None admin] RBAC: Authorizing `identity:get_user(user_id=d6275a9eb7304324a50cab40d9e274a7)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:10.294359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3273c5f-3756-42d1-acb2-2191133d43b5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:10.295986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 550/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:10 2022] GET /identity/v3/users/d6275a9eb7304324a50cab40d9e274a7 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:10.301646 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385acf5-4f39-4351-9020-cbdddb34bfb3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:10.397465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385acf5-4f39-4351-9020-cbdddb34bfb3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:10.407634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:10.429984 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7eb42-42b2-4c7e-80ca-c41c04be6627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:10.435218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7eb42-42b2-4c7e-80ca-c41c04be6627 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:10.435218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7eb42-42b2-4c7e-80ca-c41c04be6627 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:10.435218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7eb42-42b2-4c7e-80ca-c41c04be6627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:10.497175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7eb42-42b2-4c7e-80ca-c41c04be6627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:10.498744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7eb42-42b2-4c7e-80ca-c41c04be6627 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:10.595051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 565/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:53:10.600902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3273c5f-3756-42d1-acb2-2191133d43b5 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:10.696906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3273c5f-3756-42d1-acb2-2191133d43b5 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:10.707527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:10.731121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a46eaa7-3792-4a7e-b01c-37dedca955d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:10.731967 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46eaa7-3792-4a7e-b01c-37dedca955d3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:10.732247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46eaa7-3792-4a7e-b01c-37dedca955d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:10.732518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a46eaa7-3792-4a7e-b01c-37dedca955d3 None admin] PATH_INFO: `/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:10.733710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46eaa7-3792-4a7e-b01c-37dedca955d3 None admin] RBAC: Authorizing `identity:get_project(project_id=ac4e7c64a3a14364bb3a32cd16678ead)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:10.735132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a46eaa7-3792-4a7e-b01c-37dedca955d3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:10.736797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 551/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:10 2022] GET /identity/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:10.742897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7eb42-42b2-4c7e-80ca-c41c04be6627 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:10.754468 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:10.839674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7eb42-42b2-4c7e-80ca-c41c04be6627 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:10.874281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c695f1d-32fd-48e1-b895-e3787292806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:10.874937 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c695f1d-32fd-48e1-b895-e3787292806a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:10.875219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c695f1d-32fd-48e1-b895-e3787292806a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:10.875493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c695f1d-32fd-48e1-b895-e3787292806a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:10.876323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c695f1d-32fd-48e1-b895-e3787292806a None admin] RBAC: Adding query filter params (role.id=d773dfde38e5426799f6b947044767bb, scope.project.id=ac4e7c64a3a14364bb3a32cd16678ead, user.id=d6275a9eb7304324a50cab40d9e274a7) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:10.876635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c695f1d-32fd-48e1-b895-e3787292806a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:10.878106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c695f1d-32fd-48e1-b895-e3787292806a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:10.883588 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 566/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:10 2022] GET /identity/v3/role_assignments?user.id=d6275a9eb7304324a50cab40d9e274a7&scope.project.id=ac4e7c64a3a14364bb3a32cd16678ead&role.id=d773dfde38e5426799f6b947044767bb => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:12.883392 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8762b9-68c8-49f7-8a63-055c22f6a9d2 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:12.883950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8762b9-68c8-49f7-8a63-055c22f6a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:12.883950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8762b9-68c8-49f7-8a63-055c22f6a9d2 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:12.885365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 552/1118] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:12.890692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0acbcd-2598-4000-82cc-5f934b16e17c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:12.891084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0acbcd-2598-4000-82cc-5f934b16e17c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:12.891235 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0acbcd-2598-4000-82cc-5f934b16e17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:12.908261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fb0acbcd-2598-4000-82cc-5f934b16e17c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:12.909462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fb0acbcd-2598-4000-82cc-5f934b16e17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:12.973382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 567/1119] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:12.996822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8762b9-68c8-49f7-8a63-055c22f6a9d2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:13.093685 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8762b9-68c8-49f7-8a63-055c22f6a9d2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:13.126433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0d85-da62-472c-afa8-1d3157fe1c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:13.127208 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0d85-da62-472c-afa8-1d3157fe1c4f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:13.127493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0d85-da62-472c-afa8-1d3157fe1c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:13.127767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a0d85-da62-472c-afa8-1d3157fe1c4f None admin] PATH_INFO: `/v3/roles/d773dfde38e5426799f6b947044767bb` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:13.129261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a0d85-da62-472c-afa8-1d3157fe1c4f None admin] RBAC: Authorizing `identity:get_role(role_id=d773dfde38e5426799f6b947044767bb)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:13.130626 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219a0d85-da62-472c-afa8-1d3157fe1c4f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:13.131960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 553/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:12 2022] GET /identity/v3/roles/d773dfde38e5426799f6b947044767bb => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:13.138245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0acbcd-2598-4000-82cc-5f934b16e17c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:13.141296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:13.233494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0acbcd-2598-4000-82cc-5f934b16e17c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:13.265480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fbe39-2e2f-4ae6-9dac-d0c1d1c38dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:13.266344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fbe39-2e2f-4ae6-9dac-d0c1d1c38dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:13.266627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fbe39-2e2f-4ae6-9dac-d0c1d1c38dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:13.266905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88fbe39-2e2f-4ae6-9dac-d0c1d1c38dd5 None admin] PATH_INFO: `/v3/users/d6275a9eb7304324a50cab40d9e274a7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:13.268079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fbe39-2e2f-4ae6-9dac-d0c1d1c38dd5 None admin] RBAC: Authorizing `identity:get_user(user_id=d6275a9eb7304324a50cab40d9e274a7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:13.269537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88fbe39-2e2f-4ae6-9dac-d0c1d1c38dd5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:13.271142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 568/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:13 2022] GET /identity/v3/users/d6275a9eb7304324a50cab40d9e274a7 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:13.277643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0d85-da62-472c-afa8-1d3157fe1c4f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:13.322956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:13.374699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219a0d85-da62-472c-afa8-1d3157fe1c4f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:13.407286 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48481fbe-3dfa-423b-bf7a-82e7be4b7c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:13.408064 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48481fbe-3dfa-423b-bf7a-82e7be4b7c71 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:13.408348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48481fbe-3dfa-423b-bf7a-82e7be4b7c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:13.408624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48481fbe-3dfa-423b-bf7a-82e7be4b7c71 None admin] PATH_INFO: `/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:13.409886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48481fbe-3dfa-423b-bf7a-82e7be4b7c71 None admin] RBAC: Authorizing `identity:get_project(project_id=ac4e7c64a3a14364bb3a32cd16678ead)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:13.411324 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48481fbe-3dfa-423b-bf7a-82e7be4b7c71 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:13.413020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 554/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:13 2022] GET /identity/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:13.419556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fbe39-2e2f-4ae6-9dac-d0c1d1c38dd5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:13.487253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:13.516054 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88fbe39-2e2f-4ae6-9dac-d0c1d1c38dd5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:13.548863 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4c2b8-c099-48f3-afaf-3fb0cfd5128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:13.549734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4c2b8-c099-48f3-afaf-3fb0cfd5128a None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:13.550021 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4c2b8-c099-48f3-afaf-3fb0cfd5128a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:13.550302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4c2b8-c099-48f3-afaf-3fb0cfd5128a None admin] PATH_INFO: `/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead/users/d6275a9eb7304324a50cab40d9e274a7/roles/d773dfde38e5426799f6b947044767bb` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:13.552503 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4c2b8-c099-48f3-afaf-3fb0cfd5128a None admin] RBAC: Authorizing `identity:create_grant(project_id=ac4e7c64a3a14364bb3a32cd16678ead, user_id=d6275a9eb7304324a50cab40d9e274a7, role_id=d773dfde38e5426799f6b947044767bb)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:13.554087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4c2b8-c099-48f3-afaf-3fb0cfd5128a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:13.636290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 569/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:13 2022] PUT /identity/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead/users/d6275a9eb7304324a50cab40d9e274a7/roles/d773dfde38e5426799f6b947044767bb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:15.653181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d416ecb-5d9b-466e-940a-b9df09a9f2b5 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.653735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d416ecb-5d9b-466e-940a-b9df09a9f2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.653735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d416ecb-5d9b-466e-940a-b9df09a9f2b5 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.655107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 555/1124] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:15.660186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c6274-3700-4127-be62-23803dc6d891 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.660594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c6274-3700-4127-be62-23803dc6d891 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.660749 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c6274-3700-4127-be62-23803dc6d891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.677744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9c7c6274-3700-4127-be62-23803dc6d891 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:15.678935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9c7c6274-3700-4127-be62-23803dc6d891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:15.744873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 570/1125] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:15.770054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d416ecb-5d9b-466e-940a-b9df09a9f2b5 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:15.869627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d416ecb-5d9b-466e-940a-b9df09a9f2b5 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:15.884619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:15.903750 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c5b44-91c1-460f-a70a-8ae54fb7346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:15.904542 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c5b44-91c1-460f-a70a-8ae54fb7346c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:15.904845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c5b44-91c1-460f-a70a-8ae54fb7346c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:15.905126 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c5b44-91c1-460f-a70a-8ae54fb7346c None admin] PATH_INFO: `/v3/roles/d773dfde38e5426799f6b947044767bb` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:15.906590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c5b44-91c1-460f-a70a-8ae54fb7346c None admin] RBAC: Authorizing `identity:get_role(role_id=d773dfde38e5426799f6b947044767bb)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:15.907959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c5b44-91c1-460f-a70a-8ae54fb7346c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:15.909339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 556/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:15 2022] GET /identity/v3/roles/d773dfde38e5426799f6b947044767bb => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:15.915739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c6274-3700-4127-be62-23803dc6d891 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:15.974215 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:16.011393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c6274-3700-4127-be62-23803dc6d891 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:16.045109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab421b0-8323-47bb-a69f-fd8671c0eda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:16.046383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab421b0-8323-47bb-a69f-fd8671c0eda9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:16.046665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab421b0-8323-47bb-a69f-fd8671c0eda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:16.046938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab421b0-8323-47bb-a69f-fd8671c0eda9 None admin] PATH_INFO: `/v3/users/d6275a9eb7304324a50cab40d9e274a7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:16.048107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab421b0-8323-47bb-a69f-fd8671c0eda9 None admin] RBAC: Authorizing `identity:get_user(user_id=d6275a9eb7304324a50cab40d9e274a7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:16.049558 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab421b0-8323-47bb-a69f-fd8671c0eda9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:16.051164 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 571/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:15 2022] GET /identity/v3/users/d6275a9eb7304324a50cab40d9e274a7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:16.057819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c5b44-91c1-460f-a70a-8ae54fb7346c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:16.154497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c5b44-91c1-460f-a70a-8ae54fb7346c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:16.187095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaee8d5-a252-4dde-95f6-d94444940b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:16.187732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaee8d5-a252-4dde-95f6-d94444940b4e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:16.188017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaee8d5-a252-4dde-95f6-d94444940b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:16.188296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaee8d5-a252-4dde-95f6-d94444940b4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:16.235544 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:16.252966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaee8d5-a252-4dde-95f6-d94444940b4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:16.254415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaee8d5-a252-4dde-95f6-d94444940b4e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:16.349851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 557/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:53:16.356066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab421b0-8323-47bb-a69f-fd8671c0eda9 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:16.452374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab421b0-8323-47bb-a69f-fd8671c0eda9 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:16.479425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:16.484923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91c722-1daa-40d2-8620-0943adb0034e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:16.488684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91c722-1daa-40d2-8620-0943adb0034e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:16.488684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91c722-1daa-40d2-8620-0943adb0034e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:16.488684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91c722-1daa-40d2-8620-0943adb0034e None admin] PATH_INFO: `/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:16.488684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91c722-1daa-40d2-8620-0943adb0034e None admin] RBAC: Authorizing `identity:get_project(project_id=ac4e7c64a3a14364bb3a32cd16678ead)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:16.489046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91c722-1daa-40d2-8620-0943adb0034e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:16.490671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 572/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:16 2022] GET /identity/v3/projects/ac4e7c64a3a14364bb3a32cd16678ead => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:16.497225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaee8d5-a252-4dde-95f6-d94444940b4e None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:16.578672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:16.596121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaee8d5-a252-4dde-95f6-d94444940b4e None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:16.630788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a13e675-f89e-472c-9ec0-8c57e8640534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:16.631432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13e675-f89e-472c-9ec0-8c57e8640534 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:16.631716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13e675-f89e-472c-9ec0-8c57e8640534 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:16.631997 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a13e675-f89e-472c-9ec0-8c57e8640534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:16.632843 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13e675-f89e-472c-9ec0-8c57e8640534 None admin] RBAC: Adding query filter params (role.id=d773dfde38e5426799f6b947044767bb, scope.project.id=ac4e7c64a3a14364bb3a32cd16678ead, user.id=d6275a9eb7304324a50cab40d9e274a7) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:16.633157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13e675-f89e-472c-9ec0-8c57e8640534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:16.634728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a13e675-f89e-472c-9ec0-8c57e8640534 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:16.640798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 558/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:16 2022] GET /identity/v3/role_assignments?user.id=d6275a9eb7304324a50cab40d9e274a7&scope.project.id=ac4e7c64a3a14364bb3a32cd16678ead&role.id=d773dfde38e5426799f6b947044767bb => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:18.734840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0e4e4-e431-4d07-8037-680eb4dbda81 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:18.735398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0e4e4-e431-4d07-8037-680eb4dbda81 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:18.735398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0e4e4-e431-4d07-8037-680eb4dbda81 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:18.736777 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 573/1131] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:18.741928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5902e3-2f31-473e-89b8-01dfaa313d64 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:18.742307 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5902e3-2f31-473e-89b8-01dfaa313d64 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:18.742484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5902e3-2f31-473e-89b8-01dfaa313d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:18.759974 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-6e5902e3-2f31-473e-89b8-01dfaa313d64 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:18.761182 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6e5902e3-2f31-473e-89b8-01dfaa313d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:18.826225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 559/1132] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:18.849228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0e4e4-e431-4d07-8037-680eb4dbda81 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:18.949711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0e4e4-e431-4d07-8037-680eb4dbda81 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:18.982361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29149e5-eed3-47e6-b72b-7071105c8287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:18.983145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29149e5-eed3-47e6-b72b-7071105c8287 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:18.983431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29149e5-eed3-47e6-b72b-7071105c8287 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:18.983710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29149e5-eed3-47e6-b72b-7071105c8287 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:18.984955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29149e5-eed3-47e6-b72b-7071105c8287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:18.986334 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29149e5-eed3-47e6-b72b-7071105c8287 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:18.987950 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 574/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:18.994267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5902e3-2f31-473e-89b8-01dfaa313d64 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:19.067234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:19.088547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5902e3-2f31-473e-89b8-01dfaa313d64 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:19.121194 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138320f1-580f-4a64-8fe4-3ab0dd14382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:19.121842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138320f1-580f-4a64-8fe4-3ab0dd14382f None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:19.122127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138320f1-580f-4a64-8fe4-3ab0dd14382f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:19.122409 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138320f1-580f-4a64-8fe4-3ab0dd14382f None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:19.123118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138320f1-580f-4a64-8fe4-3ab0dd14382f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:19.124556 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138320f1-580f-4a64-8fe4-3ab0dd14382f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:19.224665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 560/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:53:18 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:53:21.289198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ea48-5004-4f6a-8858-08823d4b4b41 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.290252 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ea48-5004-4f6a-8858-08823d4b4b41 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.290367 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9ea48-5004-4f6a-8858-08823d4b4b41 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.291726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 575/1135] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:21.296995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c10b4-22fa-47aa-abc9-5049694e7766 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.297391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c10b4-22fa-47aa-abc9-5049694e7766 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.297566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c10b4-22fa-47aa-abc9-5049694e7766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.315320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ab3c10b4-22fa-47aa-abc9-5049694e7766 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:21.316507 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ab3c10b4-22fa-47aa-abc9-5049694e7766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:21.383912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 561/1136] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:21.409482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9ea48-5004-4f6a-8858-08823d4b4b41 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:21.472866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:21.506096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9ea48-5004-4f6a-8858-08823d4b4b41 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:21.538927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418ddc8-bf2c-40a0-8e73-6125564475ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:21.540388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418ddc8-bf2c-40a0-8e73-6125564475ed None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.540560 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418ddc8-bf2c-40a0-8e73-6125564475ed None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.540861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418ddc8-bf2c-40a0-8e73-6125564475ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.542023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418ddc8-bf2c-40a0-8e73-6125564475ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:21.543469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418ddc8-bf2c-40a0-8e73-6125564475ed None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:21.545089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 576/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:53:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:21.550704 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c10b4-22fa-47aa-abc9-5049694e7766 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:21.607304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:21.647673 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c10b4-22fa-47aa-abc9-5049694e7766 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:21.683219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c52da-4acd-4b5f-b2e3-7610c90773f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:21.683883 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c52da-4acd-4b5f-b2e3-7610c90773f8 None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:21.684164 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c52da-4acd-4b5f-b2e3-7610c90773f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:21.684439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c52da-4acd-4b5f-b2e3-7610c90773f8 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:21.685176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c52da-4acd-4b5f-b2e3-7610c90773f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:21.686613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c52da-4acd-4b5f-b2e3-7610c90773f8 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:21.767305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 562/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:53:21 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:53:23.830612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450687f-5dc2-411d-b838-e412437fad99 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.831171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450687f-5dc2-411d-b838-e412437fad99 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.831171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450687f-5dc2-411d-b838-e412437fad99 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.832531 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 577/1139] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:23.837814 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b5be4-5b99-4335-b31b-97a4fc383fb5 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:23.838222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b5be4-5b99-4335-b31b-97a4fc383fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:23.838377 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b5be4-5b99-4335-b31b-97a4fc383fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:23.854639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-b30b5be4-5b99-4335-b31b-97a4fc383fb5 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:23.855807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b30b5be4-5b99-4335-b31b-97a4fc383fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:23.921499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 563/1140] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:23.945226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450687f-5dc2-411d-b838-e412437fad99 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:24.043501 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450687f-5dc2-411d-b838-e412437fad99 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:24.076383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3a912-10be-46e3-b12f-6bad307e7f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.077190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3a912-10be-46e3-b12f-6bad307e7f21 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.077474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3a912-10be-46e3-b12f-6bad307e7f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.077750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3a912-10be-46e3-b12f-6bad307e7f21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.079567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:24.087896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba3a912-10be-46e3-b12f-6bad307e7f21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-4ba3a912-10be-46e3-b12f-6bad307e7f21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:24.095446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:24.096584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:53:24.097551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 578/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:24.103149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b5be4-5b99-4335-b31b-97a4fc383fb5 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:24.146980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:24.200278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b5be4-5b99-4335-b31b-97a4fc383fb5 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:24.232975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48d8e0-4fb6-47ef-90ef-5222fd2738bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.233622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48d8e0-4fb6-47ef-90ef-5222fd2738bc None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.233904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48d8e0-4fb6-47ef-90ef-5222fd2738bc None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.234178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac48d8e0-4fb6-47ef-90ef-5222fd2738bc None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.234917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48d8e0-4fb6-47ef-90ef-5222fd2738bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:24.235220 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48d8e0-4fb6-47ef-90ef-5222fd2738bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:24.236580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac48d8e0-4fb6-47ef-90ef-5222fd2738bc None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.245384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 564/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:24.251165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3a912-10be-46e3-b12f-6bad307e7f21 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:24.350594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3a912-10be-46e3-b12f-6bad307e7f21 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:24.383939 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea0fe2-dc3e-400d-9e03-45bd0d10be90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.384828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea0fe2-dc3e-400d-9e03-45bd0d10be90 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.385110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea0fe2-dc3e-400d-9e03-45bd0d10be90 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.385384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea0fe2-dc3e-400d-9e03-45bd0d10be90 None admin] PATH_INFO: `/v3/users/cf73fbf475594d1aa222881a028397ed` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.398106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea0fe2-dc3e-400d-9e03-45bd0d10be90 None admin] RBAC: Authorizing `identity:get_user(user_id=cf73fbf475594d1aa222881a028397ed)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:24.400495 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea0fe2-dc3e-400d-9e03-45bd0d10be90 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.402154 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 579/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:24 2022] GET /identity/v3/users/cf73fbf475594d1aa222881a028397ed => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:24.407955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48d8e0-4fb6-47ef-90ef-5222fd2738bc None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:24.503071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac48d8e0-4fb6-47ef-90ef-5222fd2738bc None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:24.510256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:24.536222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d30aa-2b45-4069-8adc-1a04336310d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.536922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d30aa-2b45-4069-8adc-1a04336310d5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.537232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d30aa-2b45-4069-8adc-1a04336310d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.537512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06d30aa-2b45-4069-8adc-1a04336310d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.603745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d30aa-2b45-4069-8adc-1a04336310d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:24.605158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06d30aa-2b45-4069-8adc-1a04336310d5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.701699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 565/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:53:24.707517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea0fe2-dc3e-400d-9e03-45bd0d10be90 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:24.759053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:24.803886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea0fe2-dc3e-400d-9e03-45bd0d10be90 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:24.836245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc81a86-266e-43c1-be37-c956e04114f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.837119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc81a86-266e-43c1-be37-c956e04114f6 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.837398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc81a86-266e-43c1-be37-c956e04114f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.837671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc81a86-266e-43c1-be37-c956e04114f6 None admin] PATH_INFO: `/v3/projects/8d886d0cd74148eca65bb37f2815936c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.838823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc81a86-266e-43c1-be37-c956e04114f6 None admin] RBAC: Authorizing `identity:get_project(project_id=8d886d0cd74148eca65bb37f2815936c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:24.840237 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc81a86-266e-43c1-be37-c956e04114f6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.841925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 580/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:24 2022] GET /identity/v3/projects/8d886d0cd74148eca65bb37f2815936c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:24.847868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d30aa-2b45-4069-8adc-1a04336310d5 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:24.856517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:24.946739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06d30aa-2b45-4069-8adc-1a04336310d5 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:24.978885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3748dc3-3fa0-4b5e-881d-db5078e370fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:24.979521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748dc3-3fa0-4b5e-881d-db5078e370fe None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:24.979803 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748dc3-3fa0-4b5e-881d-db5078e370fe None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:24.980080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3748dc3-3fa0-4b5e-881d-db5078e370fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:24.980940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3748dc3-3fa0-4b5e-881d-db5078e370fe None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=8d886d0cd74148eca65bb37f2815936c, user.id=cf73fbf475594d1aa222881a028397ed) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:24.981251 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3748dc3-3fa0-4b5e-881d-db5078e370fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:24.982680 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3748dc3-3fa0-4b5e-881d-db5078e370fe None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:24.987947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 566/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:24 2022] GET /identity/v3/role_assignments?user.id=cf73fbf475594d1aa222881a028397ed&scope.project.id=8d886d0cd74148eca65bb37f2815936c&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:26.986651 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0212afe-bbb6-43fe-b231-351faab3fde9 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:26.987155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0212afe-bbb6-43fe-b231-351faab3fde9 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:26.987246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0212afe-bbb6-43fe-b231-351faab3fde9 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:26.988550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 581/1147] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:26.994396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea93e26-a81e-4f54-a1ca-00c9c2eee7e0 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:26.994830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea93e26-a81e-4f54-a1ca-00c9c2eee7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:26.994952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea93e26-a81e-4f54-a1ca-00c9c2eee7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.012887 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-9ea93e26-a81e-4f54-a1ca-00c9c2eee7e0 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:27.014081 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9ea93e26-a81e-4f54-a1ca-00c9c2eee7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:27.074794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:27.079209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 567/1148] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 12:53:27.102292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0212afe-bbb6-43fe-b231-351faab3fde9 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:27.201853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0212afe-bbb6-43fe-b231-351faab3fde9 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:27.221328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:27.234983 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096e19b-0d5c-44ff-b7d3-b6e034dde9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:27.235763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096e19b-0d5c-44ff-b7d3-b6e034dde9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.236043 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096e19b-0d5c-44ff-b7d3-b6e034dde9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.236318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096e19b-0d5c-44ff-b7d3-b6e034dde9d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.246592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a096e19b-0d5c-44ff-b7d3-b6e034dde9d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-a096e19b-0d5c-44ff-b7d3-b6e034dde9d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:27.254206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:27.255269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:53:27.256288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 582/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:27.261498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea93e26-a81e-4f54-a1ca-00c9c2eee7e0 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:27.361436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea93e26-a81e-4f54-a1ca-00c9c2eee7e0 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:27.394704 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106f664-95b3-4550-9f3f-192712c53125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:27.395368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106f664-95b3-4550-9f3f-192712c53125 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.395653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106f664-95b3-4550-9f3f-192712c53125 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.395933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106f664-95b3-4550-9f3f-192712c53125 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.396685 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106f664-95b3-4550-9f3f-192712c53125 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:27.397022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106f664-95b3-4550-9f3f-192712c53125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:27.398920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106f664-95b3-4550-9f3f-192712c53125 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:27.406733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 568/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:27.412491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096e19b-0d5c-44ff-b7d3-b6e034dde9d1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:27.509335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096e19b-0d5c-44ff-b7d3-b6e034dde9d1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:27.541018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459331c-f345-4448-98db-6e1c6e69cac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:27.541869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459331c-f345-4448-98db-6e1c6e69cac4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.542153 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459331c-f345-4448-98db-6e1c6e69cac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.542428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459331c-f345-4448-98db-6e1c6e69cac4 None admin] PATH_INFO: `/v3/users/cf73fbf475594d1aa222881a028397ed` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.543597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459331c-f345-4448-98db-6e1c6e69cac4 None admin] RBAC: Authorizing `identity:get_user(user_id=cf73fbf475594d1aa222881a028397ed)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:27.545042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459331c-f345-4448-98db-6e1c6e69cac4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:27.546641 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 583/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:27 2022] GET /identity/v3/users/cf73fbf475594d1aa222881a028397ed => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:27.552366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106f664-95b3-4550-9f3f-192712c53125 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:27.613049 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:27.650078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106f664-95b3-4550-9f3f-192712c53125 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:27.681924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d9dce-066b-48af-a701-02e6eb7c000c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:27.682763 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d9dce-066b-48af-a701-02e6eb7c000c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.683042 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d9dce-066b-48af-a701-02e6eb7c000c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.683313 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d9dce-066b-48af-a701-02e6eb7c000c None admin] PATH_INFO: `/v3/projects/8d886d0cd74148eca65bb37f2815936c` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.684465 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d9dce-066b-48af-a701-02e6eb7c000c None admin] RBAC: Authorizing `identity:get_project(project_id=8d886d0cd74148eca65bb37f2815936c)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:27.685922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d9dce-066b-48af-a701-02e6eb7c000c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:27.687585 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 569/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:27 2022] GET /identity/v3/projects/8d886d0cd74148eca65bb37f2815936c => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:27.693428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459331c-f345-4448-98db-6e1c6e69cac4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:27.741834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:27.791027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459331c-f345-4448-98db-6e1c6e69cac4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:27.826872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f671f9-a9c4-4b4d-adfa-fdcad102ed42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:27.827760 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f671f9-a9c4-4b4d-adfa-fdcad102ed42 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:27.828044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f671f9-a9c4-4b4d-adfa-fdcad102ed42 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:27.828322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f671f9-a9c4-4b4d-adfa-fdcad102ed42 None admin] PATH_INFO: `/v3/projects/8d886d0cd74148eca65bb37f2815936c/users/cf73fbf475594d1aa222881a028397ed/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:27.830318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f671f9-a9c4-4b4d-adfa-fdcad102ed42 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d886d0cd74148eca65bb37f2815936c, user_id=cf73fbf475594d1aa222881a028397ed, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:27.831746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f671f9-a9c4-4b4d-adfa-fdcad102ed42 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:27.915887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 584/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:27 2022] PUT /identity/v3/projects/8d886d0cd74148eca65bb37f2815936c/users/cf73fbf475594d1aa222881a028397ed/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:29.914811 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4d11f-45ba-45b5-a417-458d83229ec2 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:29.915304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4d11f-45ba-45b5-a417-458d83229ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:29.915394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4d11f-45ba-45b5-a417-458d83229ec2 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:29.916749 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 570/1154] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:29.921944 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abd63d-e98c-4406-8bfd-4bcae7e9a84d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:29.922355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abd63d-e98c-4406-8bfd-4bcae7e9a84d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:29.922499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abd63d-e98c-4406-8bfd-4bcae7e9a84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:29.939246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a5abd63d-e98c-4406-8bfd-4bcae7e9a84d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:29.940423 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a5abd63d-e98c-4406-8bfd-4bcae7e9a84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:30.005096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 585/1155] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:30.030518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4d11f-45ba-45b5-a417-458d83229ec2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:30.129956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4d11f-45ba-45b5-a417-458d83229ec2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:30.157517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:30.163037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c94b2a-13b5-4ccd-b361-6d5f45daf2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:30.164310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c94b2a-13b5-4ccd-b361-6d5f45daf2ab None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.164592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c94b2a-13b5-4ccd-b361-6d5f45daf2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.164908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c94b2a-13b5-4ccd-b361-6d5f45daf2ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.174783 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c94b2a-13b5-4ccd-b361-6d5f45daf2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-a6c94b2a-13b5-4ccd-b361-6d5f45daf2ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:30.182730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:30.183818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:53:30.185086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 571/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:30.189901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abd63d-e98c-4406-8bfd-4bcae7e9a84d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:30.229863 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:30.287300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abd63d-e98c-4406-8bfd-4bcae7e9a84d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:30.321550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa57b2a-f337-4977-b2df-f3e1b3ec3780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:30.322206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa57b2a-f337-4977-b2df-f3e1b3ec3780 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.322487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa57b2a-f337-4977-b2df-f3e1b3ec3780 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.322757 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa57b2a-f337-4977-b2df-f3e1b3ec3780 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.323489 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa57b2a-f337-4977-b2df-f3e1b3ec3780 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:30.323790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa57b2a-f337-4977-b2df-f3e1b3ec3780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:30.325171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa57b2a-f337-4977-b2df-f3e1b3ec3780 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:30.332792 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 586/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:30.339183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c94b2a-13b5-4ccd-b361-6d5f45daf2ab None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:30.437122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c94b2a-13b5-4ccd-b361-6d5f45daf2ab None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:30.469738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2886f-e971-4b64-b8a7-5fce3154fe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:30.470581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2886f-e971-4b64-b8a7-5fce3154fe30 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.470866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2886f-e971-4b64-b8a7-5fce3154fe30 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.471139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2886f-e971-4b64-b8a7-5fce3154fe30 None admin] PATH_INFO: `/v3/users/cf73fbf475594d1aa222881a028397ed` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.472299 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2886f-e971-4b64-b8a7-5fce3154fe30 None admin] RBAC: Authorizing `identity:get_user(user_id=cf73fbf475594d1aa222881a028397ed)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:30.473738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2886f-e971-4b64-b8a7-5fce3154fe30 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:30.475325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 572/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/users/cf73fbf475594d1aa222881a028397ed => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:30.481014 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa57b2a-f337-4977-b2df-f3e1b3ec3780 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:30.575920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:30.578764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa57b2a-f337-4977-b2df-f3e1b3ec3780 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:30.611436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067d510-1c01-4c83-bead-9fd9f26685d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:30.612075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067d510-1c01-4c83-bead-9fd9f26685d3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.612360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067d510-1c01-4c83-bead-9fd9f26685d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.612641 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e067d510-1c01-4c83-bead-9fd9f26685d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.677457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067d510-1c01-4c83-bead-9fd9f26685d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:30.678896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e067d510-1c01-4c83-bead-9fd9f26685d3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:30.769800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:30.773464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 587/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:53:30.779282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2886f-e971-4b64-b8a7-5fce3154fe30 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:30.836147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:30.876884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2886f-e971-4b64-b8a7-5fce3154fe30 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:30.910235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e850304-17a9-4f9f-9b39-1e5ca7f53010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:30.911088 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e850304-17a9-4f9f-9b39-1e5ca7f53010 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:30.911375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e850304-17a9-4f9f-9b39-1e5ca7f53010 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:30.911654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e850304-17a9-4f9f-9b39-1e5ca7f53010 None admin] PATH_INFO: `/v3/projects/8d886d0cd74148eca65bb37f2815936c` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:30.912849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e850304-17a9-4f9f-9b39-1e5ca7f53010 None admin] RBAC: Authorizing `identity:get_project(project_id=8d886d0cd74148eca65bb37f2815936c)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:30.914365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e850304-17a9-4f9f-9b39-1e5ca7f53010 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:30.916051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 573/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/projects/8d886d0cd74148eca65bb37f2815936c => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:30.922044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067d510-1c01-4c83-bead-9fd9f26685d3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:31.018499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e067d510-1c01-4c83-bead-9fd9f26685d3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:31.051078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd3aff-23f0-409b-a956-c5da5a3a76eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:31.051667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd3aff-23f0-409b-a956-c5da5a3a76eb None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:31.051953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd3aff-23f0-409b-a956-c5da5a3a76eb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:31.052235 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd3aff-23f0-409b-a956-c5da5a3a76eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:31.053092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd3aff-23f0-409b-a956-c5da5a3a76eb None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=8d886d0cd74148eca65bb37f2815936c, user.id=cf73fbf475594d1aa222881a028397ed) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:31.053409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd3aff-23f0-409b-a956-c5da5a3a76eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:31.054990 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd3aff-23f0-409b-a956-c5da5a3a76eb None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:31.060639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 588/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:30 2022] GET /identity/v3/role_assignments?user.id=cf73fbf475594d1aa222881a028397ed&scope.project.id=8d886d0cd74148eca65bb37f2815936c&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:33.140196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aad0e6-1a1c-4328-83b8-d119fc498930 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:33.140846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aad0e6-1a1c-4328-83b8-d119fc498930 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:33.140846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aad0e6-1a1c-4328-83b8-d119fc498930 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:33.142055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 574/1162] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:33.147933 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d435fd-1ec7-4859-bab9-6b2d306affc8 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:33.148382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d435fd-1ec7-4859-bab9-6b2d306affc8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:33.148758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d435fd-1ec7-4859-bab9-6b2d306affc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:33.167138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-81d435fd-1ec7-4859-bab9-6b2d306affc8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:33.168311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-81d435fd-1ec7-4859-bab9-6b2d306affc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:33.224093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:33.233126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 589/1163] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:33.256052 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aad0e6-1a1c-4328-83b8-d119fc498930 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:33.355274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aad0e6-1a1c-4328-83b8-d119fc498930 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:33.380101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:33.388700 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8e94d-d7e2-4d1c-9a90-58aefdfaacf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:33.389356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8e94d-d7e2-4d1c-9a90-58aefdfaacf5 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:33.391397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8e94d-d7e2-4d1c-9a90-58aefdfaacf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:33.391397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd8e94d-d7e2-4d1c-9a90-58aefdfaacf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:33.458175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8e94d-d7e2-4d1c-9a90-58aefdfaacf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:33.459626 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd8e94d-d7e2-4d1c-9a90-58aefdfaacf5 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:33.555160 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 575/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:53:33.561276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d435fd-1ec7-4859-bab9-6b2d306affc8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:33.658200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d435fd-1ec7-4859-bab9-6b2d306affc8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:33.691055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e5671-83f2-4c71-ab2e-df2ec5b82611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:33.691833 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e5671-83f2-4c71-ab2e-df2ec5b82611 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:33.692113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e5671-83f2-4c71-ab2e-df2ec5b82611 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:33.692386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e5671-83f2-4c71-ab2e-df2ec5b82611 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:33.699060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e5671-83f2-4c71-ab2e-df2ec5b82611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:33.700486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e5671-83f2-4c71-ab2e-df2ec5b82611 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-9a4e5671-83f2-4c71-ab2e-df2ec5b82611 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:33.714910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:33.716142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:53:33.717060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 590/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 23 12:53:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:33.721851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8e94d-d7e2-4d1c-9a90-58aefdfaacf5 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:33.748966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:33.826409 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd8e94d-d7e2-4d1c-9a90-58aefdfaacf5 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:33.859257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a60660-82c6-4a16-a23c-d9e1a501c9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:33.859924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a60660-82c6-4a16-a23c-d9e1a501c9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:33.860206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a60660-82c6-4a16-a23c-d9e1a501c9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:33.860481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a60660-82c6-4a16-a23c-d9e1a501c9d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:33.861237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a60660-82c6-4a16-a23c-d9e1a501c9d3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:33.861542 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a60660-82c6-4a16-a23c-d9e1a501c9d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:33.862917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a60660-82c6-4a16-a23c-d9e1a501c9d3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:33.870640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 576/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Thu Jun 23 12:53:33 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:35.862795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442680d-347a-4253-9fed-86dd35b8a2ce None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:35.863312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442680d-347a-4253-9fed-86dd35b8a2ce None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:35.863391 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442680d-347a-4253-9fed-86dd35b8a2ce None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:35.864711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 591/1167] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:35.870106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c37a2c-2dfd-44dd-8d9c-1c479057a015 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:35.870530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c37a2c-2dfd-44dd-8d9c-1c479057a015 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:35.870670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c37a2c-2dfd-44dd-8d9c-1c479057a015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:35.887465 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-59c37a2c-2dfd-44dd-8d9c-1c479057a015 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:35.888638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-59c37a2c-2dfd-44dd-8d9c-1c479057a015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:35.952719 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 577/1168] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:35.976548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442680d-347a-4253-9fed-86dd35b8a2ce None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:36.031918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:36.076349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442680d-347a-4253-9fed-86dd35b8a2ce None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:36.108632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b5196-1453-4a35-8fa2-912867ad8bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:36.109313 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b5196-1453-4a35-8fa2-912867ad8bd4 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:36.109600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b5196-1453-4a35-8fa2-912867ad8bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:36.109878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b5196-1453-4a35-8fa2-912867ad8bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:36.110615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b5196-1453-4a35-8fa2-912867ad8bd4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:36.111981 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b5196-1453-4a35-8fa2-912867ad8bd4 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:36.173385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 592/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Thu Jun 23 12:53:35 2022] POST /identity/v3/domains => generated 267 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:53:38.237581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd2fed-f835-4d01-bddf-2238b27a0626 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:38.238146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd2fed-f835-4d01-bddf-2238b27a0626 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:38.238146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd2fed-f835-4d01-bddf-2238b27a0626 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:38.239498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 578/1170] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:38.245551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d6dd1-e354-44ce-921d-6994986c8762 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:38.245991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d6dd1-e354-44ce-921d-6994986c8762 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:38.246119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d6dd1-e354-44ce-921d-6994986c8762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:38.263462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-153d6dd1-e354-44ce-921d-6994986c8762 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:38.264648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-153d6dd1-e354-44ce-921d-6994986c8762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:38.329608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 593/1171] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:38.353314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd2fed-f835-4d01-bddf-2238b27a0626 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:38.374679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:38.450747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd2fed-f835-4d01-bddf-2238b27a0626 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:38.482774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b87abe-d7a8-42d6-8f30-1ba3a17b44f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:38.483868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b87abe-d7a8-42d6-8f30-1ba3a17b44f3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:38.484154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b87abe-d7a8-42d6-8f30-1ba3a17b44f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:38.484425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b87abe-d7a8-42d6-8f30-1ba3a17b44f3 None admin] PATH_INFO: `/v3/domains/3c94ff8fa0004d75a9053eedbf71db90` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:38.495028 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b87abe-d7a8-42d6-8f30-1ba3a17b44f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3c94ff8fa0004d75a9053eedbf71db90)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:38.496406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b87abe-d7a8-42d6-8f30-1ba3a17b44f3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:38.498106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 579/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Jun 23 12:53:38 2022] GET /identity/v3/domains/3c94ff8fa0004d75a9053eedbf71db90 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:38.503813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d6dd1-e354-44ce-921d-6994986c8762 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:38.547672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:38.599075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d6dd1-e354-44ce-921d-6994986c8762 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:38.632967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ff5f4-580a-45ee-a430-a6c2a3f859b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:38.633620 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ff5f4-580a-45ee-a430-a6c2a3f859b9 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:38.633904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ff5f4-580a-45ee-a430-a6c2a3f859b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:38.634181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ff5f4-580a-45ee-a430-a6c2a3f859b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:38.634894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ff5f4-580a-45ee-a430-a6c2a3f859b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:38.636312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ff5f4-580a-45ee-a430-a6c2a3f859b9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:38.765207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 594/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:53:38 2022] POST /identity/v3/projects => generated 361 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 12:53:40.830504 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f1d37-4cd3-4bb7-8752-6bd37cb5b518 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.831057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f1d37-4cd3-4bb7-8752-6bd37cb5b518 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.831057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f1d37-4cd3-4bb7-8752-6bd37cb5b518 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.832423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 580/1174] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:40.837568 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968863cb-fa71-47fc-aeca-1e11de089f7e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:40.838005 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968863cb-fa71-47fc-aeca-1e11de089f7e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:40.838110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968863cb-fa71-47fc-aeca-1e11de089f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:40.854850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-968863cb-fa71-47fc-aeca-1e11de089f7e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:40.856012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-968863cb-fa71-47fc-aeca-1e11de089f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:40.921420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 595/1175] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:40.946397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f1d37-4cd3-4bb7-8752-6bd37cb5b518 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.026775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:41.046055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f1d37-4cd3-4bb7-8752-6bd37cb5b518 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.079338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5ea63-96bd-4a45-83d6-2c0f49110b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.080192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ea63-96bd-4a45-83d6-2c0f49110b46 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.080470 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ea63-96bd-4a45-83d6-2c0f49110b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.080824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5ea63-96bd-4a45-83d6-2c0f49110b46 None admin] PATH_INFO: `/v3/domains/3c94ff8fa0004d75a9053eedbf71db90` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.081936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5ea63-96bd-4a45-83d6-2c0f49110b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3c94ff8fa0004d75a9053eedbf71db90)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:41.083356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5ea63-96bd-4a45-83d6-2c0f49110b46 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:41.085905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 581/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Thu Jun 23 12:53:40 2022] GET /identity/v3/domains/3c94ff8fa0004d75a9053eedbf71db90 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:41.091612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968863cb-fa71-47fc-aeca-1e11de089f7e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:41.118116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:41.189397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968863cb-fa71-47fc-aeca-1e11de089f7e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:41.222253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8bb85-53b6-4e2e-8e02-9bfcf52be321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:41.222915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8bb85-53b6-4e2e-8e02-9bfcf52be321 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:41.223202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8bb85-53b6-4e2e-8e02-9bfcf52be321 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:41.223481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8bb85-53b6-4e2e-8e02-9bfcf52be321 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:41.224199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8bb85-53b6-4e2e-8e02-9bfcf52be321 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:41.226357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8bb85-53b6-4e2e-8e02-9bfcf52be321 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:41.308893 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 596/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:53:41 2022] POST /identity/v3/users => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:53:43.381426 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4afd6-3fd9-491a-9cb1-3764860dcfe2 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.382013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4afd6-3fd9-491a-9cb1-3764860dcfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.382180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4afd6-3fd9-491a-9cb1-3764860dcfe2 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.383559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 582/1178] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:43.388854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da226f-b995-4931-b0b2-f59a40988a1f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.389274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da226f-b995-4931-b0b2-f59a40988a1f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.389422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da226f-b995-4931-b0b2-f59a40988a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.406394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-19da226f-b995-4931-b0b2-f59a40988a1f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:43.407580 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-19da226f-b995-4931-b0b2-f59a40988a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:43.471721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 597/1179] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:43.495710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4afd6-3fd9-491a-9cb1-3764860dcfe2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.595805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4afd6-3fd9-491a-9cb1-3764860dcfe2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:43.628334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af113-77e8-42ff-94dc-d0cc6dc11d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.629124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af113-77e8-42ff-94dc-d0cc6dc11d9d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.629405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af113-77e8-42ff-94dc-d0cc6dc11d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.629677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60af113-77e8-42ff-94dc-d0cc6dc11d9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.640566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60af113-77e8-42ff-94dc-d0cc6dc11d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-d60af113-77e8-42ff-94dc-d0cc6dc11d9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:43.648596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:43.649793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:53:43.651041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 583/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:43.655621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da226f-b995-4931-b0b2-f59a40988a1f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.670294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:43.753030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da226f-b995-4931-b0b2-f59a40988a1f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:43.786351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06060f2-5dbc-469c-9375-ae5dd11115a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.786995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06060f2-5dbc-469c-9375-ae5dd11115a1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.787275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06060f2-5dbc-469c-9375-ae5dd11115a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.787547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06060f2-5dbc-469c-9375-ae5dd11115a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.789263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06060f2-5dbc-469c-9375-ae5dd11115a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:43.789572 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06060f2-5dbc-469c-9375-ae5dd11115a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.790930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06060f2-5dbc-469c-9375-ae5dd11115a1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:43.798607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 598/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:43.804868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af113-77e8-42ff-94dc-d0cc6dc11d9d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:43.816020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:43.906444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60af113-77e8-42ff-94dc-d0cc6dc11d9d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:43.938652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e04a7b-a777-4c34-8396-d6cd85ba1281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:43.939533 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e04a7b-a777-4c34-8396-d6cd85ba1281 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:43.939798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e04a7b-a777-4c34-8396-d6cd85ba1281 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:43.940071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e04a7b-a777-4c34-8396-d6cd85ba1281 None admin] PATH_INFO: `/v3/users/4b68adc05d874e3784b10a2f68b30712` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:43.952906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e04a7b-a777-4c34-8396-d6cd85ba1281 None admin] RBAC: Authorizing `identity:get_user(user_id=4b68adc05d874e3784b10a2f68b30712)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:43.954355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e04a7b-a777-4c34-8396-d6cd85ba1281 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:43.955991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 584/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/users/4b68adc05d874e3784b10a2f68b30712 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:43.962524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06060f2-5dbc-469c-9375-ae5dd11115a1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:44.035612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:44.060347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06060f2-5dbc-469c-9375-ae5dd11115a1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:44.093641 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eb8b2-627c-4e47-b15f-38f0f533d5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:44.094276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eb8b2-627c-4e47-b15f-38f0f533d5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:44.094563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eb8b2-627c-4e47-b15f-38f0f533d5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:44.094840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90eb8b2-627c-4e47-b15f-38f0f533d5b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:44.159791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90eb8b2-627c-4e47-b15f-38f0f533d5b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:44.161192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90eb8b2-627c-4e47-b15f-38f0f533d5b3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:44.232125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:44.255904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 599/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:53:44.263951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e04a7b-a777-4c34-8396-d6cd85ba1281 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:44.327358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:44.360865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e04a7b-a777-4c34-8396-d6cd85ba1281 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:44.393611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4f0ee-622e-4721-b2e0-c55c87fa6cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:44.394482 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f0ee-622e-4721-b2e0-c55c87fa6cfc None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:44.394764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f0ee-622e-4721-b2e0-c55c87fa6cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:44.395038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f0ee-622e-4721-b2e0-c55c87fa6cfc None admin] PATH_INFO: `/v3/projects/c8a6d9e21e9a49c5814992a82d41dc30` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:44.396203 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4f0ee-622e-4721-b2e0-c55c87fa6cfc None admin] RBAC: Authorizing `identity:get_project(project_id=c8a6d9e21e9a49c5814992a82d41dc30)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:44.398290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4f0ee-622e-4721-b2e0-c55c87fa6cfc None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:44.399962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 585/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:44 2022] GET /identity/v3/projects/c8a6d9e21e9a49c5814992a82d41dc30 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:44.405997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eb8b2-627c-4e47-b15f-38f0f533d5b3 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:44.500000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90eb8b2-627c-4e47-b15f-38f0f533d5b3 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:44.532556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6f2c1-454c-48f0-af5f-7ad5a7c90b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:44.533222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6f2c1-454c-48f0-af5f-7ad5a7c90b53 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:44.533507 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6f2c1-454c-48f0-af5f-7ad5a7c90b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:44.533782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6f2c1-454c-48f0-af5f-7ad5a7c90b53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:44.534602 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6f2c1-454c-48f0-af5f-7ad5a7c90b53 None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=c8a6d9e21e9a49c5814992a82d41dc30, user.id=4b68adc05d874e3784b10a2f68b30712) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:44.534910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6f2c1-454c-48f0-af5f-7ad5a7c90b53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:44.536318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6f2c1-454c-48f0-af5f-7ad5a7c90b53 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:44.542184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 600/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:44 2022] GET /identity/v3/role_assignments?user.id=4b68adc05d874e3784b10a2f68b30712&scope.project.id=c8a6d9e21e9a49c5814992a82d41dc30&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:46.538290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabb045-6a82-4e81-abfe-499c6334dea2 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.538820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabb045-6a82-4e81-abfe-499c6334dea2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.538926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabb045-6a82-4e81-abfe-499c6334dea2 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.540224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 586/1186] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:46.545505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d56c44-6264-4a73-8a36-1620ee8032d7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.545902 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d56c44-6264-4a73-8a36-1620ee8032d7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.546052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d56c44-6264-4a73-8a36-1620ee8032d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.562917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a7d56c44-6264-4a73-8a36-1620ee8032d7 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:46.564077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a7d56c44-6264-4a73-8a36-1620ee8032d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:46.591967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:46.627784 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 601/1187] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:46.650544 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabb045-6a82-4e81-abfe-499c6334dea2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:46.750278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabb045-6a82-4e81-abfe-499c6334dea2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:46.783119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861a36c-dc6f-4057-b270-4f4a8699ba63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:46.783904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861a36c-dc6f-4057-b270-4f4a8699ba63 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.784189 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861a36c-dc6f-4057-b270-4f4a8699ba63 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.784468 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9861a36c-dc6f-4057-b270-4f4a8699ba63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.787149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:46.795810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9861a36c-dc6f-4057-b270-4f4a8699ba63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-9861a36c-dc6f-4057-b270-4f4a8699ba63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:46.804223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:46.805335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:53:46.806364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 587/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:46.811643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d56c44-6264-4a73-8a36-1620ee8032d7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:46.909744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d56c44-6264-4a73-8a36-1620ee8032d7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:46.942071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab163a-f1bc-49b6-ae26-4bc3af8351a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:46.942725 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab163a-f1bc-49b6-ae26-4bc3af8351a5 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:46.943007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab163a-f1bc-49b6-ae26-4bc3af8351a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:46.943283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab163a-f1bc-49b6-ae26-4bc3af8351a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:46.944022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab163a-f1bc-49b6-ae26-4bc3af8351a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:46.944427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab163a-f1bc-49b6-ae26-4bc3af8351a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:46.945814 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab163a-f1bc-49b6-ae26-4bc3af8351a5 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:46.953505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 602/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:46.959175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861a36c-dc6f-4057-b270-4f4a8699ba63 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.056867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9861a36c-dc6f-4057-b270-4f4a8699ba63 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.089348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11934cbb-8144-424e-9208-087f3aa21929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.090200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11934cbb-8144-424e-9208-087f3aa21929 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.090485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11934cbb-8144-424e-9208-087f3aa21929 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.090764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11934cbb-8144-424e-9208-087f3aa21929 None admin] PATH_INFO: `/v3/users/4b68adc05d874e3784b10a2f68b30712` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.091940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11934cbb-8144-424e-9208-087f3aa21929 None admin] RBAC: Authorizing `identity:get_user(user_id=4b68adc05d874e3784b10a2f68b30712)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:47.093402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11934cbb-8144-424e-9208-087f3aa21929 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.095001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 588/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:46 2022] GET /identity/v3/users/4b68adc05d874e3784b10a2f68b30712 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:47.100665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab163a-f1bc-49b6-ae26-4bc3af8351a5 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.130539 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:47.197868 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab163a-f1bc-49b6-ae26-4bc3af8351a5 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.230273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081dad3-9be8-4331-a62b-2722cc00e773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.231120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081dad3-9be8-4331-a62b-2722cc00e773 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.231403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081dad3-9be8-4331-a62b-2722cc00e773 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.231679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081dad3-9be8-4331-a62b-2722cc00e773 None admin] PATH_INFO: `/v3/projects/c8a6d9e21e9a49c5814992a82d41dc30` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.232860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081dad3-9be8-4331-a62b-2722cc00e773 None admin] RBAC: Authorizing `identity:get_project(project_id=c8a6d9e21e9a49c5814992a82d41dc30)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:47.234276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081dad3-9be8-4331-a62b-2722cc00e773 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.235938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 603/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:47 2022] GET /identity/v3/projects/c8a6d9e21e9a49c5814992a82d41dc30 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:47.242655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11934cbb-8144-424e-9208-087f3aa21929 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:47.302642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:47.340218 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11934cbb-8144-424e-9208-087f3aa21929 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:47.372848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b345c2-b5f1-4a44-ab00-6e8c24ad81a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:47.373709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b345c2-b5f1-4a44-ab00-6e8c24ad81a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:47.373989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b345c2-b5f1-4a44-ab00-6e8c24ad81a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:47.374262 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b345c2-b5f1-4a44-ab00-6e8c24ad81a1 None admin] PATH_INFO: `/v3/projects/c8a6d9e21e9a49c5814992a82d41dc30/users/4b68adc05d874e3784b10a2f68b30712/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:47.376176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b345c2-b5f1-4a44-ab00-6e8c24ad81a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8a6d9e21e9a49c5814992a82d41dc30, user_id=4b68adc05d874e3784b10a2f68b30712, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:47.377625 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b345c2-b5f1-4a44-ab00-6e8c24ad81a1 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:47.466163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 589/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:53:47 2022] PUT /identity/v3/projects/c8a6d9e21e9a49c5814992a82d41dc30/users/4b68adc05d874e3784b10a2f68b30712/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 12:53:49.496687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0474f0b-f7dc-4eff-8ce0-240eda333248 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.497270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0474f0b-f7dc-4eff-8ce0-240eda333248 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.497270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0474f0b-f7dc-4eff-8ce0-240eda333248 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.498635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 604/1193] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:53:49.503732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dccd32-1933-4842-94ff-43ec02b336bf None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.504126 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dccd32-1933-4842-94ff-43ec02b336bf None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.504285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dccd32-1933-4842-94ff-43ec02b336bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.521960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-42dccd32-1933-4842-94ff-43ec02b336bf None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:53:49.523130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-42dccd32-1933-4842-94ff-43ec02b336bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:53:49.587679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 590/1194] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:53:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:53:49.611493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0474f0b-f7dc-4eff-8ce0-240eda333248 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:49.704926 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:49.709929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0474f0b-f7dc-4eff-8ce0-240eda333248 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.741964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235057-3524-4108-80a5-49353add2679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.742744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235057-3524-4108-80a5-49353add2679 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.743024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235057-3524-4108-80a5-49353add2679 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.743298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e235057-3524-4108-80a5-49353add2679 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.753061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e235057-3524-4108-80a5-49353add2679 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-0e235057-3524-4108-80a5-49353add2679 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:53:49.761121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:53:49.762907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:53:49.763778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 605/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:53:49.768450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dccd32-1933-4842-94ff-43ec02b336bf None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:49.820471 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:49.869572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dccd32-1933-4842-94ff-43ec02b336bf None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:49.904742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d3e12-9fd4-4e2b-9206-b8476342df0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:49.905434 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d3e12-9fd4-4e2b-9206-b8476342df0d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:49.905724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d3e12-9fd4-4e2b-9206-b8476342df0d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:49.906001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d3e12-9fd4-4e2b-9206-b8476342df0d None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:49.906748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d3e12-9fd4-4e2b-9206-b8476342df0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:49.907055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d3e12-9fd4-4e2b-9206-b8476342df0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:49.908427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d3e12-9fd4-4e2b-9206-b8476342df0d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:49.916319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 591/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:49.922089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235057-3524-4108-80a5-49353add2679 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.019303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e235057-3524-4108-80a5-49353add2679 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:50.050643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc42e6f-3b9f-4887-a289-c2730e1cfc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:50.051498 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc42e6f-3b9f-4887-a289-c2730e1cfc4b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.051781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc42e6f-3b9f-4887-a289-c2730e1cfc4b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.052055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc42e6f-3b9f-4887-a289-c2730e1cfc4b None admin] PATH_INFO: `/v3/users/4b68adc05d874e3784b10a2f68b30712` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.054102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc42e6f-3b9f-4887-a289-c2730e1cfc4b None admin] RBAC: Authorizing `identity:get_user(user_id=4b68adc05d874e3784b10a2f68b30712)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:50.055627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc42e6f-3b9f-4887-a289-c2730e1cfc4b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:50.057262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 606/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Thu Jun 23 12:53:49 2022] GET /identity/v3/users/4b68adc05d874e3784b10a2f68b30712 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:50.062875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d3e12-9fd4-4e2b-9206-b8476342df0d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.171838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d3e12-9fd4-4e2b-9206-b8476342df0d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:50.185382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:50.205155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c9e95-97de-4928-a9b6-6806561076ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:50.205795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c9e95-97de-4928-a9b6-6806561076ac None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.206078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c9e95-97de-4928-a9b6-6806561076ac None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.206355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c9e95-97de-4928-a9b6-6806561076ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.271359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c9e95-97de-4928-a9b6-6806561076ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:50.272893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c9e95-97de-4928-a9b6-6806561076ac None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:50.366379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 592/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:53:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:53:50.372375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc42e6f-3b9f-4887-a289-c2730e1cfc4b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.400444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:50.480208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc42e6f-3b9f-4887-a289-c2730e1cfc4b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:50.514234 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2753f-f05c-4b62-a2d8-7ac94fc9d28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:50.515091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2753f-f05c-4b62-a2d8-7ac94fc9d28d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.515374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2753f-f05c-4b62-a2d8-7ac94fc9d28d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.515649 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2753f-f05c-4b62-a2d8-7ac94fc9d28d None admin] PATH_INFO: `/v3/projects/c8a6d9e21e9a49c5814992a82d41dc30` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.516836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2753f-f05c-4b62-a2d8-7ac94fc9d28d None admin] RBAC: Authorizing `identity:get_project(project_id=c8a6d9e21e9a49c5814992a82d41dc30)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:50.518267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2753f-f05c-4b62-a2d8-7ac94fc9d28d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:50.519961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 607/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Thu Jun 23 12:53:50 2022] GET /identity/v3/projects/c8a6d9e21e9a49c5814992a82d41dc30 => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:53:50.526925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c9e95-97de-4928-a9b6-6806561076ac None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:53:50.541436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:53:50.623192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c9e95-97de-4928-a9b6-6806561076ac None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:53:50.655831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c552012-2d97-4ae3-8ae3-16f33c406f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:53:50.656464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552012-2d97-4ae3-8ae3-16f33c406f6b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:53:50.656742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552012-2d97-4ae3-8ae3-16f33c406f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:53:50.657041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c552012-2d97-4ae3-8ae3-16f33c406f6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:53:50.657863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552012-2d97-4ae3-8ae3-16f33c406f6b None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=c8a6d9e21e9a49c5814992a82d41dc30, user.id=4b68adc05d874e3784b10a2f68b30712) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:53:50.658169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552012-2d97-4ae3-8ae3-16f33c406f6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:53:50.659611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c552012-2d97-4ae3-8ae3-16f33c406f6b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:53:50.665271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 593/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:53:50 2022] GET /identity/v3/role_assignments?user.id=4b68adc05d874e3784b10a2f68b30712&scope.project.id=c8a6d9e21e9a49c5814992a82d41dc30&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:54:00.509738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=53 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:54:00.662666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=61 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:04.693385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee0998-c705-4d9e-82bd-91e055620aa7 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:04.693974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee0998-c705-4d9e-82bd-91e055620aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:04.693974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee0998-c705-4d9e-82bd-91e055620aa7 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:04.695321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 608/1201] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:04.700520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532338b9-20bb-4632-8724-baab434270bf None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:04.700959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532338b9-20bb-4632-8724-baab434270bf None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:04.701092 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532338b9-20bb-4632-8724-baab434270bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:04.718600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-532338b9-20bb-4632-8724-baab434270bf None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:04.720405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-532338b9-20bb-4632-8724-baab434270bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:04.789336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 594/1202] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:04.814063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee0998-c705-4d9e-82bd-91e055620aa7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:04.916537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee0998-c705-4d9e-82bd-91e055620aa7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:04.950015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b62fd0-0d5b-4213-af1e-ac6cb8454ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:04.950747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b62fd0-0d5b-4213-af1e-ac6cb8454ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:04.951033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b62fd0-0d5b-4213-af1e-ac6cb8454ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:04.951311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b62fd0-0d5b-4213-af1e-ac6cb8454ae1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:04.961092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b62fd0-0d5b-4213-af1e-ac6cb8454ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:04.962521 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b62fd0-0d5b-4213-af1e-ac6cb8454ae1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-d2b62fd0-0d5b-4213-af1e-ac6cb8454ae1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:04.979730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:04.980979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:04.982167 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:04.982167 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:04.982167 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:04.982167 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:04.982167 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 609/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:04.987506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532338b9-20bb-4632-8724-baab434270bf None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:05.089233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532338b9-20bb-4632-8724-baab434270bf None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:05.120128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:05.126437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bdb7e-6258-4e27-9faa-48ac31f1db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:05.127096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bdb7e-6258-4e27-9faa-48ac31f1db7b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:05.127380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bdb7e-6258-4e27-9faa-48ac31f1db7b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:05.127659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bdb7e-6258-4e27-9faa-48ac31f1db7b None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:05.128391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bdb7e-6258-4e27-9faa-48ac31f1db7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:05.128697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bdb7e-6258-4e27-9faa-48ac31f1db7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:05.130112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0bdb7e-6258-4e27-9faa-48ac31f1db7b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:05.141523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 595/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:05.147577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b62fd0-0d5b-4213-af1e-ac6cb8454ae1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:05.200553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:05.246183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b62fd0-0d5b-4213-af1e-ac6cb8454ae1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:05.282611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6962bd4-cebc-4704-b760-702a5ad94ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:05.283280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6962bd4-cebc-4704-b760-702a5ad94ebb None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:05.283565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6962bd4-cebc-4704-b760-702a5ad94ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:05.283868 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6962bd4-cebc-4704-b760-702a5ad94ebb None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:05.284585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6962bd4-cebc-4704-b760-702a5ad94ebb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:05.286048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6962bd4-cebc-4704-b760-702a5ad94ebb None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:05.353152 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 610/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Thu Jun 23 12:55:05 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:55:07.465156 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b31b1-008e-45b4-aa27-f1a4d458e9d0 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:07.465710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b31b1-008e-45b4-aa27-f1a4d458e9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:07.465710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b31b1-008e-45b4-aa27-f1a4d458e9d0 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:07.467080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 596/1206] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:07.472497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4ed4-666d-40b1-a684-94fb3327bc25 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:07.472934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4ed4-666d-40b1-a684-94fb3327bc25 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:07.473097 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e4ed4-666d-40b1-a684-94fb3327bc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:07.492935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-082e4ed4-666d-40b1-a684-94fb3327bc25 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:07.494146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-082e4ed4-666d-40b1-a684-94fb3327bc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:07.561604 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 611/1207] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:07.584748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b31b1-008e-45b4-aa27-f1a4d458e9d0 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:07.687066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b31b1-008e-45b4-aa27-f1a4d458e9d0 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:07.722200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa7dd4-a63c-495f-950a-5cd4d548040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:07.722941 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa7dd4-a63c-495f-950a-5cd4d548040a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:07.723231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa7dd4-a63c-495f-950a-5cd4d548040a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:07.723509 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa7dd4-a63c-495f-950a-5cd4d548040a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:07.733587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa7dd4-a63c-495f-950a-5cd4d548040a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-7aaa7dd4-a63c-495f-950a-5cd4d548040a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:55:07.741781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:07.742931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:07.744191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 597/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:55:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:07.749073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e4ed4-666d-40b1-a684-94fb3327bc25 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:07.788221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:07.848411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e4ed4-666d-40b1-a684-94fb3327bc25 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:07.882353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407db02-93a5-4b0f-b037-f37ceca7cfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:07.883030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407db02-93a5-4b0f-b037-f37ceca7cfd8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:07.883318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407db02-93a5-4b0f-b037-f37ceca7cfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:07.883665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407db02-93a5-4b0f-b037-f37ceca7cfd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:07.884680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407db02-93a5-4b0f-b037-f37ceca7cfd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:07.885033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407db02-93a5-4b0f-b037-f37ceca7cfd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:07.886406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407db02-93a5-4b0f-b037-f37ceca7cfd8 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:07.894684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 612/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:55:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:07.900336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa7dd4-a63c-495f-950a-5cd4d548040a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:07.948930 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:07.996980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa7dd4-a63c-495f-950a-5cd4d548040a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:08.030423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a6510-9a3d-43db-ab60-61fd084af0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:08.031211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a6510-9a3d-43db-ab60-61fd084af0cd None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:08.031578 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a6510-9a3d-43db-ab60-61fd084af0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:08.032393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a6510-9a3d-43db-ab60-61fd084af0cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:08.042823 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a6510-9a3d-43db-ab60-61fd084af0cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:08.044272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a6510-9a3d-43db-ab60-61fd084af0cd None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-cd6a6510-9a3d-43db-ab60-61fd084af0cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:08.061007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:08.063431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:08.064545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:08.064545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:08.064545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:08.064545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:08.064545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 598/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:08.068166 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407db02-93a5-4b0f-b037-f37ceca7cfd8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:08.168243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407db02-93a5-4b0f-b037-f37ceca7cfd8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:08.199966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec74965-1baa-4227-8cba-72d47ba8ba4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:08.200625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec74965-1baa-4227-8cba-72d47ba8ba4a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:08.200941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec74965-1baa-4227-8cba-72d47ba8ba4a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:08.201221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec74965-1baa-4227-8cba-72d47ba8ba4a None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:08.202010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec74965-1baa-4227-8cba-72d47ba8ba4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:08.202249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec74965-1baa-4227-8cba-72d47ba8ba4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:08.204155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec74965-1baa-4227-8cba-72d47ba8ba4a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:08.218313 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 613/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:08.224738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a6510-9a3d-43db-ab60-61fd084af0cd None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:08.245198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:08.326311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a6510-9a3d-43db-ab60-61fd084af0cd None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:08.327735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:08.360496 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac28897-544a-4874-8591-e791cc685c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:08.361325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac28897-544a-4874-8591-e791cc685c21 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:08.361606 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac28897-544a-4874-8591-e791cc685c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:08.361881 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac28897-544a-4874-8591-e791cc685c21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:08.368760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac28897-544a-4874-8591-e791cc685c21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:08.370338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac28897-544a-4874-8591-e791cc685c21 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-aac28897-544a-4874-8591-e791cc685c21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:55:08.386373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:08.387609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:08.388765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:08.388765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:08.388765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:55:08.388765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:55:08.388765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:55:08.388765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:55:08.388765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:55:08.388765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:55:08.388765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:55:08.388765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:08.388765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 599/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:08.394001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec74965-1baa-4227-8cba-72d47ba8ba4a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:08.497764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec74965-1baa-4227-8cba-72d47ba8ba4a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:08.531874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677a6aa-fcde-4b57-ab06-daf31183330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:08.532586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677a6aa-fcde-4b57-ab06-daf31183330b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:08.532899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677a6aa-fcde-4b57-ab06-daf31183330b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:08.533181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677a6aa-fcde-4b57-ab06-daf31183330b None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:08.534021 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677a6aa-fcde-4b57-ab06-daf31183330b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:08.534333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677a6aa-fcde-4b57-ab06-daf31183330b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:08.535769 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677a6aa-fcde-4b57-ab06-daf31183330b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:08.552492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 614/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jun 23 12:55:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:08.558283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac28897-544a-4874-8591-e791cc685c21 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:08.661810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac28897-544a-4874-8591-e791cc685c21 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:08.695661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f3666-9b6b-49aa-b08d-204914e1de50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:08.696302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f3666-9b6b-49aa-b08d-204914e1de50 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:08.696578 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f3666-9b6b-49aa-b08d-204914e1de50 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:08.696873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f3666-9b6b-49aa-b08d-204914e1de50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:08.725543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:08.765272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f3666-9b6b-49aa-b08d-204914e1de50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:08.766845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f3666-9b6b-49aa-b08d-204914e1de50 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:08.861793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 600/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:55:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:55:08.867773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677a6aa-fcde-4b57-ab06-daf31183330b None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:08.887875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:08.967359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677a6aa-fcde-4b57-ab06-daf31183330b None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:09.002648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaf9cf-53ff-4ca2-9d52-7f8b9aa60fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:09.003433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaf9cf-53ff-4ca2-9d52-7f8b9aa60fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:09.003824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaf9cf-53ff-4ca2-9d52-7f8b9aa60fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:09.004092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaf9cf-53ff-4ca2-9d52-7f8b9aa60fc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:09.014251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaf9cf-53ff-4ca2-9d52-7f8b9aa60fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:09.015774 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaf9cf-53ff-4ca2-9d52-7f8b9aa60fc1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-9fcaf9cf-53ff-4ca2-9d52-7f8b9aa60fc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:09.033732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:09.034850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:09.035869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:09.035869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:09.035869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:09.035869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:09.035869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 615/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:09.040635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f3666-9b6b-49aa-b08d-204914e1de50 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:09.103783 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:09.142667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f3666-9b6b-49aa-b08d-204914e1de50 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:09.175443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14efc9-48ae-44fb-9565-ad939087fe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:09.176094 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14efc9-48ae-44fb-9565-ad939087fe7f None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:09.176374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14efc9-48ae-44fb-9565-ad939087fe7f None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:09.176647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14efc9-48ae-44fb-9565-ad939087fe7f None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:09.177389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14efc9-48ae-44fb-9565-ad939087fe7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:09.177754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14efc9-48ae-44fb-9565-ad939087fe7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:09.179117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c14efc9-48ae-44fb-9565-ad939087fe7f None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:09.190987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 601/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:09.196717 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaf9cf-53ff-4ca2-9d52-7f8b9aa60fc1 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:09.265211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:09.295042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaf9cf-53ff-4ca2-9d52-7f8b9aa60fc1 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:09.329256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b080d3d-e28d-4a9b-9812-0bf5d81b97d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:09.330045 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b080d3d-e28d-4a9b-9812-0bf5d81b97d7 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:09.330327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b080d3d-e28d-4a9b-9812-0bf5d81b97d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:09.330603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b080d3d-e28d-4a9b-9812-0bf5d81b97d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:09.337155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b080d3d-e28d-4a9b-9812-0bf5d81b97d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:09.338624 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b080d3d-e28d-4a9b-9812-0bf5d81b97d7 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-2b080d3d-e28d-4a9b-9812-0bf5d81b97d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:55:09.352786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:09.353919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:09.355264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:55:09.355264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:55:09.355264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:55:09.355264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:55:09.355264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:55:09.355264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:55:09.355264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:55:09.355264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:09.355264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 616/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:55:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:09.360710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14efc9-48ae-44fb-9565-ad939087fe7f None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:09.463371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14efc9-48ae-44fb-9565-ad939087fe7f None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:09.487196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:09.498526 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895964ea-33d9-4603-a573-b8133e7fbfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:09.499178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895964ea-33d9-4603-a573-b8133e7fbfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:09.504157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895964ea-33d9-4603-a573-b8133e7fbfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:09.504157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895964ea-33d9-4603-a573-b8133e7fbfe8 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:09.504157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895964ea-33d9-4603-a573-b8133e7fbfe8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:09.504157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895964ea-33d9-4603-a573-b8133e7fbfe8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:09.504157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895964ea-33d9-4603-a573-b8133e7fbfe8 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:09.514190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 602/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:55:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:09.521349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b080d3d-e28d-4a9b-9812-0bf5d81b97d7 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:09.622280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b080d3d-e28d-4a9b-9812-0bf5d81b97d7 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:09.650013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:09.655406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6092055-48bf-4353-8f7a-dfa503e7cf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:09.656054 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6092055-48bf-4353-8f7a-dfa503e7cf1d None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:09.656487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6092055-48bf-4353-8f7a-dfa503e7cf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:09.656698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6092055-48bf-4353-8f7a-dfa503e7cf1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:09.657735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6092055-48bf-4353-8f7a-dfa503e7cf1d None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=69b5745bfb5d4e6ca172bb8fab229e58) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:09.657928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6092055-48bf-4353-8f7a-dfa503e7cf1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:09.659349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6092055-48bf-4353-8f7a-dfa503e7cf1d None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:09.664848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 617/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:55:09 2022] GET /identity/v3/role_assignments?user.id=69b5745bfb5d4e6ca172bb8fab229e58&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:11.686302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99564fc7-08c7-4739-b40d-5ba5eae7b03e None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:11.686866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99564fc7-08c7-4739-b40d-5ba5eae7b03e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:11.686866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99564fc7-08c7-4739-b40d-5ba5eae7b03e None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:11.688367 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 603/1220] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:11.693538 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7da794-38fb-49e9-967b-14e35f1a15d6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:11.693966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7da794-38fb-49e9-967b-14e35f1a15d6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:11.694098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7da794-38fb-49e9-967b-14e35f1a15d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:11.711079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0e7da794-38fb-49e9-967b-14e35f1a15d6 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:11.712250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0e7da794-38fb-49e9-967b-14e35f1a15d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:11.777227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 618/1221] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:11.800779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99564fc7-08c7-4739-b40d-5ba5eae7b03e None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:11.903769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99564fc7-08c7-4739-b40d-5ba5eae7b03e None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:11.937062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16953e5c-f8c0-4aaf-87af-8d11e3add461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:11.938005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16953e5c-f8c0-4aaf-87af-8d11e3add461 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:11.938145 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16953e5c-f8c0-4aaf-87af-8d11e3add461 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:11.938364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16953e5c-f8c0-4aaf-87af-8d11e3add461 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:11.948292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16953e5c-f8c0-4aaf-87af-8d11e3add461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-16953e5c-f8c0-4aaf-87af-8d11e3add461 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:55:11.956461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:11.957637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:11.958946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 604/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:55:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:11.963766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7da794-38fb-49e9-967b-14e35f1a15d6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:12.064129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7da794-38fb-49e9-967b-14e35f1a15d6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:12.089540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:12.100345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3e44b-1a3c-49f4-85d4-7c081101fb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:12.101049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3e44b-1a3c-49f4-85d4-7c081101fb5f None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:12.101332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3e44b-1a3c-49f4-85d4-7c081101fb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:12.101608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3e44b-1a3c-49f4-85d4-7c081101fb5f None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:12.102356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3e44b-1a3c-49f4-85d4-7c081101fb5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:12.102665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3e44b-1a3c-49f4-85d4-7c081101fb5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:12.104027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3e44b-1a3c-49f4-85d4-7c081101fb5f None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:12.112331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 619/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:55:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:12.118215 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16953e5c-f8c0-4aaf-87af-8d11e3add461 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:12.162765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:12.219376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16953e5c-f8c0-4aaf-87af-8d11e3add461 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:12.254315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163172b5-866d-4b24-83fa-84721d157f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:12.255110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163172b5-866d-4b24-83fa-84721d157f67 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:12.255389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163172b5-866d-4b24-83fa-84721d157f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:12.255660 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163172b5-866d-4b24-83fa-84721d157f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:12.266448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163172b5-866d-4b24-83fa-84721d157f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:12.267899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163172b5-866d-4b24-83fa-84721d157f67 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-163172b5-866d-4b24-83fa-84721d157f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:12.285253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:12.286257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:12.287162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:12.287162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:12.287162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:12.287162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:12.287162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 605/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:12.292589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3e44b-1a3c-49f4-85d4-7c081101fb5f None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:12.391162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3e44b-1a3c-49f4-85d4-7c081101fb5f None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:12.423415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408036-15d1-4af2-878c-771eae48ffe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:12.424063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408036-15d1-4af2-878c-771eae48ffe6 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:12.424343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408036-15d1-4af2-878c-771eae48ffe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:12.424615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70408036-15d1-4af2-878c-771eae48ffe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:12.425359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408036-15d1-4af2-878c-771eae48ffe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:12.425663 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408036-15d1-4af2-878c-771eae48ffe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:12.427037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70408036-15d1-4af2-878c-771eae48ffe6 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:12.439155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 620/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:12.445027 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163172b5-866d-4b24-83fa-84721d157f67 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:12.537987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:12.544477 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163172b5-866d-4b24-83fa-84721d157f67 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:12.576778 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f658c9-c4fc-40db-b5f9-0a46cee0c871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:12.577596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f658c9-c4fc-40db-b5f9-0a46cee0c871 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:12.577882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f658c9-c4fc-40db-b5f9-0a46cee0c871 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:12.578687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f658c9-c4fc-40db-b5f9-0a46cee0c871 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:12.585584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f658c9-c4fc-40db-b5f9-0a46cee0c871 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:12.587034 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f658c9-c4fc-40db-b5f9-0a46cee0c871 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-b8f658c9-c4fc-40db-b5f9-0a46cee0c871 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:55:12.602669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:12.603885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:12.605278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:12.605278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:12.605278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:55:12.605278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:55:12.605278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:55:12.605278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:55:12.605278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:55:12.605278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:55:12.605278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:55:12.605278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:12.605278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 606/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:12.609972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408036-15d1-4af2-878c-771eae48ffe6 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:12.656148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:12.708417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70408036-15d1-4af2-878c-771eae48ffe6 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:12.741697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026bc33-0b05-4bf1-8613-2535ee291892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:12.742365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026bc33-0b05-4bf1-8613-2535ee291892 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:12.742649 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026bc33-0b05-4bf1-8613-2535ee291892 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:12.742927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c026bc33-0b05-4bf1-8613-2535ee291892 None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:12.743816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026bc33-0b05-4bf1-8613-2535ee291892 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:12.744405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026bc33-0b05-4bf1-8613-2535ee291892 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:12.746207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c026bc33-0b05-4bf1-8613-2535ee291892 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:12.765187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 621/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jun 23 12:55:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:12.771168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f658c9-c4fc-40db-b5f9-0a46cee0c871 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:12.872080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f658c9-c4fc-40db-b5f9-0a46cee0c871 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:12.905914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9531a-fa3b-481d-981e-8db6db2fd028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:12.907651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9531a-fa3b-481d-981e-8db6db2fd028 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:12.907930 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9531a-fa3b-481d-981e-8db6db2fd028 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:12.908201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9531a-fa3b-481d-981e-8db6db2fd028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:12.917847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9531a-fa3b-481d-981e-8db6db2fd028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:12.919277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9531a-fa3b-481d-981e-8db6db2fd028 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-aca9531a-fa3b-481d-981e-8db6db2fd028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:12.937376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:12.943115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:12.944257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:12.944257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:12.944257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:12.944257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:12.944257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 607/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:12.944814 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026bc33-0b05-4bf1-8613-2535ee291892 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:13.041285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c026bc33-0b05-4bf1-8613-2535ee291892 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:13.043514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:13.075155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a756029-cea2-4d35-b759-b90ab8942e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:13.075998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a756029-cea2-4d35-b759-b90ab8942e80 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:13.076502 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a756029-cea2-4d35-b759-b90ab8942e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:13.077187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a756029-cea2-4d35-b759-b90ab8942e80 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:13.077918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a756029-cea2-4d35-b759-b90ab8942e80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:13.078543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a756029-cea2-4d35-b759-b90ab8942e80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:13.079896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a756029-cea2-4d35-b759-b90ab8942e80 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:13.090986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 622/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:13.097253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9531a-fa3b-481d-981e-8db6db2fd028 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:13.106083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:13.197442 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9531a-fa3b-481d-981e-8db6db2fd028 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:13.232082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163d08c-4d68-41b0-83ea-7c88aeadf814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:13.232897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163d08c-4d68-41b0-83ea-7c88aeadf814 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:13.233186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163d08c-4d68-41b0-83ea-7c88aeadf814 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:13.233471 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163d08c-4d68-41b0-83ea-7c88aeadf814 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:13.240200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163d08c-4d68-41b0-83ea-7c88aeadf814 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:13.241669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b163d08c-4d68-41b0-83ea-7c88aeadf814 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-b163d08c-4d68-41b0-83ea-7c88aeadf814 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:55:13.255959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:13.257046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:13.258289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:55:13.258289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:55:13.258289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:55:13.258289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:55:13.258289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:55:13.258289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:55:13.258289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:55:13.258289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:13.258289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 608/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:55:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:13.263272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a756029-cea2-4d35-b759-b90ab8942e80 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:13.362279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a756029-cea2-4d35-b759-b90ab8942e80 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:13.395564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55151f10-aee6-42cf-948e-57465794b13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:13.396221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55151f10-aee6-42cf-948e-57465794b13b None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:13.396508 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55151f10-aee6-42cf-948e-57465794b13b None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:13.396786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55151f10-aee6-42cf-948e-57465794b13b None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:13.397640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55151f10-aee6-42cf-948e-57465794b13b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:13.403264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55151f10-aee6-42cf-948e-57465794b13b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:13.403264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55151f10-aee6-42cf-948e-57465794b13b None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:13.411641 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 623/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:55:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:13.417699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163d08c-4d68-41b0-83ea-7c88aeadf814 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:13.482506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:13.517936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163d08c-4d68-41b0-83ea-7c88aeadf814 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:13.551645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471da3ca-2913-4265-bd0d-dde837ab659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:13.552591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da3ca-2913-4265-bd0d-dde837ab659b None admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:13.552901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da3ca-2913-4265-bd0d-dde837ab659b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:13.553178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471da3ca-2913-4265-bd0d-dde837ab659b None admin] PATH_INFO: `/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/69b5745bfb5d4e6ca172bb8fab229e58/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:13.571923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471da3ca-2913-4265-bd0d-dde837ab659b None admin] RBAC: Authorizing `identity:create_grant(project_id=66de76d7ea7a45a6b698f8b1295c66c3, user_id=69b5745bfb5d4e6ca172bb8fab229e58, role_id=66cfaff0c6ec455aa7274a8b8d1f8aaf)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:13.573398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471da3ca-2913-4265-bd0d-dde837ab659b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:13.736201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 609/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:55:13 2022] PUT /identity/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/69b5745bfb5d4e6ca172bb8fab229e58/roles/66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:55:15.792814 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039120b7-b971-43e2-8311-d616beb25bb8 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:15.793369 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039120b7-b971-43e2-8311-d616beb25bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:15.793369 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039120b7-b971-43e2-8311-d616beb25bb8 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:15.794795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 624/1233] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:15.800858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c476430-f0c8-4fcc-9281-0da45b0f0022 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:15.801279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c476430-f0c8-4fcc-9281-0da45b0f0022 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:15.801368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c476430-f0c8-4fcc-9281-0da45b0f0022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:15.817877 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-1c476430-f0c8-4fcc-9281-0da45b0f0022 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:15.819090 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1c476430-f0c8-4fcc-9281-0da45b0f0022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:15.886424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 610/1234] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:15.910146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039120b7-b971-43e2-8311-d616beb25bb8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:15.935076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:16.008453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039120b7-b971-43e2-8311-d616beb25bb8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:16.043297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76ab39-ce7c-4657-9fac-b20be4541fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:16.044017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76ab39-ce7c-4657-9fac-b20be4541fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:16.044299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76ab39-ce7c-4657-9fac-b20be4541fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:16.044574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76ab39-ce7c-4657-9fac-b20be4541fc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:16.055530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76ab39-ce7c-4657-9fac-b20be4541fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-6e76ab39-ce7c-4657-9fac-b20be4541fc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:55:16.063752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:16.064899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:16.066107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 625/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Thu Jun 23 12:55:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:16.070915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c476430-f0c8-4fcc-9281-0da45b0f0022 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:16.117980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:16.173143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c476430-f0c8-4fcc-9281-0da45b0f0022 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:16.207371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184d2e1-19b0-4807-bf80-1d1cf5e034b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:16.208035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184d2e1-19b0-4807-bf80-1d1cf5e034b0 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:16.208317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184d2e1-19b0-4807-bf80-1d1cf5e034b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:16.208593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184d2e1-19b0-4807-bf80-1d1cf5e034b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:16.209453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184d2e1-19b0-4807-bf80-1d1cf5e034b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:16.209753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184d2e1-19b0-4807-bf80-1d1cf5e034b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:16.211144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184d2e1-19b0-4807-bf80-1d1cf5e034b0 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:16.219872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 611/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Thu Jun 23 12:55:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:16.225654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76ab39-ce7c-4657-9fac-b20be4541fc4 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:16.318361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:16.333706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76ab39-ce7c-4657-9fac-b20be4541fc4 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:16.366873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c49600-b21d-47ce-b95c-c52048847f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:16.370657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c49600-b21d-47ce-b95c-c52048847f29 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:16.370657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c49600-b21d-47ce-b95c-c52048847f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:16.370657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c49600-b21d-47ce-b95c-c52048847f29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:16.378727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c49600-b21d-47ce-b95c-c52048847f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:16.380159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c49600-b21d-47ce-b95c-c52048847f29 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-87c49600-b21d-47ce-b95c-c52048847f29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:16.397969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:16.405767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:16.407735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:16.407735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:16.407735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:16.407735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:16.407735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 626/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:16.408156 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184d2e1-19b0-4807-bf80-1d1cf5e034b0 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:16.504377 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184d2e1-19b0-4807-bf80-1d1cf5e034b0 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:16.513038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:16.537771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a0afc-b519-4509-9b80-6ce7a995b2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:16.538421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a0afc-b519-4509-9b80-6ce7a995b2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:16.538698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a0afc-b519-4509-9b80-6ce7a995b2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:16.538970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a0afc-b519-4509-9b80-6ce7a995b2e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:16.539682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a0afc-b519-4509-9b80-6ce7a995b2e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:16.539983 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a0afc-b519-4509-9b80-6ce7a995b2e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:16.541436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a0afc-b519-4509-9b80-6ce7a995b2e8 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:16.553261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 612/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:16.558898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c49600-b21d-47ce-b95c-c52048847f29 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:16.657447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c49600-b21d-47ce-b95c-c52048847f29 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:16.691080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926692af-33e8-476e-973e-abc3f0b7de87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:16.691881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926692af-33e8-476e-973e-abc3f0b7de87 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:16.692161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926692af-33e8-476e-973e-abc3f0b7de87 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:16.692452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926692af-33e8-476e-973e-abc3f0b7de87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:16.695152 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:16.699987 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926692af-33e8-476e-973e-abc3f0b7de87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:16.701458 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926692af-33e8-476e-973e-abc3f0b7de87 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-926692af-33e8-476e-973e-abc3f0b7de87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:55:16.716058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:16.717192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:16.718360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:16.718360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:16.718360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:55:16.718360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:55:16.718360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:55:16.718360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:55:16.718360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:55:16.718360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:55:16.718360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:55:16.718360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:16.718360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 627/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:16.723060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a0afc-b519-4509-9b80-6ce7a995b2e8 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:16.821328 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a0afc-b519-4509-9b80-6ce7a995b2e8 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:16.854255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39f757-21b0-4cdb-91cd-891d41f673a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:16.854925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39f757-21b0-4cdb-91cd-891d41f673a2 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:16.855199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39f757-21b0-4cdb-91cd-891d41f673a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:16.855473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39f757-21b0-4cdb-91cd-891d41f673a2 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:16.856310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39f757-21b0-4cdb-91cd-891d41f673a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:16.856619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39f757-21b0-4cdb-91cd-891d41f673a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:16.858084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39f757-21b0-4cdb-91cd-891d41f673a2 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:16.876554 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 613/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jun 23 12:55:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:16.882250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926692af-33e8-476e-973e-abc3f0b7de87 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:16.979619 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926692af-33e8-476e-973e-abc3f0b7de87 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:17.012932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6709-0407-48c0-a19b-0c35ec87fb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:17.013572 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6709-0407-48c0-a19b-0c35ec87fb21 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:17.013856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6709-0407-48c0-a19b-0c35ec87fb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:17.014192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6709-0407-48c0-a19b-0c35ec87fb21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:17.076299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:17.082843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde6709-0407-48c0-a19b-0c35ec87fb21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:17.084284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde6709-0407-48c0-a19b-0c35ec87fb21 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:17.180494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 628/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:55:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:55:17.186308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39f757-21b0-4cdb-91cd-891d41f673a2 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:17.213665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:17.285109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39f757-21b0-4cdb-91cd-891d41f673a2 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:17.318901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d78a4-8c1f-49d3-b77c-0f70c1e1c28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:17.319692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d78a4-8c1f-49d3-b77c-0f70c1e1c28c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:17.319972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d78a4-8c1f-49d3-b77c-0f70c1e1c28c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:17.320246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d78a4-8c1f-49d3-b77c-0f70c1e1c28c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:17.330778 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d78a4-8c1f-49d3-b77c-0f70c1e1c28c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:17.332213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d78a4-8c1f-49d3-b77c-0f70c1e1c28c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-1d1d78a4-8c1f-49d3-b77c-0f70c1e1c28c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:17.350537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:17.351576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:17.352712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:17.352712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:17.352712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:17.352712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:17.352712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 614/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:17.357515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6709-0407-48c0-a19b-0c35ec87fb21 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:17.450678 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:17.456395 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6709-0407-48c0-a19b-0c35ec87fb21 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:17.489931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c76a1-be75-4b54-be73-bb3d7bc52f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:17.490592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c76a1-be75-4b54-be73-bb3d7bc52f81 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:17.490877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c76a1-be75-4b54-be73-bb3d7bc52f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:17.491155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c76a1-be75-4b54-be73-bb3d7bc52f81 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:17.491873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c76a1-be75-4b54-be73-bb3d7bc52f81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:17.492181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c76a1-be75-4b54-be73-bb3d7bc52f81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:17.493588 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130c76a1-be75-4b54-be73-bb3d7bc52f81 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:17.504724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 629/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:17.510890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d78a4-8c1f-49d3-b77c-0f70c1e1c28c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:17.588765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:17.611547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d78a4-8c1f-49d3-b77c-0f70c1e1c28c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:17.645247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0687350-d31d-436d-80ed-be2133db3ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:17.646035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0687350-d31d-436d-80ed-be2133db3ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:17.646320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0687350-d31d-436d-80ed-be2133db3ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:17.646598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0687350-d31d-436d-80ed-be2133db3ab0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:17.653207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0687350-d31d-436d-80ed-be2133db3ab0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:17.654697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0687350-d31d-436d-80ed-be2133db3ab0 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-c0687350-d31d-436d-80ed-be2133db3ab0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:55:17.669181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:17.672039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:17.673213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:55:17.673213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:55:17.673213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:55:17.673213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:55:17.673213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:55:17.673213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:55:17.673213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:55:17.673213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:17.673213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 615/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:55:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:17.676431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c76a1-be75-4b54-be73-bb3d7bc52f81 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:17.775494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c76a1-be75-4b54-be73-bb3d7bc52f81 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:17.809610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30c860-9bab-4317-89ee-a4d57b24c481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:17.810270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c860-9bab-4317-89ee-a4d57b24c481 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:17.810557 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c860-9bab-4317-89ee-a4d57b24c481 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:17.810836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30c860-9bab-4317-89ee-a4d57b24c481 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:17.811662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30c860-9bab-4317-89ee-a4d57b24c481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:17.811976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30c860-9bab-4317-89ee-a4d57b24c481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:17.813571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30c860-9bab-4317-89ee-a4d57b24c481 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:17.825865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 630/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:55:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:17.833004 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0687350-d31d-436d-80ed-be2133db3ab0 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:17.934599 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0687350-d31d-436d-80ed-be2133db3ab0 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:17.969096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201360d-d8a4-4b09-b320-62ca62be8357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:17.969751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201360d-d8a4-4b09-b320-62ca62be8357 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:17.970038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201360d-d8a4-4b09-b320-62ca62be8357 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:17.970316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201360d-d8a4-4b09-b320-62ca62be8357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:17.971152 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201360d-d8a4-4b09-b320-62ca62be8357 None admin] RBAC: Adding query filter params (role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=69b5745bfb5d4e6ca172bb8fab229e58) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:17.971464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201360d-d8a4-4b09-b320-62ca62be8357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:17.972939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201360d-d8a4-4b09-b320-62ca62be8357 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:17.978732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 616/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:55:17 2022] GET /identity/v3/role_assignments?user.id=69b5745bfb5d4e6ca172bb8fab229e58&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=66cfaff0c6ec455aa7274a8b8d1f8aaf => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:20.086373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6568e0-57c3-4478-93d4-0fcefbae9a47 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:20.086917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6568e0-57c3-4478-93d4-0fcefbae9a47 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:20.086917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6568e0-57c3-4478-93d4-0fcefbae9a47 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:20.088294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 631/1247] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:20.094095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74062-06a6-4795-a775-0b2cc4934fbb None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:20.094478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74062-06a6-4795-a775-0b2cc4934fbb None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:20.094651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74062-06a6-4795-a775-0b2cc4934fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:20.099702 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:20.111708 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d7b74062-06a6-4795-a775-0b2cc4934fbb None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:20.112958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d7b74062-06a6-4795-a775-0b2cc4934fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:20.178686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 617/1248] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:20.202367 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6568e0-57c3-4478-93d4-0fcefbae9a47 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:20.221485 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:20.317825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6568e0-57c3-4478-93d4-0fcefbae9a47 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:20.355217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95448857-df64-41f5-97de-f89a86fbae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:20.356004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95448857-df64-41f5-97de-f89a86fbae31 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:20.356284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95448857-df64-41f5-97de-f89a86fbae31 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:20.356558 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95448857-df64-41f5-97de-f89a86fbae31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:20.366871 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95448857-df64-41f5-97de-f89a86fbae31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-95448857-df64-41f5-97de-f89a86fbae31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:55:20.375094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:20.376263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:20.377160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 632/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:55:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:20.382488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74062-06a6-4795-a775-0b2cc4934fbb None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:20.479789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74062-06a6-4795-a775-0b2cc4934fbb None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:20.508709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:20.514103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe14064-4a3d-46e1-83db-855fb3df37c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:20.516717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14064-4a3d-46e1-83db-855fb3df37c0 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:20.516717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14064-4a3d-46e1-83db-855fb3df37c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:20.516717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe14064-4a3d-46e1-83db-855fb3df37c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:20.516717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe14064-4a3d-46e1-83db-855fb3df37c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:20.517090 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe14064-4a3d-46e1-83db-855fb3df37c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:20.518388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe14064-4a3d-46e1-83db-855fb3df37c0 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:20.526530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 618/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:55:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:20.532403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95448857-df64-41f5-97de-f89a86fbae31 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:20.611765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:20.635800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95448857-df64-41f5-97de-f89a86fbae31 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:20.668737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d4dbf-ea55-4da9-b74a-1d73896769dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:20.669569 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d4dbf-ea55-4da9-b74a-1d73896769dc None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:20.669858 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d4dbf-ea55-4da9-b74a-1d73896769dc None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:20.670147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d4dbf-ea55-4da9-b74a-1d73896769dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:20.681300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d4dbf-ea55-4da9-b74a-1d73896769dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:20.682759 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d4dbf-ea55-4da9-b74a-1d73896769dc None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-837d4dbf-ea55-4da9-b74a-1d73896769dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:20.699855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:20.700949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:20.702317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:20.702317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:20.702317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:20.702317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:20.702317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 633/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:20.707873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe14064-4a3d-46e1-83db-855fb3df37c0 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:20.807058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe14064-4a3d-46e1-83db-855fb3df37c0 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:20.840610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9de11-afb7-4ef9-8b91-5c0bf26d22f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:20.841293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9de11-afb7-4ef9-8b91-5c0bf26d22f3 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:20.841573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9de11-afb7-4ef9-8b91-5c0bf26d22f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:20.841846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9de11-afb7-4ef9-8b91-5c0bf26d22f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:20.842621 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9de11-afb7-4ef9-8b91-5c0bf26d22f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:20.842933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9de11-afb7-4ef9-8b91-5c0bf26d22f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:20.845428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9de11-afb7-4ef9-8b91-5c0bf26d22f3 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:20.857250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 619/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:20.863180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d4dbf-ea55-4da9-b74a-1d73896769dc None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:20.971540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d4dbf-ea55-4da9-b74a-1d73896769dc None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:20.996433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:21.004661 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f845180-8b19-4215-b558-8c043fcce259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:21.005509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f845180-8b19-4215-b558-8c043fcce259 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:21.005796 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f845180-8b19-4215-b558-8c043fcce259 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:21.006075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f845180-8b19-4215-b558-8c043fcce259 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:21.013580 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f845180-8b19-4215-b558-8c043fcce259 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:21.015580 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f845180-8b19-4215-b558-8c043fcce259 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-4f845180-8b19-4215-b558-8c043fcce259 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:55:21.029433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:21.030565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:21.031964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:21.031964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:21.031964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:55:21.031964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:55:21.031964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:55:21.031964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:55:21.031964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:55:21.031964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:55:21.031964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:55:21.031964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:21.032790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 634/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:21.036436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9de11-afb7-4ef9-8b91-5c0bf26d22f3 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:21.092292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:21.135316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9de11-afb7-4ef9-8b91-5c0bf26d22f3 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:21.169494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbf928-5860-4e7a-b910-409cff62937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:21.170163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbf928-5860-4e7a-b910-409cff62937a None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:21.170446 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbf928-5860-4e7a-b910-409cff62937a None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:21.170724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbf928-5860-4e7a-b910-409cff62937a None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:21.171558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbf928-5860-4e7a-b910-409cff62937a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:21.171869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbf928-5860-4e7a-b910-409cff62937a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:21.173330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbf928-5860-4e7a-b910-409cff62937a None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:21.190630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 620/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jun 23 12:55:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:21.196507 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f845180-8b19-4215-b558-8c043fcce259 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:21.295536 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f845180-8b19-4215-b558-8c043fcce259 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:21.329231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e0bd-647a-49a4-bf6c-92d6736d0f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:21.329884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e0bd-647a-49a4-bf6c-92d6736d0f27 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:21.330169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e0bd-647a-49a4-bf6c-92d6736d0f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:21.330451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17e0bd-647a-49a4-bf6c-92d6736d0f27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:21.384691 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:21.396449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17e0bd-647a-49a4-bf6c-92d6736d0f27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:21.397946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17e0bd-647a-49a4-bf6c-92d6736d0f27 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:21.494238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 635/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:55:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 12:55:21.500613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbf928-5860-4e7a-b910-409cff62937a None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:21.603567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbf928-5860-4e7a-b910-409cff62937a None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:21.617852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:21.639216 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98095b4e-24cc-4bc0-a780-fce3fcc3ea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:21.639962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98095b4e-24cc-4bc0-a780-fce3fcc3ea83 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:21.640245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98095b4e-24cc-4bc0-a780-fce3fcc3ea83 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:21.640520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98095b4e-24cc-4bc0-a780-fce3fcc3ea83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:21.650240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98095b4e-24cc-4bc0-a780-fce3fcc3ea83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:21.651682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98095b4e-24cc-4bc0-a780-fce3fcc3ea83 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-98095b4e-24cc-4bc0-a780-fce3fcc3ea83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:21.668574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:21.669638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:21.670587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:21.670587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:21.670587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:21.670587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:21.670587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 621/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:21.676147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e0bd-647a-49a4-bf6c-92d6736d0f27 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:21.763279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:21.775015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17e0bd-647a-49a4-bf6c-92d6736d0f27 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:21.809037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b556b23-ede1-4eda-9e5e-07ee886e32b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:21.809702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556b23-ede1-4eda-9e5e-07ee886e32b2 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:21.809991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556b23-ede1-4eda-9e5e-07ee886e32b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:21.810274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556b23-ede1-4eda-9e5e-07ee886e32b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:21.811057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b556b23-ede1-4eda-9e5e-07ee886e32b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:21.811347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b556b23-ede1-4eda-9e5e-07ee886e32b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:21.812786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b556b23-ede1-4eda-9e5e-07ee886e32b2 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:21.823765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 636/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:21.829521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98095b4e-24cc-4bc0-a780-fce3fcc3ea83 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:21.932283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98095b4e-24cc-4bc0-a780-fce3fcc3ea83 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:21.964782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33d624-a311-40c8-81fc-e47c1eea52ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:21.965585 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33d624-a311-40c8-81fc-e47c1eea52ad None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:21.965865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33d624-a311-40c8-81fc-e47c1eea52ad None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:21.966133 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33d624-a311-40c8-81fc-e47c1eea52ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:21.973201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33d624-a311-40c8-81fc-e47c1eea52ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:21.981673 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33d624-a311-40c8-81fc-e47c1eea52ad None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-6a33d624-a311-40c8-81fc-e47c1eea52ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:55:21.988530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:21.989590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:21.990677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:55:21.990677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:55:21.990677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:55:21.990677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:55:21.990677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:55:21.990677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:55:21.990677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:55:21.990677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:21.990677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 622/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:55:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:21.995556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b556b23-ede1-4eda-9e5e-07ee886e32b2 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:22.093424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b556b23-ede1-4eda-9e5e-07ee886e32b2 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:22.126480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b960e0-c50f-4da0-9108-6a1317df43c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:22.127139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b960e0-c50f-4da0-9108-6a1317df43c9 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:22.127424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b960e0-c50f-4da0-9108-6a1317df43c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:22.127697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b960e0-c50f-4da0-9108-6a1317df43c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:22.128481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b960e0-c50f-4da0-9108-6a1317df43c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:22.128790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b960e0-c50f-4da0-9108-6a1317df43c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:22.130239 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b960e0-c50f-4da0-9108-6a1317df43c9 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:22.143061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 637/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:55:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:22.149184 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33d624-a311-40c8-81fc-e47c1eea52ad None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:22.175362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:22.246799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33d624-a311-40c8-81fc-e47c1eea52ad None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:22.281943 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91fcba0-3e91-4af7-bdc7-980c4196d92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:22.282594 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91fcba0-3e91-4af7-bdc7-980c4196d92e None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:22.282879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91fcba0-3e91-4af7-bdc7-980c4196d92e None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:22.283152 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91fcba0-3e91-4af7-bdc7-980c4196d92e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:22.283981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91fcba0-3e91-4af7-bdc7-980c4196d92e None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=69b5745bfb5d4e6ca172bb8fab229e58) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:22.284296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91fcba0-3e91-4af7-bdc7-980c4196d92e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:22.285759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91fcba0-3e91-4af7-bdc7-980c4196d92e None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:22.291166 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 623/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:55:22 2022] GET /identity/v3/role_assignments?user.id=69b5745bfb5d4e6ca172bb8fab229e58&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:24.317193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f111f-bd53-4ba1-9f38-2e7ea200cea7 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:24.317793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f111f-bd53-4ba1-9f38-2e7ea200cea7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:24.317793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f111f-bd53-4ba1-9f38-2e7ea200cea7 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:24.319107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 638/1261] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 12:55:24.324131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce5c0-ee1b-420d-8007-94e42a6a3ff1 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:24.324558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce5c0-ee1b-420d-8007-94e42a6a3ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:24.324681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ce5c0-ee1b-420d-8007-94e42a6a3ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:24.342416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-dc4ce5c0-ee1b-420d-8007-94e42a6a3ff1 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:24.344062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-dc4ce5c0-ee1b-420d-8007-94e42a6a3ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:24.411239 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 624/1262] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:24.434114 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f111f-bd53-4ba1-9f38-2e7ea200cea7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:24.445609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:24.534566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f111f-bd53-4ba1-9f38-2e7ea200cea7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:24.568691 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03153d-ce8d-4650-aa58-eb69c21047d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:24.569450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03153d-ce8d-4650-aa58-eb69c21047d8 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:24.569737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03153d-ce8d-4650-aa58-eb69c21047d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:24.570018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03153d-ce8d-4650-aa58-eb69c21047d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:24.580116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03153d-ce8d-4650-aa58-eb69c21047d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-ec03153d-ce8d-4650-aa58-eb69c21047d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:55:24.587820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:24.588935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:24.594946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 639/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:55:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:24.595793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ce5c0-ee1b-420d-8007-94e42a6a3ff1 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:24.613900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:24.694493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ce5c0-ee1b-420d-8007-94e42a6a3ff1 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:24.727609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649dfeb-f413-4b38-8d05-5c1072ea46c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:24.728272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649dfeb-f413-4b38-8d05-5c1072ea46c2 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:24.728555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649dfeb-f413-4b38-8d05-5c1072ea46c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:24.728861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649dfeb-f413-4b38-8d05-5c1072ea46c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:24.729612 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649dfeb-f413-4b38-8d05-5c1072ea46c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:24.729917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649dfeb-f413-4b38-8d05-5c1072ea46c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:24.731289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649dfeb-f413-4b38-8d05-5c1072ea46c2 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:24.739778 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 625/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:55:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:24.745540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03153d-ce8d-4650-aa58-eb69c21047d8 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:24.812456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:24.846360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03153d-ce8d-4650-aa58-eb69c21047d8 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:24.879490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f008e2-11bb-4adb-ad6b-73df463b1b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:24.880403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f008e2-11bb-4adb-ad6b-73df463b1b12 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:24.881255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f008e2-11bb-4adb-ad6b-73df463b1b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:24.881255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f008e2-11bb-4adb-ad6b-73df463b1b12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:24.892788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f008e2-11bb-4adb-ad6b-73df463b1b12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:24.894273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f008e2-11bb-4adb-ad6b-73df463b1b12 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-22f008e2-11bb-4adb-ad6b-73df463b1b12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:24.911862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:24.912951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:24.918554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:24.918554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:24.918554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:24.918554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:24.918554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 640/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:24.918890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649dfeb-f413-4b38-8d05-5c1072ea46c2 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:25.000868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:25.019622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649dfeb-f413-4b38-8d05-5c1072ea46c2 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:25.053565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd360e58-d435-4913-9c13-8893673053ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:25.054220 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd360e58-d435-4913-9c13-8893673053ae None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:25.054503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd360e58-d435-4913-9c13-8893673053ae None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:25.054777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd360e58-d435-4913-9c13-8893673053ae None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:25.055502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd360e58-d435-4913-9c13-8893673053ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:25.055812 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd360e58-d435-4913-9c13-8893673053ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:25.057212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd360e58-d435-4913-9c13-8893673053ae None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:25.068217 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 626/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:25.074058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f008e2-11bb-4adb-ad6b-73df463b1b12 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:25.178314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f008e2-11bb-4adb-ad6b-73df463b1b12 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:25.197279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:25.211178 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc120854-de12-42f5-b37f-ff1d282ceabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:25.211984 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc120854-de12-42f5-b37f-ff1d282ceabe None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:25.212266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc120854-de12-42f5-b37f-ff1d282ceabe None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:25.212570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc120854-de12-42f5-b37f-ff1d282ceabe None admin] PATH_INFO: `/v3/users/placement` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:25.220449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc120854-de12-42f5-b37f-ff1d282ceabe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:25.221920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc120854-de12-42f5-b37f-ff1d282ceabe None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-dc120854-de12-42f5-b37f-ff1d282ceabe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:55:25.235813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:25.236986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:25.238203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:25.238203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:25.238203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:55:25.238203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:55:25.238203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:55:25.238203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:55:25.238203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:55:25.238203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:55:25.238203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:55:25.238203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:25.238203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 641/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:25.242748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd360e58-d435-4913-9c13-8893673053ae None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:25.340285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd360e58-d435-4913-9c13-8893673053ae None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:25.373381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b15434-7b33-497a-a84e-0bdd2ed472a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:25.374047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b15434-7b33-497a-a84e-0bdd2ed472a2 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:25.374331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b15434-7b33-497a-a84e-0bdd2ed472a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:25.374605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b15434-7b33-497a-a84e-0bdd2ed472a2 None admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:25.375440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b15434-7b33-497a-a84e-0bdd2ed472a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:25.375748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b15434-7b33-497a-a84e-0bdd2ed472a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:25.377242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b15434-7b33-497a-a84e-0bdd2ed472a2 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:25.386317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:25.394943 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 627/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jun 23 12:55:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:25.401067 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc120854-de12-42f5-b37f-ff1d282ceabe None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:25.498539 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc120854-de12-42f5-b37f-ff1d282ceabe None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:25.533014 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d00424-3d21-42ea-857d-6237ae43644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:25.533807 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d00424-3d21-42ea-857d-6237ae43644a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:25.534093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d00424-3d21-42ea-857d-6237ae43644a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:25.534372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d00424-3d21-42ea-857d-6237ae43644a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:25.544974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d00424-3d21-42ea-857d-6237ae43644a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:25.546452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d00424-3d21-42ea-857d-6237ae43644a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-b9d00424-3d21-42ea-857d-6237ae43644a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:25.563662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:25.564736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:25.565874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:25.565874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:25.565874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:25.565874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:25.565874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 642/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:25.571355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b15434-7b33-497a-a84e-0bdd2ed472a2 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:25.672148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b15434-7b33-497a-a84e-0bdd2ed472a2 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:25.706529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842b5f6-8204-4d00-af8f-8158abf6995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:25.707192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842b5f6-8204-4d00-af8f-8158abf6995b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:25.707477 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842b5f6-8204-4d00-af8f-8158abf6995b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:25.707756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842b5f6-8204-4d00-af8f-8158abf6995b None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:25.708493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842b5f6-8204-4d00-af8f-8158abf6995b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:25.708878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842b5f6-8204-4d00-af8f-8158abf6995b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:25.710193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842b5f6-8204-4d00-af8f-8158abf6995b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:25.721852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 628/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 12:55:25.727573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d00424-3d21-42ea-857d-6237ae43644a None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:25.759483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:25.825876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d00424-3d21-42ea-857d-6237ae43644a None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:25.859329 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c625cd-3e20-4372-b420-6f7f6e8c3047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:25.860250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c625cd-3e20-4372-b420-6f7f6e8c3047 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:25.860532 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c625cd-3e20-4372-b420-6f7f6e8c3047 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:25.860831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c625cd-3e20-4372-b420-6f7f6e8c3047 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:25.867648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c625cd-3e20-4372-b420-6f7f6e8c3047 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:25.869119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c625cd-3e20-4372-b420-6f7f6e8c3047 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-02c625cd-3e20-4372-b420-6f7f6e8c3047 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:55:25.883895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:25.885102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:25.886352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:55:25.886352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:55:25.886352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:55:25.886352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:55:25.886352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:55:25.886352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:55:25.886352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:55:25.886352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:25.886352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 643/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:55:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:25.891976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842b5f6-8204-4d00-af8f-8158abf6995b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:25.949707 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:25.990951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842b5f6-8204-4d00-af8f-8158abf6995b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:26.025174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c041-0103-4cc2-b8ef-22bb0aaff3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:26.025785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c041-0103-4cc2-b8ef-22bb0aaff3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:26.026069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c041-0103-4cc2-b8ef-22bb0aaff3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:26.026346 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c041-0103-4cc2-b8ef-22bb0aaff3d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:26.027131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c041-0103-4cc2-b8ef-22bb0aaff3d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:26.027444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c041-0103-4cc2-b8ef-22bb0aaff3d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:26.028899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c041-0103-4cc2-b8ef-22bb0aaff3d2 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:26.040613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 629/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:55:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:26.047200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c625cd-3e20-4372-b420-6f7f6e8c3047 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:26.140403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:26.148932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c625cd-3e20-4372-b420-6f7f6e8c3047 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:26.181290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52318d-0e50-4fd3-9a9b-e87813562df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:26.182176 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52318d-0e50-4fd3-9a9b-e87813562df1 None admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:26.182459 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52318d-0e50-4fd3-9a9b-e87813562df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:26.182736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52318d-0e50-4fd3-9a9b-e87813562df1 None admin] PATH_INFO: `/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/69b5745bfb5d4e6ca172bb8fab229e58/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:26.184660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52318d-0e50-4fd3-9a9b-e87813562df1 None admin] RBAC: Authorizing `identity:create_grant(project_id=66de76d7ea7a45a6b698f8b1295c66c3, user_id=69b5745bfb5d4e6ca172bb8fab229e58, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:26.186220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c52318d-0e50-4fd3-9a9b-e87813562df1 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:26.278288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 644/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Thu Jun 23 12:55:26 2022] PUT /identity/v3/projects/66de76d7ea7a45a6b698f8b1295c66c3/users/69b5745bfb5d4e6ca172bb8fab229e58/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 12:55:28.284436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f398a0-5ebe-470a-b05f-f7027e93dd77 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:28.285013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f398a0-5ebe-470a-b05f-f7027e93dd77 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:28.285106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f398a0-5ebe-470a-b05f-f7027e93dd77 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:28.286533 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 630/1274] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:28.291514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bec6e-9951-4fad-a935-f0172de5e312 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:28.291943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bec6e-9951-4fad-a935-f0172de5e312 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:28.292084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bec6e-9951-4fad-a935-f0172de5e312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:28.309559 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0e5bec6e-9951-4fad-a935-f0172de5e312 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:28.310756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0e5bec6e-9951-4fad-a935-f0172de5e312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:28.381648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 645/1275] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:28.406053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f398a0-5ebe-470a-b05f-f7027e93dd77 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:28.506258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f398a0-5ebe-470a-b05f-f7027e93dd77 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:28.524002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:28.540667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f048c-28b5-4073-9beb-bae07e02d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:28.541442 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f048c-28b5-4073-9beb-bae07e02d23c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:28.541726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f048c-28b5-4073-9beb-bae07e02d23c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:28.542001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f048c-28b5-4073-9beb-bae07e02d23c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:28.553178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f048c-28b5-4073-9beb-bae07e02d23c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-4e3f048c-28b5-4073-9beb-bae07e02d23c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 12:55:28.560797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:28.562175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:28.563376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 631/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Thu Jun 23 12:55:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:28.568016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bec6e-9951-4fad-a935-f0172de5e312 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:28.650486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:28.668240 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bec6e-9951-4fad-a935-f0172de5e312 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:28.700527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9cca6-ab50-4c80-b53b-6b2b81656ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:28.701219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9cca6-ab50-4c80-b53b-6b2b81656ecf None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:28.701505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9cca6-ab50-4c80-b53b-6b2b81656ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:28.701806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9cca6-ab50-4c80-b53b-6b2b81656ecf None admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:28.702593 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9cca6-ab50-4c80-b53b-6b2b81656ecf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:28.702898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9cca6-ab50-4c80-b53b-6b2b81656ecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:28.704263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e9cca6-ab50-4c80-b53b-6b2b81656ecf None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:28.712013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 646/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Thu Jun 23 12:55:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:28.718901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f048c-28b5-4073-9beb-bae07e02d23c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:28.820979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f048c-28b5-4073-9beb-bae07e02d23c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:28.853941 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3081af-f271-4b81-b329-1bd7e342646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:28.854722 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3081af-f271-4b81-b329-1bd7e342646c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:28.855000 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3081af-f271-4b81-b329-1bd7e342646c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:28.855273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3081af-f271-4b81-b329-1bd7e342646c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:28.868032 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3081af-f271-4b81-b329-1bd7e342646c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:28.869527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3081af-f271-4b81-b329-1bd7e342646c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-bf3081af-f271-4b81-b329-1bd7e342646c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:28.886684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:28.887706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:28.888907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:28.888907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:28.888907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:28.888907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:28.888907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 632/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:28.894271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9cca6-ab50-4c80-b53b-6b2b81656ecf None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:28.992313 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e9cca6-ab50-4c80-b53b-6b2b81656ecf None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:29.026110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24f633-496c-44b4-b030-7d366a8800cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:29.026776 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24f633-496c-44b4-b030-7d366a8800cd None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:29.027066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24f633-496c-44b4-b030-7d366a8800cd None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:29.027346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24f633-496c-44b4-b030-7d366a8800cd None admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:29.028122 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24f633-496c-44b4-b030-7d366a8800cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:29.028439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24f633-496c-44b4-b030-7d366a8800cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:29.029840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24f633-496c-44b4-b030-7d366a8800cd None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:29.041969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 647/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:29.048102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3081af-f271-4b81-b329-1bd7e342646c None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:29.079287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:29.149309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3081af-f271-4b81-b329-1bd7e342646c None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:29.182987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680c12e-a597-4793-bac7-a3a36c183c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:29.183782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c12e-a597-4793-bac7-a3a36c183c7d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:29.184062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c12e-a597-4793-bac7-a3a36c183c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:29.184337 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c12e-a597-4793-bac7-a3a36c183c7d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:29.191416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680c12e-a597-4793-bac7-a3a36c183c7d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:29.192884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0680c12e-a597-4793-bac7-a3a36c183c7d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-0680c12e-a597-4793-bac7-a3a36c183c7d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 12:55:29.208054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:29.209209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:29.210268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:29.210268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:29.210268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 12:55:29.210268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 12:55:29.210268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 12:55:29.210268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 12:55:29.210268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 12:55:29.210268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 12:55:29.210268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 12:55:29.210268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:29.210268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 633/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:29.215093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24f633-496c-44b4-b030-7d366a8800cd None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:29.220095 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:29.315078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24f633-496c-44b4-b030-7d366a8800cd None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:29.349039 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb5fa-a875-454c-afd2-d55b29a8129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:29.349679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb5fa-a875-454c-afd2-d55b29a8129c None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:29.349956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb5fa-a875-454c-afd2-d55b29a8129c None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:29.350230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb5fa-a875-454c-afd2-d55b29a8129c None admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:29.351059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fb5fa-a875-454c-afd2-d55b29a8129c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:29.351363 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fb5fa-a875-454c-afd2-d55b29a8129c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:29.352779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106fb5fa-a875-454c-afd2-d55b29a8129c None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:29.369506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 648/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Thu Jun 23 12:55:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:29.375906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680c12e-a597-4793-bac7-a3a36c183c7d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:29.466845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:29.476505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680c12e-a597-4793-bac7-a3a36c183c7d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:29.510611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa8b3-5555-48c0-a145-9f9cccb43a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:29.511259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa8b3-5555-48c0-a145-9f9cccb43a26 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:29.511539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa8b3-5555-48c0-a145-9f9cccb43a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:29.511814 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa8b3-5555-48c0-a145-9f9cccb43a26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:29.579043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aa8b3-5555-48c0-a145-9f9cccb43a26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:29.580500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2aa8b3-5555-48c0-a145-9f9cccb43a26 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:29.668868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:29.678638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 634/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Thu Jun 23 12:55:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 12:55:29.684489 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb5fa-a875-454c-afd2-d55b29a8129c None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:29.746451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:29.786312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb5fa-a875-454c-afd2-d55b29a8129c None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:29.821899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c416f-8b0d-4c4d-b4b3-ca6d5fea4b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:29.823089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c416f-8b0d-4c4d-b4b3-ca6d5fea4b52 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:29.823493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c416f-8b0d-4c4d-b4b3-ca6d5fea4b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:29.823892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c416f-8b0d-4c4d-b4b3-ca6d5fea4b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:29.839035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c416f-8b0d-4c4d-b4b3-ca6d5fea4b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:29.841417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c416f-8b0d-4c4d-b4b3-ca6d5fea4b52 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-752c416f-8b0d-4c4d-b4b3-ca6d5fea4b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 12:55:29.862573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:29.865297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:29.866816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 12:55:29.866816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 12:55:29.866816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 12:55:29.866816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:29.868966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 649/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 12:55:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:29.870724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa8b3-5555-48c0-a145-9f9cccb43a26 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:29.973770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2aa8b3-5555-48c0-a145-9f9cccb43a26 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:30.007193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b049ca-eb1a-4dce-881b-9a30272cdf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:30.007842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b049ca-eb1a-4dce-881b-9a30272cdf0d None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:30.008123 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b049ca-eb1a-4dce-881b-9a30272cdf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:30.008395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b049ca-eb1a-4dce-881b-9a30272cdf0d None admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:30.009428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b049ca-eb1a-4dce-881b-9a30272cdf0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:30.009726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b049ca-eb1a-4dce-881b-9a30272cdf0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:30.013710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b049ca-eb1a-4dce-881b-9a30272cdf0d None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:30.023089 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 635/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Thu Jun 23 12:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:30.028691 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c416f-8b0d-4c4d-b4b3-ca6d5fea4b52 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:30.125850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c416f-8b0d-4c4d-b4b3-ca6d5fea4b52 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:30.139863 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:30.167042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef0405-e6e0-497b-b443-9daa34a54d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:30.168095 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef0405-e6e0-497b-b443-9daa34a54d15 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:30.168378 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef0405-e6e0-497b-b443-9daa34a54d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:30.168654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef0405-e6e0-497b-b443-9daa34a54d15 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:30.175530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef0405-e6e0-497b-b443-9daa34a54d15 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:30.176996 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef0405-e6e0-497b-b443-9daa34a54d15 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application [None req-46ef0405-e6e0-497b-b443-9daa34a54d15 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 12:55:30.191676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:30.192767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:30.193708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 12:55:30.193708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 12:55:30.193708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 12:55:30.193708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 12:55:30.193708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 12:55:30.193708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 12:55:30.193708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 12:55:30.193708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: ERROR keystone.server.flask.application Jun 23 12:55:30.193708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 650/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Thu Jun 23 12:55:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:30.198833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b049ca-eb1a-4dce-881b-9a30272cdf0d None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:30.249223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:30.297705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b049ca-eb1a-4dce-881b-9a30272cdf0d None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:30.331347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec07dd-3391-4984-89c6-50dcaa8e6ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:30.331996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec07dd-3391-4984-89c6-50dcaa8e6ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:30.332274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec07dd-3391-4984-89c6-50dcaa8e6ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:30.332547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec07dd-3391-4984-89c6-50dcaa8e6ec6 None admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:30.333383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec07dd-3391-4984-89c6-50dcaa8e6ec6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:30.333719 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec07dd-3391-4984-89c6-50dcaa8e6ec6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:30.339606 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec07dd-3391-4984-89c6-50dcaa8e6ec6 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:30.352449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 636/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Thu Jun 23 12:55:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:30.359101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef0405-e6e0-497b-b443-9daa34a54d15 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:30.457707 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef0405-e6e0-497b-b443-9daa34a54d15 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:30.490689 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0734e-79ed-4c0a-9544-e45aff96f7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:30.491333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0734e-79ed-4c0a-9544-e45aff96f7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:30.491612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0734e-79ed-4c0a-9544-e45aff96f7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:30.491889 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0734e-79ed-4c0a-9544-e45aff96f7d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:30.492710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0734e-79ed-4c0a-9544-e45aff96f7d3 None admin] RBAC: Adding query filter params (role.id=0374c5203588439693ac9f7fe25bbe6d, scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3, user.id=69b5745bfb5d4e6ca172bb8fab229e58) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:30.493047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0734e-79ed-4c0a-9544-e45aff96f7d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:30.494460 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e0734e-79ed-4c0a-9544-e45aff96f7d3 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:30.500743 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 651/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Thu Jun 23 12:55:30 2022] GET /identity/v3/role_assignments?user.id=69b5745bfb5d4e6ca172bb8fab229e58&scope.project.id=66de76d7ea7a45a6b698f8b1295c66c3&role.id=0374c5203588439693ac9f7fe25bbe6d => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:32.561865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96939347-683a-4d16-9801-4da9e1cdaacd None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:32.562424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96939347-683a-4d16-9801-4da9e1cdaacd None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:32.562424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96939347-683a-4d16-9801-4da9e1cdaacd None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:32.563793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 637/1288] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:32.569170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436eba2d-a238-4c40-831d-7eb05b7825d9 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:32.569590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436eba2d-a238-4c40-831d-7eb05b7825d9 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:32.569729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436eba2d-a238-4c40-831d-7eb05b7825d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:32.586436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-436eba2d-a238-4c40-831d-7eb05b7825d9 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:32.587651 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-436eba2d-a238-4c40-831d-7eb05b7825d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:32.618192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:32.655665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 652/1289] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:32.678319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96939347-683a-4d16-9801-4da9e1cdaacd None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:32.789678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96939347-683a-4d16-9801-4da9e1cdaacd None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:32.802082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:32.827175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2c39d-1f5c-4e4f-b0f6-d6f76a36562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:32.827885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2c39d-1f5c-4e4f-b0f6-d6f76a36562b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:32.828168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2c39d-1f5c-4e4f-b0f6-d6f76a36562b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:32.828455 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2c39d-1f5c-4e4f-b0f6-d6f76a36562b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:32.829154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2c39d-1f5c-4e4f-b0f6-d6f76a36562b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:32.834300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2c39d-1f5c-4e4f-b0f6-d6f76a36562b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-dcf2c39d-1f5c-4e4f-b0f6-d6f76a36562b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:32.843892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:32.850378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:32.851721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 638/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 23 12:55:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:32.852561 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436eba2d-a238-4c40-831d-7eb05b7825d9 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:32.960411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436eba2d-a238-4c40-831d-7eb05b7825d9 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:33.001193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefe6c8-09c2-4e0c-bb65-629bc26c701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:33.001875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe6c8-09c2-4e0c-bb65-629bc26c701a None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:33.002155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe6c8-09c2-4e0c-bb65-629bc26c701a None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:33.002426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefe6c8-09c2-4e0c-bb65-629bc26c701a None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:33.003156 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe6c8-09c2-4e0c-bb65-629bc26c701a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:33.003447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe6c8-09c2-4e0c-bb65-629bc26c701a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:33.004847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefe6c8-09c2-4e0c-bb65-629bc26c701a None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:33.010550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 653/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Jun 23 12:55:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:33.017236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2c39d-1f5c-4e4f-b0f6-d6f76a36562b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:33.129037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2c39d-1f5c-4e4f-b0f6-d6f76a36562b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:33.165345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7529d40-6d93-4ef8-9eee-9d1a2e6289d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:33.166023 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7529d40-6d93-4ef8-9eee-9d1a2e6289d6 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:33.166311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7529d40-6d93-4ef8-9eee-9d1a2e6289d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:33.166593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7529d40-6d93-4ef8-9eee-9d1a2e6289d6 None admin] PATH_INFO: `/v3/services` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:33.167504 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7529d40-6d93-4ef8-9eee-9d1a2e6289d6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:33.167810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7529d40-6d93-4ef8-9eee-9d1a2e6289d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:33.169252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7529d40-6d93-4ef8-9eee-9d1a2e6289d6 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:33.175070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 639/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Jun 23 12:55:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:35.204634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789269-ad69-48c0-a7d3-2c6b25f8e496 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:35.205192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789269-ad69-48c0-a7d3-2c6b25f8e496 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:35.205192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789269-ad69-48c0-a7d3-2c6b25f8e496 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:35.206515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 654/1293] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:35.211502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eb471-5744-41e2-b07f-59ddd94d3341 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:35.211937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eb471-5744-41e2-b07f-59ddd94d3341 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:35.212053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585eb471-5744-41e2-b07f-59ddd94d3341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:35.229693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-585eb471-5744-41e2-b07f-59ddd94d3341 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:35.230906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-585eb471-5744-41e2-b07f-59ddd94d3341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:35.260424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:35.296674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 640/1294] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:35.320065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789269-ad69-48c0-a7d3-2c6b25f8e496 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:35.351639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:35.421370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789269-ad69-48c0-a7d3-2c6b25f8e496 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:35.455460 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f481cf-b910-40e2-a82e-bfe8f6c95f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:35.456052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f481cf-b910-40e2-a82e-bfe8f6c95f42 None admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:35.456336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f481cf-b910-40e2-a82e-bfe8f6c95f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:35.456658 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f481cf-b910-40e2-a82e-bfe8f6c95f42 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:35.457419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f481cf-b910-40e2-a82e-bfe8f6c95f42 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:35.458785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f481cf-b910-40e2-a82e-bfe8f6c95f42 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:35.544362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 655/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Thu Jun 23 12:55:35 2022] POST /identity/v3/services => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:55:37.618536 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e665966-81e9-4b2a-9fdf-7b3a32c31faf None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:37.619116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e665966-81e9-4b2a-9fdf-7b3a32c31faf None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:37.619116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e665966-81e9-4b2a-9fdf-7b3a32c31faf None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:37.620463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 641/1296] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:37.626060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dcbd0-d211-4691-a5ba-9fea5ae513df None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:37.626434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dcbd0-d211-4691-a5ba-9fea5ae513df None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:37.630025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29dcbd0-d211-4691-a5ba-9fea5ae513df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:37.643875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f29dcbd0-d211-4691-a5ba-9fea5ae513df None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:37.645079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f29dcbd0-d211-4691-a5ba-9fea5ae513df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:37.718531 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 656/1297] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:37.742286 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e665966-81e9-4b2a-9fdf-7b3a32c31faf None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:37.842681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e665966-81e9-4b2a-9fdf-7b3a32c31faf None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:37.878107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216645a8-2526-45cc-b945-1422dc54aa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:37.878848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216645a8-2526-45cc-b945-1422dc54aa8b None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:37.879178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216645a8-2526-45cc-b945-1422dc54aa8b None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:37.879455 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216645a8-2526-45cc-b945-1422dc54aa8b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:37.880111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216645a8-2526-45cc-b945-1422dc54aa8b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:37.881523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216645a8-2526-45cc-b945-1422dc54aa8b None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-216645a8-2526-45cc-b945-1422dc54aa8b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:37.895104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:37.901790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:37.902838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 642/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 23 12:55:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:37.904986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dcbd0-d211-4691-a5ba-9fea5ae513df None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:37.924153 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:38.002393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29dcbd0-d211-4691-a5ba-9fea5ae513df None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:38.037373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3480198-f15e-43f6-b0aa-c2899c919653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:38.038027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3480198-f15e-43f6-b0aa-c2899c919653 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:38.038306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3480198-f15e-43f6-b0aa-c2899c919653 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:38.038579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3480198-f15e-43f6-b0aa-c2899c919653 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:38.039306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3480198-f15e-43f6-b0aa-c2899c919653 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:38.039644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3480198-f15e-43f6-b0aa-c2899c919653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:38.041029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3480198-f15e-43f6-b0aa-c2899c919653 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:38.046627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 657/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Jun 23 12:55:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:38.052779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216645a8-2526-45cc-b945-1422dc54aa8b None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:38.084244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:38.150522 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216645a8-2526-45cc-b945-1422dc54aa8b None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:38.183405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609053b2-2b98-46a6-800f-183fb1e94e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:38.184056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609053b2-2b98-46a6-800f-183fb1e94e5c None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:38.184340 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609053b2-2b98-46a6-800f-183fb1e94e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:38.184618 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609053b2-2b98-46a6-800f-183fb1e94e5c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:38.185443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609053b2-2b98-46a6-800f-183fb1e94e5c None admin] RBAC: Adding query filter params (interface=public, service_id=3210e3445c974c7499bb0d906ec43da7, region_id=RegionOne) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:38.185901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609053b2-2b98-46a6-800f-183fb1e94e5c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:38.187377 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609053b2-2b98-46a6-800f-183fb1e94e5c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:38.193891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 643/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Thu Jun 23 12:55:38 2022] GET /identity/v3/endpoints?service_id=3210e3445c974c7499bb0d906ec43da7&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:38.199851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3480198-f15e-43f6-b0aa-c2899c919653 None admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:38.287926 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:38.305080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3480198-f15e-43f6-b0aa-c2899c919653 None admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:38.338363 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae483542-e96a-44b8-b272-dd5277e11b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:38.339027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae483542-e96a-44b8-b272-dd5277e11b64 None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:38.339310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae483542-e96a-44b8-b272-dd5277e11b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:38.339589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae483542-e96a-44b8-b272-dd5277e11b64 None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:38.340273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae483542-e96a-44b8-b272-dd5277e11b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:38.341665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae483542-e96a-44b8-b272-dd5277e11b64 None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:38.348265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 658/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Thu Jun 23 12:55:38 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 12:55:40.452358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1435e5-a285-45a1-958e-084f575f70b6 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:40.452990 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1435e5-a285-45a1-958e-084f575f70b6 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:40.452990 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1435e5-a285-45a1-958e-084f575f70b6 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:40.454346 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 644/1302] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 12:55:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 12:55:40.459415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ec1c-ef38-4849-a0ab-549fc6afd3cc None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:40.459861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ec1c-ef38-4849-a0ab-549fc6afd3cc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:40.459971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ec1c-ef38-4849-a0ab-549fc6afd3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:40.476362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-de90ec1c-ef38-4849-a0ab-549fc6afd3cc None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 12:55:40.477582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-de90ec1c-ef38-4849-a0ab-549fc6afd3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 12:55:40.555777 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 659/1303] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 12:55:40 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 12:55:40.579942 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1435e5-a285-45a1-958e-084f575f70b6 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:40.673886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:40.680586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1435e5-a285-45a1-958e-084f575f70b6 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:40.713121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48fc2e-b8ca-48c1-a8ba-ec8701045d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:40.713851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48fc2e-b8ca-48c1-a8ba-ec8701045d68 None admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:40.714135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48fc2e-b8ca-48c1-a8ba-ec8701045d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:40.714413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48fc2e-b8ca-48c1-a8ba-ec8701045d68 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:40.715059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48fc2e-b8ca-48c1-a8ba-ec8701045d68 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:40.716426 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48fc2e-b8ca-48c1-a8ba-ec8701045d68 None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application [None req-7e48fc2e-b8ca-48c1-a8ba-ec8701045d68 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 12:55:40.729800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 12:55:40.731109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application with Lock( Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self._enter() Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application return self.creator() Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application created_value = creator( Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: ERROR keystone.server.flask.application Jun 23 12:55:40.732875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 645/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Thu Jun 23 12:55:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 12:55:40.737670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ec1c-ef38-4849-a0ab-549fc6afd3cc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:40.811480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:40.833063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ec1c-ef38-4849-a0ab-549fc6afd3cc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:40.867112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a231cf8-bf2b-42e5-9809-759302d01a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:40.867804 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a231cf8-bf2b-42e5-9809-759302d01a9e None admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:40.868088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a231cf8-bf2b-42e5-9809-759302d01a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:40.868366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a231cf8-bf2b-42e5-9809-759302d01a9e None admin] PATH_INFO: `/v3/services` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:40.869117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a231cf8-bf2b-42e5-9809-759302d01a9e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 12:55:40.869428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a231cf8-bf2b-42e5-9809-759302d01a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:40.870884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a231cf8-bf2b-42e5-9809-759302d01a9e None admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:40.876365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 660/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Thu Jun 23 12:55:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 12:55:40.882010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48fc2e-b8ca-48c1-a8ba-ec8701045d68 None admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 12:55:40.980657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48fc2e-b8ca-48c1-a8ba-ec8701045d68 None admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 12:55:41.012667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d60ad4-9ab6-48e6-ade4-6bd4913f238c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 12:55:41.013328 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d60ad4-9ab6-48e6-ade4-6bd4913f238c None admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 12:55:41.014294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d60ad4-9ab6-48e6-ade4-6bd4913f238c None admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 12:55:41.014577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d60ad4-9ab6-48e6-ade4-6bd4913f238c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 12:55:41.015325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d60ad4-9ab6-48e6-ade4-6bd4913f238c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 12:55:41.016683 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d60ad4-9ab6-48e6-ade4-6bd4913f238c None admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 12:55:41.111718 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 646/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Thu Jun 23 12:55:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 12:55:50.873107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=30 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:55:51.107291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:07.629817 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1cd0d-7319-4e1d-b29c-10adfae88fcb None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:07.630431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1cd0d-7319-4e1d-b29c-10adfae88fcb None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:07.630431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1cd0d-7319-4e1d-b29c-10adfae88fcb None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:07.633183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 661/1307] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:07.637097 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b0edb-17c2-4c25-a60e-859e6ba7053b None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:07.638925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b0edb-17c2-4c25-a60e-859e6ba7053b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:07.638925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b0edb-17c2-4c25-a60e-859e6ba7053b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:07.726451 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-611b0edb-17c2-4c25-a60e-859e6ba7053b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:07.727736 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-611b0edb-17c2-4c25-a60e-859e6ba7053b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:07.860828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 647/1308] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:07.916284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e94b5-855c-42d1-8e08-592824d795ce None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:07.916760 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e94b5-855c-42d1-8e08-592824d795ce None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:07.917231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e94b5-855c-42d1-8e08-592824d795ce None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:07.919324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 662/1309] 10.222.0.16 () {54 vars in 964 bytes} [Thu Jun 23 13:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:07.925395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51943f6e-7482-4573-af03-f467cd71adad None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:07.925640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51943f6e-7482-4573-af03-f467cd71adad None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:07.925916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51943f6e-7482-4573-af03-f467cd71adad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:08.008636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-51943f6e-7482-4573-af03-f467cd71adad None None] MFA Rules not processed for user `83858713769b41af800bab317602bf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:08.010137 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-51943f6e-7482-4573-af03-f467cd71adad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:08.045364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:08.108389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 648/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Jun 23 13:03:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:08.118521 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e94b5-855c-42d1-8e08-592824d795ce None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:08.120424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3e5e94b5-855c-42d1-8e08-592824d795ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:08.243198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e94b5-855c-42d1-8e08-592824d795ce None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:08.330334 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa2b62-ca72-41e3-96bc-ab81e6ff02ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:08.331004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa2b62-ca72-41e3-96bc-ab81e6ff02ce service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:08.331272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa2b62-ca72-41e3-96bc-ab81e6ff02ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:08.331549 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa2b62-ca72-41e3-96bc-ab81e6ff02ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:08.333357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-10fa2b62-ca72-41e3-96bc-ab81e6ff02ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:08.397435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:08.464126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa2b62-ca72-41e3-96bc-ab81e6ff02ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:08.465784 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa2b62-ca72-41e3-96bc-ab81e6ff02ce service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:08.487797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 663/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:03:10.898884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ba368-4903-484d-af57-8acd66a7166b None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:10.899456 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ba368-4903-484d-af57-8acd66a7166b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:10.899456 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ba368-4903-484d-af57-8acd66a7166b None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:10.900867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 649/1312] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:03:10.906788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72919550-3c85-4d9c-8c66-c6d961c162c4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:10.907577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72919550-3c85-4d9c-8c66-c6d961c162c4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:10.907577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72919550-3c85-4d9c-8c66-c6d961c162c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:10.996057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-72919550-3c85-4d9c-8c66-c6d961c162c4 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:10.997342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-72919550-3c85-4d9c-8c66-c6d961c162c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:11.098945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 664/1313] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:11.146200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ba368-4903-484d-af57-8acd66a7166b None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:11.147765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-779ba368-4903-484d-af57-8acd66a7166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:11.258203 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ba368-4903-484d-af57-8acd66a7166b None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:11.334065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:11.336820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148c57f-3a93-41d5-8c67-3e455b87a13f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:11.337535 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148c57f-3a93-41d5-8c67-3e455b87a13f service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:11.337818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148c57f-3a93-41d5-8c67-3e455b87a13f service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:11.338094 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148c57f-3a93-41d5-8c67-3e455b87a13f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:11.339743 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-8148c57f-3a93-41d5-8c67-3e455b87a13f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:11.451445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148c57f-3a93-41d5-8c67-3e455b87a13f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:11.452829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148c57f-3a93-41d5-8c67-3e455b87a13f service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:11.472904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 650/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:03:14.095261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bdf73-8c8e-46ba-a52a-c58a3b2e317b None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:14.095779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bdf73-8c8e-46ba-a52a-c58a3b2e317b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:14.095866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bdf73-8c8e-46ba-a52a-c58a3b2e317b None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:14.097241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 665/1315] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:14.102462 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3022279-7e4d-4886-933d-fa4b2835c8f9 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:14.102881 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3022279-7e4d-4886-933d-fa4b2835c8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:14.103017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3022279-7e4d-4886-933d-fa4b2835c8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:14.166948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-c3022279-7e4d-4886-933d-fa4b2835c8f9 None None] MFA Rules not processed for user `66aae726fe6c49fe9ae28384be5409f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:14.168061 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c3022279-7e4d-4886-933d-fa4b2835c8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:14.219070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:14.262071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 651/1316] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:14.302979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bdf73-8c8e-46ba-a52a-c58a3b2e317b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:14.304512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-516bdf73-8c8e-46ba-a52a-c58a3b2e317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:14.314856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:14.410674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bdf73-8c8e-46ba-a52a-c58a3b2e317b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:14.482279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874087a-5203-4ede-bed1-38b1f3c961c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:14.482924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874087a-5203-4ede-bed1-38b1f3c961c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:14.483208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874087a-5203-4ede-bed1-38b1f3c961c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:14.483489 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874087a-5203-4ede-bed1-38b1f3c961c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:14.485739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f874087a-5203-4ede-bed1-38b1f3c961c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:14.545353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:14.590370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874087a-5203-4ede-bed1-38b1f3c961c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:14.591797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874087a-5203-4ede-bed1-38b1f3c961c7 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:14.609957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 666/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:14 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:03:17.503830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33120239-705d-4f6b-9094-f02c17ec65dc None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:17.504357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33120239-705d-4f6b-9094-f02c17ec65dc None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:17.504478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33120239-705d-4f6b-9094-f02c17ec65dc None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:17.505791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 652/1318] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:17.511005 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4853-691a-412b-bdfe-0d18600ba360 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:17.511426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4853-691a-412b-bdfe-0d18600ba360 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:17.511573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e4853-691a-412b-bdfe-0d18600ba360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:17.581862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-5c8e4853-691a-412b-bdfe-0d18600ba360 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:17.583026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5c8e4853-691a-412b-bdfe-0d18600ba360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:17.678371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 667/1319] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:17.717253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33120239-705d-4f6b-9094-f02c17ec65dc None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:17.718795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-33120239-705d-4f6b-9094-f02c17ec65dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:17.822910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33120239-705d-4f6b-9094-f02c17ec65dc None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:17.900916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c44dd-6530-486a-8315-b9bc7fed6577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:17.901567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c44dd-6530-486a-8315-b9bc7fed6577 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:17.901850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c44dd-6530-486a-8315-b9bc7fed6577 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:17.902128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c44dd-6530-486a-8315-b9bc7fed6577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:17.903950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ec8c44dd-6530-486a-8315-b9bc7fed6577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:17.911575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:18.012092 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c44dd-6530-486a-8315-b9bc7fed6577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:18.013847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c44dd-6530-486a-8315-b9bc7fed6577 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:18.033499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 653/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:03:21.284062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a90b1-f59e-4690-a028-9d8c88875e15 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:21.284527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a90b1-f59e-4690-a028-9d8c88875e15 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:21.284612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a90b1-f59e-4690-a028-9d8c88875e15 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:21.286207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 668/1321] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:21.291252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bfefa-216a-4c8b-b893-8accd634e262 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:21.291713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bfefa-216a-4c8b-b893-8accd634e262 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:21.291816 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bfefa-216a-4c8b-b893-8accd634e262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:21.357605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-006bfefa-216a-4c8b-b893-8accd634e262 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:21.358812 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-006bfefa-216a-4c8b-b893-8accd634e262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:21.418349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:21.458487 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 654/1322] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:03:21.495828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a90b1-f59e-4690-a028-9d8c88875e15 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:21.497406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bb1a90b1-f59e-4690-a028-9d8c88875e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:21.518273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:21.613931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a90b1-f59e-4690-a028-9d8c88875e15 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:21.692868 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74c305-e46f-4482-8759-9687c88cc293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:21.693643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74c305-e46f-4482-8759-9687c88cc293 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:21.693932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74c305-e46f-4482-8759-9687c88cc293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:21.694209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74c305-e46f-4482-8759-9687c88cc293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:21.695911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0c74c305-e46f-4482-8759-9687c88cc293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:21.771318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:21.809059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74c305-e46f-4482-8759-9687c88cc293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:21.810549 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74c305-e46f-4482-8759-9687c88cc293 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:21.830307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 669/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:03:23.964049 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8b607-fd5b-4dba-9d33-f7eab973bb9d None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:23.964614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8b607-fd5b-4dba-9d33-f7eab973bb9d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:23.964614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8b607-fd5b-4dba-9d33-f7eab973bb9d None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:23.966029 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 655/1324] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:23.971386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a6a7b-c023-4844-9b8c-90e965e5c015 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:23.971791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a6a7b-c023-4844-9b8c-90e965e5c015 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:23.971952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a6a7b-c023-4844-9b8c-90e965e5c015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:24.037221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ed7a6a7b-c023-4844-9b8c-90e965e5c015 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:24.038372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ed7a6a7b-c023-4844-9b8c-90e965e5c015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:24.134887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 670/1325] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:24.170425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8b607-fd5b-4dba-9d33-f7eab973bb9d None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:24.172602 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-eba8b607-fd5b-4dba-9d33-f7eab973bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:24.274339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8b607-fd5b-4dba-9d33-f7eab973bb9d None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:24.347439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6dd58-c450-4b74-8060-e6f5ab956663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:24.348092 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6dd58-c450-4b74-8060-e6f5ab956663 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:24.348373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6dd58-c450-4b74-8060-e6f5ab956663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:24.348666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6dd58-c450-4b74-8060-e6f5ab956663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:24.350332 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7ee6dd58-c450-4b74-8060-e6f5ab956663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:24.367393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:24.462232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6dd58-c450-4b74-8060-e6f5ab956663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:24.463732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6dd58-c450-4b74-8060-e6f5ab956663 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:24.484002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 656/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:03:26.605196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464971f7-8f08-4f2e-bf41-0eeb0a328503 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:26.605723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464971f7-8f08-4f2e-bf41-0eeb0a328503 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:26.605816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464971f7-8f08-4f2e-bf41-0eeb0a328503 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:26.607117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 671/1327] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:26.613325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91b8c8-8058-43a7-a326-46722d258e46 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:26.613764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91b8c8-8058-43a7-a326-46722d258e46 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:26.613871 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91b8c8-8058-43a7-a326-46722d258e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:26.678507 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-dd91b8c8-8058-43a7-a326-46722d258e46 None None] MFA Rules not processed for user `66aae726fe6c49fe9ae28384be5409f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:26.679719 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-dd91b8c8-8058-43a7-a326-46722d258e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:26.745890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:26.780185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 657/1328] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:26.821069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464971f7-8f08-4f2e-bf41-0eeb0a328503 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:26.822856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-464971f7-8f08-4f2e-bf41-0eeb0a328503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:26.857625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:26.937319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464971f7-8f08-4f2e-bf41-0eeb0a328503 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:27.010846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f17dff-c802-47c4-9bdf-f0de94401eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:27.011497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17dff-c802-47c4-9bdf-f0de94401eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:27.011784 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17dff-c802-47c4-9bdf-f0de94401eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:27.012055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f17dff-c802-47c4-9bdf-f0de94401eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:27.013719 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-36f17dff-c802-47c4-9bdf-f0de94401eb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:27.093567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:27.129490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f17dff-c802-47c4-9bdf-f0de94401eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:27.130961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f17dff-c802-47c4-9bdf-f0de94401eb0 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:27.149078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 672/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:26 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:03:29.765445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2648ec9-1baa-46b9-9c7b-69b1625ec986 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:29.766600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2648ec9-1baa-46b9-9c7b-69b1625ec986 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:29.766732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2648ec9-1baa-46b9-9c7b-69b1625ec986 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:29.768131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 658/1330] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:29.773380 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee745b9-4d45-4d17-b7c9-182a3adbcf6d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:29.774067 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee745b9-4d45-4d17-b7c9-182a3adbcf6d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:29.774203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee745b9-4d45-4d17-b7c9-182a3adbcf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:29.838085 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8ee745b9-4d45-4d17-b7c9-182a3adbcf6d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:29.839303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8ee745b9-4d45-4d17-b7c9-182a3adbcf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:29.935572 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 673/1331] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:29.971349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2648ec9-1baa-46b9-9c7b-69b1625ec986 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:29.973033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d2648ec9-1baa-46b9-9c7b-69b1625ec986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:30.079133 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2648ec9-1baa-46b9-9c7b-69b1625ec986 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:30.150647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9672b1b-4488-4f58-919b-b7771b2390ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:30.151298 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9672b1b-4488-4f58-919b-b7771b2390ae service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:30.151585 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9672b1b-4488-4f58-919b-b7771b2390ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:30.151861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9672b1b-4488-4f58-919b-b7771b2390ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:30.153535 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b9672b1b-4488-4f58-919b-b7771b2390ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:30.180534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:30.260060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9672b1b-4488-4f58-919b-b7771b2390ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:30.261535 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9672b1b-4488-4f58-919b-b7771b2390ae service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:30.280013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 659/1332] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:03:32.348001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be379cb6-35b5-4cdc-8323-843f1edb56b8 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:32.348556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be379cb6-35b5-4cdc-8323-843f1edb56b8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:32.348669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be379cb6-35b5-4cdc-8323-843f1edb56b8 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:32.350075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 674/1333] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:32.355085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f9dd2-f977-4c3a-9d9e-7a30bc7aa06d None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:32.355525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f9dd2-f977-4c3a-9d9e-7a30bc7aa06d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:32.355643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f9dd2-f977-4c3a-9d9e-7a30bc7aa06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:32.419351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-da0f9dd2-f977-4c3a-9d9e-7a30bc7aa06d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:32.420597 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-da0f9dd2-f977-4c3a-9d9e-7a30bc7aa06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:32.505493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:32.529360 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 660/1334] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:32.582134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24c94f-5eb6-46a2-9138-2f1e84f3a7b8 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:32.582426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24c94f-5eb6-46a2-9138-2f1e84f3a7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:32.582707 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24c94f-5eb6-46a2-9138-2f1e84f3a7b8 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:32.584098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 675/1335] 10.222.0.16 () {54 vars in 964 bytes} [Thu Jun 23 13:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:32.589631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03449b-4e04-4043-b319-0cc645fe559f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:32.589923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03449b-4e04-4043-b319-0cc645fe559f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:32.590204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03449b-4e04-4043-b319-0cc645fe559f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:32.664310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-9e03449b-4e04-4043-b319-0cc645fe559f None None] MFA Rules not processed for user `83858713769b41af800bab317602bf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:32.665461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9e03449b-4e04-4043-b319-0cc645fe559f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:32.740138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 661/1336] 10.222.0.16 () {58 vars in 1061 bytes} [Thu Jun 23 13:03:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:32.749349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24c94f-5eb6-46a2-9138-2f1e84f3a7b8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:32.751015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4e24c94f-5eb6-46a2-9138-2f1e84f3a7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:32.790623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:32.858050 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24c94f-5eb6-46a2-9138-2f1e84f3a7b8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:32.932359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d58c9-955c-44c0-aeb8-5f64d9f317f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:32.932963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d58c9-955c-44c0-aeb8-5f64d9f317f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:32.933248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d58c9-955c-44c0-aeb8-5f64d9f317f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:32.933525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d58c9-955c-44c0-aeb8-5f64d9f317f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:32.935171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-163d58c9-955c-44c0-aeb8-5f64d9f317f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:33.017537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:33.042908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d58c9-955c-44c0-aeb8-5f64d9f317f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:33.044449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d58c9-955c-44c0-aeb8-5f64d9f317f8 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:33.061890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 676/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:03:36.265205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea887ca-eca6-4e32-b3ed-6be56298f457 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:36.265958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea887ca-eca6-4e32-b3ed-6be56298f457 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:36.265958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea887ca-eca6-4e32-b3ed-6be56298f457 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:36.267269 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 662/1338] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:36.272404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79466451-c350-4b28-953a-f606cb76b872 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:36.272850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79466451-c350-4b28-953a-f606cb76b872 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:36.272989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79466451-c350-4b28-953a-f606cb76b872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:36.337602 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-79466451-c350-4b28-953a-f606cb76b872 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:36.338812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-79466451-c350-4b28-953a-f606cb76b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:36.433303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 677/1339] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:36.469330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea887ca-eca6-4e32-b3ed-6be56298f457 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:36.470714 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2ea887ca-eca6-4e32-b3ed-6be56298f457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:36.547353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:36.574709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea887ca-eca6-4e32-b3ed-6be56298f457 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:36.646854 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae862c8-a141-4990-8e37-b8eb0f206eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:36.647494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae862c8-a141-4990-8e37-b8eb0f206eea service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:36.647776 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae862c8-a141-4990-8e37-b8eb0f206eea service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:36.648051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae862c8-a141-4990-8e37-b8eb0f206eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:36.649989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1ae862c8-a141-4990-8e37-b8eb0f206eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:36.757330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae862c8-a141-4990-8e37-b8eb0f206eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:36.758804 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae862c8-a141-4990-8e37-b8eb0f206eea service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:36.779665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 663/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:03:41.252366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852be15-53a8-4c08-8684-233738b2a637 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:41.252907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852be15-53a8-4c08-8684-233738b2a637 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:41.253020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852be15-53a8-4c08-8684-233738b2a637 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:41.254368 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 678/1341] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:41.259610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06856906-2d88-4d5a-8559-0a88aa014171 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:41.260026 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06856906-2d88-4d5a-8559-0a88aa014171 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:41.260170 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06856906-2d88-4d5a-8559-0a88aa014171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:41.266923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:41.345195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-06856906-2d88-4d5a-8559-0a88aa014171 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:41.346432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-06856906-2d88-4d5a-8559-0a88aa014171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:41.454288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 664/1342] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:41.493931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852be15-53a8-4c08-8684-233738b2a637 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:41.496083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3852be15-53a8-4c08-8684-233738b2a637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:41.552905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:41.604352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852be15-53a8-4c08-8684-233738b2a637 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:41.607935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d521cbc-e616-4ee6-8caf-76c98af6b52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:41.608590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d521cbc-e616-4ee6-8caf-76c98af6b52a service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:41.609488 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d521cbc-e616-4ee6-8caf-76c98af6b52a service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:41.609886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d521cbc-e616-4ee6-8caf-76c98af6b52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:41.619027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d521cbc-e616-4ee6-8caf-76c98af6b52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:41.620471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d521cbc-e616-4ee6-8caf-76c98af6b52a service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:41.630029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 679/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:03:44.673624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837d6e7-2a4c-4972-a86d-62b5334ad7f0 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:44.674180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837d6e7-2a4c-4972-a86d-62b5334ad7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:44.674180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837d6e7-2a4c-4972-a86d-62b5334ad7f0 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:44.675598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 665/1344] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:44.681529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c78f36-7142-4732-8fef-9556b3f2fd22 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:44.682103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c78f36-7142-4732-8fef-9556b3f2fd22 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:44.682103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c78f36-7142-4732-8fef-9556b3f2fd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:44.712178 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-65c78f36-7142-4732-8fef-9556b3f2fd22 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:44.713437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-65c78f36-7142-4732-8fef-9556b3f2fd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:44.795647 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 680/1345] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:44.833831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837d6e7-2a4c-4972-a86d-62b5334ad7f0 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:44.845561 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837d6e7-2a4c-4972-a86d-62b5334ad7f0 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:44.849207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f936b9-6661-40de-ac1a-2ca000b8c050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:44.849847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f936b9-6661-40de-ac1a-2ca000b8c050 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:44.850125 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f936b9-6661-40de-ac1a-2ca000b8c050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:44.850398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f936b9-6661-40de-ac1a-2ca000b8c050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:44.866168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f936b9-6661-40de-ac1a-2ca000b8c050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:44.867709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f936b9-6661-40de-ac1a-2ca000b8c050 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:44.878739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 666/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:03:49.217970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768306b8-ad61-4c9f-8754-69b57c6ddb9e None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:49.218627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768306b8-ad61-4c9f-8754-69b57c6ddb9e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:49.218921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768306b8-ad61-4c9f-8754-69b57c6ddb9e None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:49.221042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 681/1347] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:49.226806 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b76f4-e0c6-419c-b710-712b673f0b30 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:49.227274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b76f4-e0c6-419c-b710-712b673f0b30 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:49.227404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b76f4-e0c6-419c-b710-712b673f0b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:49.245709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-2f8b76f4-e0c6-419c-b710-712b673f0b30 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:49.246942 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2f8b76f4-e0c6-419c-b710-712b673f0b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:49.255103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 667/1348] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:49.293051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768306b8-ad61-4c9f-8754-69b57c6ddb9e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:03:49.305139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768306b8-ad61-4c9f-8754-69b57c6ddb9e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:03:49.308966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f2eb0-b69c-4a24-b532-ba346ab39eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:03:49.309608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f2eb0-b69c-4a24-b532-ba346ab39eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:49.309889 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f2eb0-b69c-4a24-b532-ba346ab39eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:49.310168 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f2eb0-b69c-4a24-b532-ba346ab39eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:49.319741 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f2eb0-b69c-4a24-b532-ba346ab39eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:03:49.321218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f2eb0-b69c-4a24-b532-ba346ab39eb0 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:03:49.331419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 682/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:03:54.358283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7a067-1294-46e2-a271-e5a92893bbf1 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:54.358805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7a067-1294-46e2-a271-e5a92893bbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:54.358805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7a067-1294-46e2-a271-e5a92893bbf1 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:54.361041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 668/1350] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:54.366210 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc703e-1e2b-4be6-b182-d7982052ec84 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:54.366663 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc703e-1e2b-4be6-b182-d7982052ec84 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:54.366970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dc703e-1e2b-4be6-b182-d7982052ec84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:54.477129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-38dc703e-1e2b-4be6-b182-d7982052ec84 None None] MFA Rules not processed for user `69b5745bfb5d4e6ca172bb8fab229e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:54.478512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-38dc703e-1e2b-4be6-b182-d7982052ec84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:54.507195 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:03:54.558161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 683/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:03:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:58.789276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3bb59-c7d0-4b42-9ce1-716fe190bfe3 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:58.790209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3bb59-c7d0-4b42-9ce1-716fe190bfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:58.790694 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3bb59-c7d0-4b42-9ce1-716fe190bfe3 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:58.792273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 669/1352] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:03:58.798180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2a025-e867-408e-a6a4-2599175fa96d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:03:58.799007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2a025-e867-408e-a6a4-2599175fa96d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:03:58.799577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2a025-e867-408e-a6a4-2599175fa96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:03:58.819201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2ca2a025-e867-408e-a6a4-2599175fa96d None None] MFA Rules not processed for user `69b5745bfb5d4e6ca172bb8fab229e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:03:58.820416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2ca2a025-e867-408e-a6a4-2599175fa96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:03:58.829342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 684/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:03:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:03:59.240781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=72 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:00.327709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1886f9-e81e-4a18-8baf-76853f065940 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:00.328474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1886f9-e81e-4a18-8baf-76853f065940 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:00.328555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1886f9-e81e-4a18-8baf-76853f065940 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:00.330138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 670/1354] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:00.334864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691f0ad-4817-4778-b09d-651d18851d5b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:00.335268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691f0ad-4817-4778-b09d-651d18851d5b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:00.335545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691f0ad-4817-4778-b09d-651d18851d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:00.354421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a691f0ad-4817-4778-b09d-651d18851d5b None None] MFA Rules not processed for user `69b5745bfb5d4e6ca172bb8fab229e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:00.362237 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a691f0ad-4817-4778-b09d-651d18851d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:00.365306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 685/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:04:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:04:04.068418 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ea75c-bab2-4018-a6b1-5cd6d6c3279b None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:04.069005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ea75c-bab2-4018-a6b1-5cd6d6c3279b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:04.069229 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ea75c-bab2-4018-a6b1-5cd6d6c3279b None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:04.070828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 671/1356] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:04.075949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1ac70-2b5c-4849-8e93-243669ec03f2 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:04.076399 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1ac70-2b5c-4849-8e93-243669ec03f2 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:04.076558 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1ac70-2b5c-4849-8e93-243669ec03f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:04.096367 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-85e1ac70-2b5c-4849-8e93-243669ec03f2 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:04.097670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-85e1ac70-2b5c-4849-8e93-243669ec03f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:04.106470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 686/1357] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:04.164127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746628fd-c1d3-4c6d-9198-f648b36d64fd None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:04.164991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746628fd-c1d3-4c6d-9198-f648b36d64fd None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:04.165489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746628fd-c1d3-4c6d-9198-f648b36d64fd None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:04.167312 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 672/1358] 10.222.0.16 () {54 vars in 961 bytes} [Thu Jun 23 13:04:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:04.176608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a32b4-acbf-41d5-83f9-13b3356eb488 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:04.176915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a32b4-acbf-41d5-83f9-13b3356eb488 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:04.186072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a32b4-acbf-41d5-83f9-13b3356eb488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:04.228817 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b19a32b4-acbf-41d5-83f9-13b3356eb488 None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:04.230296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b19a32b4-acbf-41d5-83f9-13b3356eb488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:04.322509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 687/1359] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Jun 23 13:04:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:04.330669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746628fd-c1d3-4c6d-9198-f648b36d64fd None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:04.346327 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746628fd-c1d3-4c6d-9198-f648b36d64fd None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:04.353176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c63a7-524e-4656-8df4-49953a6ed50a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:04.354015 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c63a7-524e-4656-8df4-49953a6ed50a service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:04.354571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c63a7-524e-4656-8df4-49953a6ed50a service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:04.355002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c63a7-524e-4656-8df4-49953a6ed50a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:04.364629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c63a7-524e-4656-8df4-49953a6ed50a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:04.366521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c63a7-524e-4656-8df4-49953a6ed50a service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:04.377000 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 673/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:06.839509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac9280-73bd-4789-9ca2-f3f8d7ebb4b0 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:06.840086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac9280-73bd-4789-9ca2-f3f8d7ebb4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:06.840086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac9280-73bd-4789-9ca2-f3f8d7ebb4b0 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:06.841640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 688/1361] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:06.847363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab203-9137-43cb-8a04-e783832bcddc None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:06.847818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab203-9137-43cb-8a04-e783832bcddc None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:06.847933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab203-9137-43cb-8a04-e783832bcddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:06.866453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-1b7ab203-9137-43cb-8a04-e783832bcddc None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:06.867904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1b7ab203-9137-43cb-8a04-e783832bcddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:06.876900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 674/1362] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:06.922696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac9280-73bd-4789-9ca2-f3f8d7ebb4b0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:06.941217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac9280-73bd-4789-9ca2-f3f8d7ebb4b0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:06.946793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffa52f-e730-49f0-aa13-b60bc4faee72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:06.947439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffa52f-e730-49f0-aa13-b60bc4faee72 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:06.947723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffa52f-e730-49f0-aa13-b60bc4faee72 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:06.948012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffa52f-e730-49f0-aa13-b60bc4faee72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:06.957519 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffa52f-e730-49f0-aa13-b60bc4faee72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:06.959122 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffa52f-e730-49f0-aa13-b60bc4faee72 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:06.970047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 689/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:09.555376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871b410-d643-4f27-ac47-bd7d72d741ab None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:09.555925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871b410-d643-4f27-ac47-bd7d72d741ab None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:09.556015 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871b410-d643-4f27-ac47-bd7d72d741ab None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:09.557376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 675/1364] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:09.562936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ca38f-398e-4ee1-a017-02328f7ad90f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:09.563341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ca38f-398e-4ee1-a017-02328f7ad90f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:09.563497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ca38f-398e-4ee1-a017-02328f7ad90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:09.581867 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-829ca38f-398e-4ee1-a017-02328f7ad90f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:09.583063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-829ca38f-398e-4ee1-a017-02328f7ad90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:09.590810 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 690/1365] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:09.636595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95f3c-19ba-4e2a-86b9-f809c3440ab1 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:09.636933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95f3c-19ba-4e2a-86b9-f809c3440ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:09.637214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b95f3c-19ba-4e2a-86b9-f809c3440ab1 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:09.638593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 676/1366] 10.222.0.16 () {54 vars in 961 bytes} [Thu Jun 23 13:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:09.645746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19607c01-891f-4153-bb30-fc5be839a1ec None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:09.646074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19607c01-891f-4153-bb30-fc5be839a1ec None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:09.646354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19607c01-891f-4153-bb30-fc5be839a1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:09.675038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-19607c01-891f-4153-bb30-fc5be839a1ec None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:09.676329 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-19607c01-891f-4153-bb30-fc5be839a1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:09.685631 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 691/1367] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Jun 23 13:04:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:09.694581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95f3c-19ba-4e2a-86b9-f809c3440ab1 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:09.709832 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b95f3c-19ba-4e2a-86b9-f809c3440ab1 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:09.715324 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391cf6b-470e-48b5-b61a-d70ca34526bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:09.715967 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391cf6b-470e-48b5-b61a-d70ca34526bc service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:09.716253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391cf6b-470e-48b5-b61a-d70ca34526bc service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:09.716538 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391cf6b-470e-48b5-b61a-d70ca34526bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:09.726108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391cf6b-470e-48b5-b61a-d70ca34526bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:09.727721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f391cf6b-470e-48b5-b61a-d70ca34526bc service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:09.738156 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 677/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:12.044241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dde546-f71a-4cff-a6fa-0d58c63181ef None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:12.044788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dde546-f71a-4cff-a6fa-0d58c63181ef None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:12.045117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dde546-f71a-4cff-a6fa-0d58c63181ef None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:12.047231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 692/1369] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:12.052427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24da6e-cd86-4175-957a-a3ee25370e10 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:12.053205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24da6e-cd86-4175-957a-a3ee25370e10 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:12.053494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24da6e-cd86-4175-957a-a3ee25370e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:12.071603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-9e24da6e-cd86-4175-957a-a3ee25370e10 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:12.072822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9e24da6e-cd86-4175-957a-a3ee25370e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:12.081571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 678/1370] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:12.125510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dde546-f71a-4cff-a6fa-0d58c63181ef None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:12.142074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dde546-f71a-4cff-a6fa-0d58c63181ef None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:12.147831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a50ea-5f0f-42b6-b55a-d90ee43463bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:12.148951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a50ea-5f0f-42b6-b55a-d90ee43463bf service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:12.149472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a50ea-5f0f-42b6-b55a-d90ee43463bf service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:12.149846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a50ea-5f0f-42b6-b55a-d90ee43463bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:12.160027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a50ea-5f0f-42b6-b55a-d90ee43463bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:12.161768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a50ea-5f0f-42b6-b55a-d90ee43463bf service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:12.172144 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 693/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:12.403389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33493dd1-0f3e-41a6-b248-5dff3a384408 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:12.403913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33493dd1-0f3e-41a6-b248-5dff3a384408 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:12.404434 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33493dd1-0f3e-41a6-b248-5dff3a384408 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:12.407717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 679/1372] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:12.414045 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67714d-bc9a-42af-aebd-d2009de01cb9 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:12.415099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67714d-bc9a-42af-aebd-d2009de01cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:12.415524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67714d-bc9a-42af-aebd-d2009de01cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:12.437195 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ba67714d-bc9a-42af-aebd-d2009de01cb9 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:12.438710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ba67714d-bc9a-42af-aebd-d2009de01cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:12.447302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 694/1373] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:12.832072 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39badda9-5f93-4a9d-973d-86cb592898c5 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:12.832446 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39badda9-5f93-4a9d-973d-86cb592898c5 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:12.832790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39badda9-5f93-4a9d-973d-86cb592898c5 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:12.834288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 680/1374] 10.222.0.16 () {54 vars in 963 bytes} [Thu Jun 23 13:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:12.839407 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb448d6-441e-4d43-b345-e48d911dc98d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:12.839702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb448d6-441e-4d43-b345-e48d911dc98d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:12.839986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb448d6-441e-4d43-b345-e48d911dc98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:12.848594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:12.897086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2bb448d6-441e-4d43-b345-e48d911dc98d None None] MFA Rules not processed for user `75e6ac80e76b41e4976f5a10daad85d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:12.898383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2bb448d6-441e-4d43-b345-e48d911dc98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:12.962099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 695/1375] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Jun 23 13:04:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:12.969702 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39badda9-5f93-4a9d-973d-86cb592898c5 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:12.980527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39badda9-5f93-4a9d-973d-86cb592898c5 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:12.984330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6fd8f-2ead-4788-8c54-62eed99fc9dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:12.985127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6fd8f-2ead-4788-8c54-62eed99fc9dc service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:12.985513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6fd8f-2ead-4788-8c54-62eed99fc9dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:12.985891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6fd8f-2ead-4788-8c54-62eed99fc9dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:12.995758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6fd8f-2ead-4788-8c54-62eed99fc9dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:12.997398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d6fd8f-2ead-4788-8c54-62eed99fc9dc service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:13.008122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 681/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:14.425003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd386-caae-44af-a250-19dce4c899cb None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:14.425567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd386-caae-44af-a250-19dce4c899cb None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:14.425654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3bd386-caae-44af-a250-19dce4c899cb None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:14.427014 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 696/1377] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:14.432349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e1e1f-72e5-46c3-84df-4227f7a6470d None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:14.432777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e1e1f-72e5-46c3-84df-4227f7a6470d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:14.433100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e1e1f-72e5-46c3-84df-4227f7a6470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:14.451848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e42e1e1f-72e5-46c3-84df-4227f7a6470d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:14.453205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e42e1e1f-72e5-46c3-84df-4227f7a6470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:14.461033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 682/1378] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:14.506044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bd386-caae-44af-a250-19dce4c899cb None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:14.521058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3bd386-caae-44af-a250-19dce4c899cb None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:14.526746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8deb32-8e3a-437d-9d8c-e1f21e3692d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:14.527382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8deb32-8e3a-437d-9d8c-e1f21e3692d1 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:14.527664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8deb32-8e3a-437d-9d8c-e1f21e3692d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:14.527938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8deb32-8e3a-437d-9d8c-e1f21e3692d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:14.537187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8deb32-8e3a-437d-9d8c-e1f21e3692d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:14.538795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8deb32-8e3a-437d-9d8c-e1f21e3692d1 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:14.549231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 697/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:16.789967 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc8cfa-b710-4021-905a-a32cbc36eafa None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:16.790484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc8cfa-b710-4021-905a-a32cbc36eafa None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:16.790565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cc8cfa-b710-4021-905a-a32cbc36eafa None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:16.791926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 683/1380] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:16.797997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454272ef-f2ef-44e7-8d76-7a5398f1d43f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:16.798426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454272ef-f2ef-44e7-8d76-7a5398f1d43f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:16.798937 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454272ef-f2ef-44e7-8d76-7a5398f1d43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:16.823808 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-454272ef-f2ef-44e7-8d76-7a5398f1d43f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:16.825049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-454272ef-f2ef-44e7-8d76-7a5398f1d43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:16.835058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 698/1381] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:16.884134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc8cfa-b710-4021-905a-a32cbc36eafa None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:16.899649 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cc8cfa-b710-4021-905a-a32cbc36eafa None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:16.904958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9060075-2b54-4e86-8c6e-c8535a3be023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:16.905652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9060075-2b54-4e86-8c6e-c8535a3be023 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:16.906020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9060075-2b54-4e86-8c6e-c8535a3be023 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:16.906296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9060075-2b54-4e86-8c6e-c8535a3be023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:16.914889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9060075-2b54-4e86-8c6e-c8535a3be023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:16.916463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9060075-2b54-4e86-8c6e-c8535a3be023 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:16.926666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 684/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:19.175472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647375ab-577b-482d-81b4-4e7481ebef94 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:19.176006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647375ab-577b-482d-81b4-4e7481ebef94 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:19.176006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647375ab-577b-482d-81b4-4e7481ebef94 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:19.177439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 699/1383] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:19.182695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4ae7-c0f7-4cde-9c9f-e7ed4678dacb None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:19.183159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4ae7-c0f7-4cde-9c9f-e7ed4678dacb None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:19.183269 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d4ae7-c0f7-4cde-9c9f-e7ed4678dacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:19.201771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-9d9d4ae7-c0f7-4cde-9c9f-e7ed4678dacb None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:19.203150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9d9d4ae7-c0f7-4cde-9c9f-e7ed4678dacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:19.211277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 685/1384] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:19.253328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647375ab-577b-482d-81b4-4e7481ebef94 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:19.268015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647375ab-577b-482d-81b4-4e7481ebef94 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:19.273500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e190ac-ccc1-4536-9d9f-a33ee2373631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:19.274404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e190ac-ccc1-4536-9d9f-a33ee2373631 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:19.274686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e190ac-ccc1-4536-9d9f-a33ee2373631 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:19.274964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e190ac-ccc1-4536-9d9f-a33ee2373631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:19.284022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e190ac-ccc1-4536-9d9f-a33ee2373631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:19.285643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e190ac-ccc1-4536-9d9f-a33ee2373631 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:19.294862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 700/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:21.426546 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b350d98-3868-4dea-ab81-fd07c842e807 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:21.427165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b350d98-3868-4dea-ab81-fd07c842e807 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:21.427597 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b350d98-3868-4dea-ab81-fd07c842e807 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:21.430290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 686/1386] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:21.439102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a84d1-e3aa-46f7-a4c6-c33393938016 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:21.439548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a84d1-e3aa-46f7-a4c6-c33393938016 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:21.439668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a84d1-e3aa-46f7-a4c6-c33393938016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:21.458751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-756a84d1-e3aa-46f7-a4c6-c33393938016 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:21.459970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-756a84d1-e3aa-46f7-a4c6-c33393938016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:21.468033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 701/1387] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:21.543472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b350d98-3868-4dea-ab81-fd07c842e807 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:21.560300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b350d98-3868-4dea-ab81-fd07c842e807 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:21.567376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41f3ad-c42c-4c1e-8f7c-65f6d47cfb8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:21.568179 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41f3ad-c42c-4c1e-8f7c-65f6d47cfb8f service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:21.568431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41f3ad-c42c-4c1e-8f7c-65f6d47cfb8f service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:21.568757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41f3ad-c42c-4c1e-8f7c-65f6d47cfb8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:21.579898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41f3ad-c42c-4c1e-8f7c-65f6d47cfb8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:21.582981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41f3ad-c42c-4c1e-8f7c-65f6d47cfb8f service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:21.600931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 687/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:04:23.887125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f521ce-215d-4fd3-aeb6-fab7c700e301 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:23.892344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f521ce-215d-4fd3-aeb6-fab7c700e301 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:23.892344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f521ce-215d-4fd3-aeb6-fab7c700e301 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:23.892344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 702/1389] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:23.894851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed05c07-f76b-49ad-b5f4-e557e54e08b1 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:23.895322 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed05c07-f76b-49ad-b5f4-e557e54e08b1 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:23.895431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed05c07-f76b-49ad-b5f4-e557e54e08b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:23.914641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-eed05c07-f76b-49ad-b5f4-e557e54e08b1 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:23.915869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-eed05c07-f76b-49ad-b5f4-e557e54e08b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:23.925060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 688/1390] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:23.970133 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f521ce-215d-4fd3-aeb6-fab7c700e301 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:23.986360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f521ce-215d-4fd3-aeb6-fab7c700e301 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:23.992755 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55068320-0a97-46b8-8227-6603b0d73b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:23.993452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55068320-0a97-46b8-8227-6603b0d73b70 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:23.993747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55068320-0a97-46b8-8227-6603b0d73b70 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:23.994018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55068320-0a97-46b8-8227-6603b0d73b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:24.003970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55068320-0a97-46b8-8227-6603b0d73b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:24.005606 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55068320-0a97-46b8-8227-6603b0d73b70 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:24.015644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 703/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:04:26.334045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04346bcc-9d31-4dd3-8c53-052a4f2c6aee None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:26.334669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04346bcc-9d31-4dd3-8c53-052a4f2c6aee None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:26.335159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04346bcc-9d31-4dd3-8c53-052a4f2c6aee None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:26.337969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 689/1392] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:26.343954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a4998-9d5e-430e-b939-e655c8904368 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:26.344729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a4998-9d5e-430e-b939-e655c8904368 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:26.344729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a4998-9d5e-430e-b939-e655c8904368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:26.364300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-249a4998-9d5e-430e-b939-e655c8904368 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:26.365731 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-249a4998-9d5e-430e-b939-e655c8904368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:26.375414 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 704/1393] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:26.425955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04346bcc-9d31-4dd3-8c53-052a4f2c6aee None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:26.442849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04346bcc-9d31-4dd3-8c53-052a4f2c6aee None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:26.449516 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129b9a7-7a63-4cac-82d1-fe63421af6dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:26.450271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129b9a7-7a63-4cac-82d1-fe63421af6dc service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:26.450588 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129b9a7-7a63-4cac-82d1-fe63421af6dc service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:26.450916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129b9a7-7a63-4cac-82d1-fe63421af6dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:26.461556 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129b9a7-7a63-4cac-82d1-fe63421af6dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:26.463454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129b9a7-7a63-4cac-82d1-fe63421af6dc service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:26.475240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 690/1394] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:28.669901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74bb22-1e73-480b-8f4f-2ca2826d594e None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:28.670525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74bb22-1e73-480b-8f4f-2ca2826d594e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:28.670631 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74bb22-1e73-480b-8f4f-2ca2826d594e None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:28.672136 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 705/1395] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:28.677396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d9cce-45c9-498d-81ff-161cbf4c2788 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:28.677858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d9cce-45c9-498d-81ff-161cbf4c2788 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:28.677962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d9cce-45c9-498d-81ff-161cbf4c2788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:28.696082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-755d9cce-45c9-498d-81ff-161cbf4c2788 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:28.697303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-755d9cce-45c9-498d-81ff-161cbf4c2788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:28.705991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 691/1396] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:28.721444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50632abb-143a-4f3d-8368-af6166628309 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:28.721821 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50632abb-143a-4f3d-8368-af6166628309 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:28.722164 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50632abb-143a-4f3d-8368-af6166628309 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:28.723622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 706/1397] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:28.728876 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8406b31-fdda-451d-8469-1cabb1e13005 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:28.729176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8406b31-fdda-451d-8469-1cabb1e13005 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:28.729459 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8406b31-fdda-451d-8469-1cabb1e13005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:28.747530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e8406b31-fdda-451d-8469-1cabb1e13005 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:28.749339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e8406b31-fdda-451d-8469-1cabb1e13005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:28.757517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 692/1398] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:28.763431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166490e-7a92-4b91-a936-5517100ab7c7 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:28.763721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166490e-7a92-4b91-a936-5517100ab7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:28.764004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166490e-7a92-4b91-a936-5517100ab7c7 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:28.766605 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 707/1399] 10.222.0.16 () {54 vars in 962 bytes} [Thu Jun 23 13:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:28.771804 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec285770-783f-45b9-8598-3c538ccb3289 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:28.772099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec285770-783f-45b9-8598-3c538ccb3289 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:28.772384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec285770-783f-45b9-8598-3c538ccb3289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:28.801563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166490e-7a92-4b91-a936-5517100ab7c7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:28.816190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166490e-7a92-4b91-a936-5517100ab7c7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:28.821543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f814f6e-d2a7-46c8-b94b-dee47be6d0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:28.822180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814f6e-d2a7-46c8-b94b-dee47be6d0eb service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:28.822466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814f6e-d2a7-46c8-b94b-dee47be6d0eb service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:28.822740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f814f6e-d2a7-46c8-b94b-dee47be6d0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:28.823897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ec285770-783f-45b9-8598-3c538ccb3289 None None] MFA Rules not processed for user `fe6832291d504cff9e787c0d791c70ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:28.825118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ec285770-783f-45b9-8598-3c538ccb3289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:28.831706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f814f6e-d2a7-46c8-b94b-dee47be6d0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:28.833307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f814f6e-d2a7-46c8-b94b-dee47be6d0eb service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:28.843307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 708/1400] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:04:28.887574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 693/1401] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Jun 23 13:04:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:28.896049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f814f6e-d2a7-46c8-b94b-dee47be6d0eb service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:28.905342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f814f6e-d2a7-46c8-b94b-dee47be6d0eb service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:28.908898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f34f9-f4d7-47ff-b3f5-ca7b804289a3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6832291d504cff9e787c0d791c70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:28.909529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f34f9-f4d7-47ff-b3f5-ca7b804289a3 service glance] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:28.909809 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f34f9-f4d7-47ff-b3f5-ca7b804289a3 service glance] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:28.910081 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f34f9-f4d7-47ff-b3f5-ca7b804289a3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:28.919030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f34f9-f4d7-47ff-b3f5-ca7b804289a3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:28.920550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f34f9-f4d7-47ff-b3f5-ca7b804289a3 service glance] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:28.930836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 709/1402] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:29.819015 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc6e0-60b5-4c7e-aa2c-cadde774946f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:29.819482 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc6e0-60b5-4c7e-aa2c-cadde774946f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:29.819637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cc6e0-60b5-4c7e-aa2c-cadde774946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:29.824783 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=96 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:29.877089 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-657cc6e0-60b5-4c7e-aa2c-cadde774946f None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:29.878287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-657cc6e0-60b5-4c7e-aa2c-cadde774946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:29.947364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 694/1403] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:04:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:29.994227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61ed6c-2467-466d-9f72-8c84455bf628 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:29.994713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61ed6c-2467-466d-9f72-8c84455bf628 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:29.994915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61ed6c-2467-466d-9f72-8c84455bf628 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:29.996401 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 710/1404] 10.222.0.16 () {54 vars in 942 bytes} [Thu Jun 23 13:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:30.003638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a5e30-5b46-4810-aaf7-0d3747ab3736 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:30.003937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a5e30-5b46-4810-aaf7-0d3747ab3736 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:30.004223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a5e30-5b46-4810-aaf7-0d3747ab3736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:30.056410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-166a5e30-5b46-4810-aaf7-0d3747ab3736 None None] MFA Rules not processed for user `599a53720ecd4e729a6720a85b653eb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:30.057644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-166a5e30-5b46-4810-aaf7-0d3747ab3736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:30.137382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 695/1405] 10.222.0.16 () {58 vars in 1039 bytes} [Thu Jun 23 13:04:30 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:30.147627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61ed6c-2467-466d-9f72-8c84455bf628 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:30.161404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61ed6c-2467-466d-9f72-8c84455bf628 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:30.166239 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c77454-7e13-4ea4-8d42-537d6b1d2bca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:30.166907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c77454-7e13-4ea4-8d42-537d6b1d2bca service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:30.167187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c77454-7e13-4ea4-8d42-537d6b1d2bca service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:30.167488 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c77454-7e13-4ea4-8d42-537d6b1d2bca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:30.176207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c77454-7e13-4ea4-8d42-537d6b1d2bca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:30.178017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c77454-7e13-4ea4-8d42-537d6b1d2bca service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:30.186871 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 711/1406] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:04:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:04:31.050749 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09efd-545f-4fd5-875c-a854558fa93f None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:31.051339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09efd-545f-4fd5-875c-a854558fa93f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:31.051339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc09efd-545f-4fd5-875c-a854558fa93f None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:31.052678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 696/1407] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:31.058019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70b646-9400-4935-99fe-8fc68b26e29f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:31.058813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70b646-9400-4935-99fe-8fc68b26e29f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:31.059101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70b646-9400-4935-99fe-8fc68b26e29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:31.081079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-da70b646-9400-4935-99fe-8fc68b26e29f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:31.083304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-da70b646-9400-4935-99fe-8fc68b26e29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:31.092960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 712/1408] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:31.136516 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc09efd-545f-4fd5-875c-a854558fa93f None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:31.152489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc09efd-545f-4fd5-875c-a854558fa93f None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:31.161641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdece8-d492-43e6-9027-b75383909136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:31.162293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdece8-d492-43e6-9027-b75383909136 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:31.162580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdece8-d492-43e6-9027-b75383909136 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:31.162862 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdece8-d492-43e6-9027-b75383909136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:31.172066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdece8-d492-43e6-9027-b75383909136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:31.173851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abdece8-d492-43e6-9027-b75383909136 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:31.184533 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 697/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:41.074041 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=84 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:41.179975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:04:54.017793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631fd41-1bee-4591-80fc-8a3743502998 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:54.018353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631fd41-1bee-4591-80fc-8a3743502998 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:54.018444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631fd41-1bee-4591-80fc-8a3743502998 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:54.019818 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 713/1410] 10.222.0.16 () {54 vars in 918 bytes} [Thu Jun 23 13:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:54.025403 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9dfac-b199-4bb9-90f9-56c21942fbb5 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:54.025806 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9dfac-b199-4bb9-90f9-56c21942fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:54.025958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca9dfac-b199-4bb9-90f9-56c21942fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:54.043779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-3ca9dfac-b199-4bb9-90f9-56c21942fbb5 None None] MFA Rules not processed for user `69b5745bfb5d4e6ca172bb8fab229e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:54.045710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-3ca9dfac-b199-4bb9-90f9-56c21942fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:54.054041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 698/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Jun 23 13:04:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:54.068347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c327bc-e7a8-4b84-b846-37e386f4de08 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:54.068644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c327bc-e7a8-4b84-b846-37e386f4de08 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:54.068955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c327bc-e7a8-4b84-b846-37e386f4de08 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:54.070306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 714/1412] 10.222.0.16 () {54 vars in 918 bytes} [Thu Jun 23 13:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:54.074633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5a48d-f80a-4ba7-8d48-e0668eaf9ea8 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:54.074918 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5a48d-f80a-4ba7-8d48-e0668eaf9ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:54.075195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5a48d-f80a-4ba7-8d48-e0668eaf9ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:54.094257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-1dc5a48d-f80a-4ba7-8d48-e0668eaf9ea8 None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:54.095492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1dc5a48d-f80a-4ba7-8d48-e0668eaf9ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:54.104385 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 699/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Jun 23 13:04:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:04:56.652039 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171bb85-46eb-4f47-b744-fc55dba29bf5 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:56.652600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171bb85-46eb-4f47-b744-fc55dba29bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:56.652600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2171bb85-46eb-4f47-b744-fc55dba29bf5 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:56.654601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 715/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:56.659891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96044f-769f-423b-a2bf-4b8075574548 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:56.660295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96044f-769f-423b-a2bf-4b8075574548 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:56.660453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96044f-769f-423b-a2bf-4b8075574548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:56.678604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-4b96044f-769f-423b-a2bf-4b8075574548 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:56.679791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4b96044f-769f-423b-a2bf-4b8075574548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:56.687727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 700/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:56.730475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171bb85-46eb-4f47-b744-fc55dba29bf5 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:56.745210 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2171bb85-46eb-4f47-b744-fc55dba29bf5 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:56.750966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614d4aa-04c4-4a17-a858-688dedf68d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:56.751607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d4aa-04c4-4a17-a858-688dedf68d76 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:56.751888 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d4aa-04c4-4a17-a858-688dedf68d76 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:56.752161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614d4aa-04c4-4a17-a858-688dedf68d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:56.760525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614d4aa-04c4-4a17-a858-688dedf68d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:56.762154 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4614d4aa-04c4-4a17-a858-688dedf68d76 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:56.771741 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 716/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:57.660901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dffa3-8ddc-4736-9576-88b7e2c77a3e None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:57.661432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dffa3-8ddc-4736-9576-88b7e2c77a3e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:57.661432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dffa3-8ddc-4736-9576-88b7e2c77a3e None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:57.662801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 701/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:57.667581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf393edb-4071-43b1-887a-ccd341cd29c4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:57.667958 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf393edb-4071-43b1-887a-ccd341cd29c4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:57.668137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf393edb-4071-43b1-887a-ccd341cd29c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:57.686667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bf393edb-4071-43b1-887a-ccd341cd29c4 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:57.687856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bf393edb-4071-43b1-887a-ccd341cd29c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:57.695452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 717/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:04:57.849313 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dffa3-8ddc-4736-9576-88b7e2c77a3e None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:57.864444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dffa3-8ddc-4736-9576-88b7e2c77a3e None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:57.870717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b3eaf-f3b6-4e74-a5c6-12ea3fc8f8e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:57.871423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3eaf-f3b6-4e74-a5c6-12ea3fc8f8e5 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:57.871707 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3eaf-f3b6-4e74-a5c6-12ea3fc8f8e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:57.872029 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b3eaf-f3b6-4e74-a5c6-12ea3fc8f8e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:57.881207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b3eaf-f3b6-4e74-a5c6-12ea3fc8f8e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:57.882801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b3eaf-f3b6-4e74-a5c6-12ea3fc8f8e5 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:57.892357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 702/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:58.781169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188e794-3144-474d-9d3a-4f4c63c09192 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:58.781772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188e794-3144-474d-9d3a-4f4c63c09192 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:58.781772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188e794-3144-474d-9d3a-4f4c63c09192 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:58.784166 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 718/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:04:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:58.789729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7e28d-fba3-4a5f-a7b1-94d491cc3b70 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:58.790193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7e28d-fba3-4a5f-a7b1-94d491cc3b70 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:58.790319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7e28d-fba3-4a5f-a7b1-94d491cc3b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:58.811702 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-24d7e28d-fba3-4a5f-a7b1-94d491cc3b70 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:58.812936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-24d7e28d-fba3-4a5f-a7b1-94d491cc3b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:58.821264 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 703/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:04:58.975238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188e794-3144-474d-9d3a-4f4c63c09192 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:04:58.989339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188e794-3144-474d-9d3a-4f4c63c09192 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:04:58.994719 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe2deb-d2f2-4752-bfae-bc561f5c67e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:04:58.995355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe2deb-d2f2-4752-bfae-bc561f5c67e9 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:58.995639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe2deb-d2f2-4752-bfae-bc561f5c67e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:58.995916 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe2deb-d2f2-4752-bfae-bc561f5c67e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:59.004506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe2deb-d2f2-4752-bfae-bc561f5c67e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:04:59.006136 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe2deb-d2f2-4752-bfae-bc561f5c67e9 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:04:59.016114 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 719/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:04:59.885244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9152af-d8e5-4726-a002-d825a37e91f6 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:59.885691 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9152af-d8e5-4726-a002-d825a37e91f6 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:59.885799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9152af-d8e5-4726-a002-d825a37e91f6 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:59.887192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 704/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:04:59.892214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f1c88-5b95-4b56-bbdb-d11475701c25 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:04:59.892669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f1c88-5b95-4b56-bbdb-d11475701c25 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:04:59.892780 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f1c88-5b95-4b56-bbdb-d11475701c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:04:59.910942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-282f1c88-5b95-4b56-bbdb-d11475701c25 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:04:59.912133 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-282f1c88-5b95-4b56-bbdb-d11475701c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:04:59.920326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 720/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:00.070836 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9152af-d8e5-4726-a002-d825a37e91f6 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:00.084866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9152af-d8e5-4726-a002-d825a37e91f6 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:00.090232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58682f-ac00-41da-b318-abe5e8e97cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:00.090870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58682f-ac00-41da-b318-abe5e8e97cd9 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:00.091151 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58682f-ac00-41da-b318-abe5e8e97cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:00.091430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58682f-ac00-41da-b318-abe5e8e97cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:00.099661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58682f-ac00-41da-b318-abe5e8e97cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:00.101286 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58682f-ac00-41da-b318-abe5e8e97cd9 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:00.111308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 705/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:00.986775 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc668e2d-a495-4767-8cd8-ff1f3ac4c56f None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:00.987325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc668e2d-a495-4767-8cd8-ff1f3ac4c56f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:00.987325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc668e2d-a495-4767-8cd8-ff1f3ac4c56f None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:00.988743 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 721/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:00.993780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042ecb8-08bc-4417-b392-1f238361e8b9 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:00.994200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042ecb8-08bc-4417-b392-1f238361e8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:00.994329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042ecb8-08bc-4417-b392-1f238361e8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:01.012077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-2042ecb8-08bc-4417-b392-1f238361e8b9 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:01.013449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2042ecb8-08bc-4417-b392-1f238361e8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:01.020988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 706/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:01.174085 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc668e2d-a495-4767-8cd8-ff1f3ac4c56f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:01.188761 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc668e2d-a495-4767-8cd8-ff1f3ac4c56f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:01.194078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c4dcb-1b35-4709-b9b9-720c105c382d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:01.194715 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4dcb-1b35-4709-b9b9-720c105c382d service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:01.195000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4dcb-1b35-4709-b9b9-720c105c382d service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:01.195277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4dcb-1b35-4709-b9b9-720c105c382d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:01.203976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c4dcb-1b35-4709-b9b9-720c105c382d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:01.205601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c4dcb-1b35-4709-b9b9-720c105c382d service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:01.214917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 722/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:02.147758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07b50-7f44-4bb9-ad02-92f09729f14c None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:02.148285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07b50-7f44-4bb9-ad02-92f09729f14c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:02.148285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07b50-7f44-4bb9-ad02-92f09729f14c None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:02.149887 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 707/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:05:02.155392 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9543b-358c-48f0-9181-12fc1ac69d34 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:02.155829 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9543b-358c-48f0-9181-12fc1ac69d34 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:02.155936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9543b-358c-48f0-9181-12fc1ac69d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:02.173857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-99f9543b-358c-48f0-9181-12fc1ac69d34 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:02.175096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-99f9543b-358c-48f0-9181-12fc1ac69d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:02.182845 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 723/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:02.334805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b07b50-7f44-4bb9-ad02-92f09729f14c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:02.349848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b07b50-7f44-4bb9-ad02-92f09729f14c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:02.355055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45954069-dade-478b-95b4-4f6f75494d7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:02.355681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45954069-dade-478b-95b4-4f6f75494d7b service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:02.355984 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45954069-dade-478b-95b4-4f6f75494d7b service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:02.356331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45954069-dade-478b-95b4-4f6f75494d7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:02.364593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45954069-dade-478b-95b4-4f6f75494d7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:02.369270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45954069-dade-478b-95b4-4f6f75494d7b service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:02.375684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 708/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:03.253762 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c570e5-594e-415f-b9d2-41a26448c93c None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:03.254294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c570e5-594e-415f-b9d2-41a26448c93c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:03.254294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c570e5-594e-415f-b9d2-41a26448c93c None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:03.255703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 724/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:03.260580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e146b-3919-433e-ada5-d3173422f8f0 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:03.261084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e146b-3919-433e-ada5-d3173422f8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:03.261190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e146b-3919-433e-ada5-d3173422f8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:03.279621 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-763e146b-3919-433e-ada5-d3173422f8f0 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:03.280819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-763e146b-3919-433e-ada5-d3173422f8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:03.288503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 709/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:03.440919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c570e5-594e-415f-b9d2-41a26448c93c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:03.455038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c570e5-594e-415f-b9d2-41a26448c93c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:03.460382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdeca32-9c31-426c-ae33-a76a29accefe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:03.461043 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdeca32-9c31-426c-ae33-a76a29accefe service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:03.461338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdeca32-9c31-426c-ae33-a76a29accefe service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:03.461612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdeca32-9c31-426c-ae33-a76a29accefe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:03.470399 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdeca32-9c31-426c-ae33-a76a29accefe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:03.472047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdeca32-9c31-426c-ae33-a76a29accefe service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:03.482293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 725/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:04.344477 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6a9b-50f1-4e45-a119-dd17c992b906 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:04.345122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6a9b-50f1-4e45-a119-dd17c992b906 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:04.345122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6a9b-50f1-4e45-a119-dd17c992b906 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:04.346452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 710/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:04.351792 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f9fb3-30f0-4f91-b459-04e47a992cc1 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:04.352203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f9fb3-30f0-4f91-b459-04e47a992cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:04.352359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f9fb3-30f0-4f91-b459-04e47a992cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:04.369970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f72f9fb3-30f0-4f91-b459-04e47a992cc1 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:04.371170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f72f9fb3-30f0-4f91-b459-04e47a992cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:04.379001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 726/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:04.531072 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff6a9b-50f1-4e45-a119-dd17c992b906 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:04.545812 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff6a9b-50f1-4e45-a119-dd17c992b906 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:04.551238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0c158-d74c-4920-85a6-b9c922738101 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:04.551872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0c158-d74c-4920-85a6-b9c922738101 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:04.552169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0c158-d74c-4920-85a6-b9c922738101 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:04.552442 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0c158-d74c-4920-85a6-b9c922738101 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:04.560825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0c158-d74c-4920-85a6-b9c922738101 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:04.562439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0c158-d74c-4920-85a6-b9c922738101 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:04.571758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 711/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:05.404401 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3590-d3e2-4cc0-bf6a-76febb89ccd3 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:05.404932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3590-d3e2-4cc0-bf6a-76febb89ccd3 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:05.405293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa3590-d3e2-4cc0-bf6a-76febb89ccd3 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:05.406696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 727/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:05.411558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b87f1-fd07-497f-8ba2-32f1878dd682 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:05.412002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b87f1-fd07-497f-8ba2-32f1878dd682 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:05.412142 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b87f1-fd07-497f-8ba2-32f1878dd682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:05.430312 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-f19b87f1-fd07-497f-8ba2-32f1878dd682 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:05.431501 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f19b87f1-fd07-497f-8ba2-32f1878dd682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:05.440058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 712/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:05.594561 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa3590-d3e2-4cc0-bf6a-76febb89ccd3 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:05.609712 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa3590-d3e2-4cc0-bf6a-76febb89ccd3 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:05.614962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19b21d-e10a-4e42-9851-4d650bd4866a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:05.615573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19b21d-e10a-4e42-9851-4d650bd4866a service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:05.615854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19b21d-e10a-4e42-9851-4d650bd4866a service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:05.616128 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19b21d-e10a-4e42-9851-4d650bd4866a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:05.624380 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19b21d-e10a-4e42-9851-4d650bd4866a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:05.625967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19b21d-e10a-4e42-9851-4d650bd4866a service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:05.635314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 728/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:07.712205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51863-cb1d-46dc-8946-88693a28eb1d None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:07.712735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51863-cb1d-46dc-8946-88693a28eb1d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:07.712735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f51863-cb1d-46dc-8946-88693a28eb1d None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:07.714091 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 713/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:07.720054 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854735f-4c40-4f57-bfac-08625cc28915 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:07.720506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854735f-4c40-4f57-bfac-08625cc28915 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:07.720616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3854735f-4c40-4f57-bfac-08625cc28915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:07.739037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3854735f-4c40-4f57-bfac-08625cc28915 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:07.740255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3854735f-4c40-4f57-bfac-08625cc28915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:07.748194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 729/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:07.795702 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f51863-cb1d-46dc-8946-88693a28eb1d None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:07.806761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f51863-cb1d-46dc-8946-88693a28eb1d None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:07.810342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4fbcb7-2c7f-4a4b-8550-7c055831ac8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:07.810960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fbcb7-2c7f-4a4b-8550-7c055831ac8d service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:07.811239 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fbcb7-2c7f-4a4b-8550-7c055831ac8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:07.811511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4fbcb7-2c7f-4a4b-8550-7c055831ac8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:07.821209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fbcb7-2c7f-4a4b-8550-7c055831ac8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:07.823012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4fbcb7-2c7f-4a4b-8550-7c055831ac8d service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:07.833516 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 714/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:10.144496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca7ab5-ef22-4259-9ffc-d4030dfe0b47 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:10.145030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca7ab5-ef22-4259-9ffc-d4030dfe0b47 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:10.145190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca7ab5-ef22-4259-9ffc-d4030dfe0b47 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:10.146579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 730/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:10.152114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080019d1-41dd-4d45-aaf4-ff9beaf62ce0 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:10.152537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080019d1-41dd-4d45-aaf4-ff9beaf62ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:10.152705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080019d1-41dd-4d45-aaf4-ff9beaf62ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:10.170293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-080019d1-41dd-4d45-aaf4-ff9beaf62ce0 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:10.171499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-080019d1-41dd-4d45-aaf4-ff9beaf62ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:10.179436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 715/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:10.218766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca7ab5-ef22-4259-9ffc-d4030dfe0b47 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:10.229332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca7ab5-ef22-4259-9ffc-d4030dfe0b47 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:10.233210 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee85d2b-0046-48aa-ab87-4b9f9c95d21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:10.233856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee85d2b-0046-48aa-ab87-4b9f9c95d21f service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:10.234140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee85d2b-0046-48aa-ab87-4b9f9c95d21f service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:10.234413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee85d2b-0046-48aa-ab87-4b9f9c95d21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:10.243541 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee85d2b-0046-48aa-ab87-4b9f9c95d21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:10.245008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee85d2b-0046-48aa-ab87-4b9f9c95d21f service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:10.255016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 731/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:12.650081 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ae01a-b443-4f12-9769-eeeaa781444e None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:12.650621 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ae01a-b443-4f12-9769-eeeaa781444e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:12.650621 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ae01a-b443-4f12-9769-eeeaa781444e None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:12.652164 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 716/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:12.658190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f400a04-a39c-47b2-8692-c2643bda7381 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:12.658601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f400a04-a39c-47b2-8692-c2643bda7381 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:12.658744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f400a04-a39c-47b2-8692-c2643bda7381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:12.676310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6f400a04-a39c-47b2-8692-c2643bda7381 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:12.677540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6f400a04-a39c-47b2-8692-c2643bda7381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:12.685454 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 732/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:12.724176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ae01a-b443-4f12-9769-eeeaa781444e None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:12.735158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ae01a-b443-4f12-9769-eeeaa781444e None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:12.738715 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c810d-0528-4089-a6a4-e279e377daac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:12.739336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c810d-0528-4089-a6a4-e279e377daac service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:12.739616 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c810d-0528-4089-a6a4-e279e377daac service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:12.739888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c810d-0528-4089-a6a4-e279e377daac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:12.748933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c810d-0528-4089-a6a4-e279e377daac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:12.750361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c810d-0528-4089-a6a4-e279e377daac service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:12.759557 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 717/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:14.950660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b03fa2-32b6-4a81-aad6-bdf8ab067378 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:14.951219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b03fa2-32b6-4a81-aad6-bdf8ab067378 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:14.951219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b03fa2-32b6-4a81-aad6-bdf8ab067378 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:14.952594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 733/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:14.957918 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91742f4e-fac0-44ac-9970-619953b7bdfd None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:14.958328 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91742f4e-fac0-44ac-9970-619953b7bdfd None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:14.958480 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91742f4e-fac0-44ac-9970-619953b7bdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:14.976581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-91742f4e-fac0-44ac-9970-619953b7bdfd None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:14.977798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-91742f4e-fac0-44ac-9970-619953b7bdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:14.985682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 718/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:15.024248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b03fa2-32b6-4a81-aad6-bdf8ab067378 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:15.035545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b03fa2-32b6-4a81-aad6-bdf8ab067378 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:15.039047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd7c2c-f55b-4c65-8839-711f00ad301e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:15.039686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd7c2c-f55b-4c65-8839-711f00ad301e service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:15.039973 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd7c2c-f55b-4c65-8839-711f00ad301e service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:15.040251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd7c2c-f55b-4c65-8839-711f00ad301e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:15.049326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd7c2c-f55b-4c65-8839-711f00ad301e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:15.050762 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd7c2c-f55b-4c65-8839-711f00ad301e service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:15.060105 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 734/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:17.141654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ee77f-c4b1-42ca-aaf1-78df340f8ba4 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:17.142177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ee77f-c4b1-42ca-aaf1-78df340f8ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:17.142177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ee77f-c4b1-42ca-aaf1-78df340f8ba4 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:17.143519 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 719/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:17.149126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473a594-b40c-43eb-9e55-19852ad93c89 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:17.149509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473a594-b40c-43eb-9e55-19852ad93c89 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:17.149686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473a594-b40c-43eb-9e55-19852ad93c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:17.168284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f473a594-b40c-43eb-9e55-19852ad93c89 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:17.169520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f473a594-b40c-43eb-9e55-19852ad93c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:17.177229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 735/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:17.215320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ee77f-c4b1-42ca-aaf1-78df340f8ba4 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:17.226124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87ee77f-c4b1-42ca-aaf1-78df340f8ba4 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:17.229674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4f9b2-fbdc-4b31-a5f3-3bc9cc2a463d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:17.230305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4f9b2-fbdc-4b31-a5f3-3bc9cc2a463d service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:17.230731 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4f9b2-fbdc-4b31-a5f3-3bc9cc2a463d service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:17.230990 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4f9b2-fbdc-4b31-a5f3-3bc9cc2a463d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:17.239815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4f9b2-fbdc-4b31-a5f3-3bc9cc2a463d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:17.241302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4f9b2-fbdc-4b31-a5f3-3bc9cc2a463d service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:17.250786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 720/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:05:19.323376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1b6ca-4f04-4cf8-be94-15da2c92a0b7 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:19.323918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1b6ca-4f04-4cf8-be94-15da2c92a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:19.324080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1b6ca-4f04-4cf8-be94-15da2c92a0b7 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:19.325432 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 736/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:19.330722 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5483b4f-eb94-4ae4-88b7-6a830d3a9ec9 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:19.331136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5483b4f-eb94-4ae4-88b7-6a830d3a9ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:19.331271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5483b4f-eb94-4ae4-88b7-6a830d3a9ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:19.349053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-a5483b4f-eb94-4ae4-88b7-6a830d3a9ec9 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:19.350235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-a5483b4f-eb94-4ae4-88b7-6a830d3a9ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:19.359432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 721/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:19.397507 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1b6ca-4f04-4cf8-be94-15da2c92a0b7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:19.399524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-12e1b6ca-4f04-4cf8-be94-15da2c92a0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:19.412297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1b6ca-4f04-4cf8-be94-15da2c92a0b7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:19.415753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c019dd-0a1a-4450-8f99-a6161c126006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:19.416385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c019dd-0a1a-4450-8f99-a6161c126006 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:19.416666 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c019dd-0a1a-4450-8f99-a6161c126006 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:19.416982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c019dd-0a1a-4450-8f99-a6161c126006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:19.426386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c019dd-0a1a-4450-8f99-a6161c126006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:19.427799 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c019dd-0a1a-4450-8f99-a6161c126006 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:19.438123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 737/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:21.617882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fe8f6-a0f6-42a2-8dae-019f24b1db97 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:21.618446 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fe8f6-a0f6-42a2-8dae-019f24b1db97 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:21.618446 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fe8f6-a0f6-42a2-8dae-019f24b1db97 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:21.619880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 722/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:21.626012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a72f3-17aa-4ed6-9364-a74af1157612 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:21.626443 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a72f3-17aa-4ed6-9364-a74af1157612 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:21.626566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a72f3-17aa-4ed6-9364-a74af1157612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:21.632630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=70 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:21.644656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-535a72f3-17aa-4ed6-9364-a74af1157612 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:21.645887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-535a72f3-17aa-4ed6-9364-a74af1157612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:21.654223 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 738/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:21.692111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fe8f6-a0f6-42a2-8dae-019f24b1db97 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:21.697493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=73 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:21.703569 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fe8f6-a0f6-42a2-8dae-019f24b1db97 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:21.707236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cc3c4-fe19-4671-975f-2b9fbd8505a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:21.707872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc3c4-fe19-4671-975f-2b9fbd8505a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:21.708156 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc3c4-fe19-4671-975f-2b9fbd8505a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:21.711624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc3c4-fe19-4671-975f-2b9fbd8505a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:21.717648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cc3c4-fe19-4671-975f-2b9fbd8505a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:21.719089 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cc3c4-fe19-4671-975f-2b9fbd8505a2 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:21.728423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 723/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:23.841573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07740746-fa93-4006-a71e-14bccc398d26 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:23.842508 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07740746-fa93-4006-a71e-14bccc398d26 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:23.842508 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07740746-fa93-4006-a71e-14bccc398d26 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:23.843796 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 739/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:23.849315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea282-cff3-4794-a84b-7e051a166b0c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:23.849748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea282-cff3-4794-a84b-7e051a166b0c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:23.849865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea282-cff3-4794-a84b-7e051a166b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:23.868640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-c54ea282-cff3-4794-a84b-7e051a166b0c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:23.869887 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c54ea282-cff3-4794-a84b-7e051a166b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:23.878201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 724/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:23.916520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07740746-fa93-4006-a71e-14bccc398d26 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:23.927324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07740746-fa93-4006-a71e-14bccc398d26 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:23.930853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830bab7-19f2-484f-9b32-d90e97d63e1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:23.931496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830bab7-19f2-484f-9b32-d90e97d63e1b service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:23.931783 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830bab7-19f2-484f-9b32-d90e97d63e1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:23.932062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830bab7-19f2-484f-9b32-d90e97d63e1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:23.941047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830bab7-19f2-484f-9b32-d90e97d63e1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:23.942477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830bab7-19f2-484f-9b32-d90e97d63e1b service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:23.952405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 740/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:26.023841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff098d7-8570-4b43-9f4c-d40f589bb008 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:26.024379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff098d7-8570-4b43-9f4c-d40f589bb008 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:26.024379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff098d7-8570-4b43-9f4c-d40f589bb008 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:26.025809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 725/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:26.031829 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5a28f-a446-4630-b044-aeec472f99ee None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:26.032267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5a28f-a446-4630-b044-aeec472f99ee None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:26.032394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5a28f-a446-4630-b044-aeec472f99ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:26.050961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-5db5a28f-a446-4630-b044-aeec472f99ee None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:26.052143 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5db5a28f-a446-4630-b044-aeec472f99ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:26.060043 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 741/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:26.097234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff098d7-8570-4b43-9f4c-d40f589bb008 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:26.108039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff098d7-8570-4b43-9f4c-d40f589bb008 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:26.111532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc680a-6c43-490c-9f52-4158e6df970c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:26.112162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc680a-6c43-490c-9f52-4158e6df970c service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:26.112448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc680a-6c43-490c-9f52-4158e6df970c service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:26.112725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc680a-6c43-490c-9f52-4158e6df970c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:26.121676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc680a-6c43-490c-9f52-4158e6df970c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:26.123054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc680a-6c43-490c-9f52-4158e6df970c service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:26.132384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 726/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:28.192224 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebe1f1-b9ff-4944-b391-d0b0893a9a2f None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:28.192758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebe1f1-b9ff-4944-b391-d0b0893a9a2f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:28.192758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebe1f1-b9ff-4944-b391-d0b0893a9a2f None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:28.194145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 742/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:28.199957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8f7cc-c4ff-48a3-9a65-2333c191ced8 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:28.200370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8f7cc-c4ff-48a3-9a65-2333c191ced8 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:28.200547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8f7cc-c4ff-48a3-9a65-2333c191ced8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:28.218116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-79d8f7cc-c4ff-48a3-9a65-2333c191ced8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:28.219314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-79d8f7cc-c4ff-48a3-9a65-2333c191ced8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:28.227139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 727/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:28.263843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebe1f1-b9ff-4944-b391-d0b0893a9a2f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:28.274629 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebe1f1-b9ff-4944-b391-d0b0893a9a2f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:28.278449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7471c6-82f9-493f-8a7b-162982dddaf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:28.279084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7471c6-82f9-493f-8a7b-162982dddaf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:28.279368 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7471c6-82f9-493f-8a7b-162982dddaf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:28.279643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7471c6-82f9-493f-8a7b-162982dddaf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:28.288373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7471c6-82f9-493f-8a7b-162982dddaf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:28.289907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7471c6-82f9-493f-8a7b-162982dddaf1 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:28.299390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 743/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:38.213140 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=17 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:38.295283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=17 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:05:48.405690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3707-f8de-48ff-8398-5f2f1110e1f2 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:48.406241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3707-f8de-48ff-8398-5f2f1110e1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:48.406241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a3707-f8de-48ff-8398-5f2f1110e1f2 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:48.407627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 728/1471] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:05:48.413159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3f163-3da5-4002-b886-420ebbfe472c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:48.413583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3f163-3da5-4002-b886-420ebbfe472c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:48.413709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3f163-3da5-4002-b886-420ebbfe472c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:48.432514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b6c3f163-3da5-4002-b886-420ebbfe472c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:48.433753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b6c3f163-3da5-4002-b886-420ebbfe472c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:48.441445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 744/1472] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:48.493124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a8027-304d-48c3-8d55-9f2f50fcd295 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:48.493417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a8027-304d-48c3-8d55-9f2f50fcd295 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:48.493701 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a8027-304d-48c3-8d55-9f2f50fcd295 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:48.495106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 729/1473] 10.222.0.16 () {54 vars in 962 bytes} [Thu Jun 23 13:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:48.500008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152a21-4be8-4128-811a-42ff5e9d4a65 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:48.500299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152a21-4be8-4128-811a-42ff5e9d4a65 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:48.500580 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152a21-4be8-4128-811a-42ff5e9d4a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:48.518476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e3152a21-4be8-4128-811a-42ff5e9d4a65 None None] MFA Rules not processed for user `fe6832291d504cff9e787c0d791c70ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:48.519651 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e3152a21-4be8-4128-811a-42ff5e9d4a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:48.527084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 745/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Thu Jun 23 13:05:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:48.534516 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a8027-304d-48c3-8d55-9f2f50fcd295 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:48.545690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a8027-304d-48c3-8d55-9f2f50fcd295 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:48.549175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c57fe-341c-4cad-b1d0-37c096be1066 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6832291d504cff9e787c0d791c70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:48.549800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c57fe-341c-4cad-b1d0-37c096be1066 service glance] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:48.550087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c57fe-341c-4cad-b1d0-37c096be1066 service glance] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:48.550366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c57fe-341c-4cad-b1d0-37c096be1066 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:48.559167 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c57fe-341c-4cad-b1d0-37c096be1066 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:48.560604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c57fe-341c-4cad-b1d0-37c096be1066 service glance] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:48.569913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 730/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:50.683213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7822c-e5ab-4d22-b353-58b10ec259fa None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:50.683783 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7822c-e5ab-4d22-b353-58b10ec259fa None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:50.683783 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7822c-e5ab-4d22-b353-58b10ec259fa None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:50.685189 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 746/1476] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:50.690300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b1aa0-da77-4f74-aff2-3f1e9671214f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:50.690675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b1aa0-da77-4f74-aff2-3f1e9671214f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:50.690952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b1aa0-da77-4f74-aff2-3f1e9671214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:50.709013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-190b1aa0-da77-4f74-aff2-3f1e9671214f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:50.710198 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-190b1aa0-da77-4f74-aff2-3f1e9671214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:50.718009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 731/1477] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:50.741316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7822c-e5ab-4d22-b353-58b10ec259fa None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:50.754126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7822c-e5ab-4d22-b353-58b10ec259fa None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:50.758533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351cf3de-e930-42b1-a4d8-6f0d3cc7e611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:50.759180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cf3de-e930-42b1-a4d8-6f0d3cc7e611 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:50.759462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cf3de-e930-42b1-a4d8-6f0d3cc7e611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:50.759738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cf3de-e930-42b1-a4d8-6f0d3cc7e611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:50.761087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cf3de-e930-42b1-a4d8-6f0d3cc7e611 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:50.762873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-351cf3de-e930-42b1-a4d8-6f0d3cc7e611 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:05:50.762873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 23 13:05:50.762873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: Jun 23 13:05:50.764004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351cf3de-e930-42b1-a4d8-6f0d3cc7e611 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:50.782892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 747/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Thu Jun 23 13:05:50 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:05:52.837560 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e9863-b44a-4f3d-bbd1-946c87ec3af9 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:52.838684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e9863-b44a-4f3d-bbd1-946c87ec3af9 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:52.838684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e9863-b44a-4f3d-bbd1-946c87ec3af9 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:52.839988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 732/1479] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:05:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:52.845116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cd809-fc75-4983-9e71-c16473ef6b91 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:52.845543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cd809-fc75-4983-9e71-c16473ef6b91 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:52.845684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cd809-fc75-4983-9e71-c16473ef6b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:52.864103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-990cd809-fc75-4983-9e71-c16473ef6b91 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:52.865615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-990cd809-fc75-4983-9e71-c16473ef6b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:52.873304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 748/1480] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:52.916663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e9863-b44a-4f3d-bbd1-946c87ec3af9 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:52.931331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e9863-b44a-4f3d-bbd1-946c87ec3af9 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:52.936988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbef0a6-13ef-4cb0-a3f0-5ae94ab163db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:52.937633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef0a6-13ef-4cb0-a3f0-5ae94ab163db service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:52.937916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef0a6-13ef-4cb0-a3f0-5ae94ab163db service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:52.938192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbef0a6-13ef-4cb0-a3f0-5ae94ab163db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:52.946407 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbef0a6-13ef-4cb0-a3f0-5ae94ab163db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:52.948039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbef0a6-13ef-4cb0-a3f0-5ae94ab163db service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:52.957434 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 733/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:55.200021 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6d5ce-2c42-4f04-8da6-2aa143a62734 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:55.200532 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6d5ce-2c42-4f04-8da6-2aa143a62734 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:55.200532 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6d5ce-2c42-4f04-8da6-2aa143a62734 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:55.201903 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 749/1482] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:55.207240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd9449-0765-4575-8de6-d0bb5ebbe276 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:55.207658 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd9449-0765-4575-8de6-d0bb5ebbe276 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:55.207807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd9449-0765-4575-8de6-d0bb5ebbe276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:55.225866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ebdd9449-0765-4575-8de6-d0bb5ebbe276 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:55.227053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ebdd9449-0765-4575-8de6-d0bb5ebbe276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:55.235492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 734/1483] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:55.271111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6d5ce-2c42-4f04-8da6-2aa143a62734 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:55.282899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6d5ce-2c42-4f04-8da6-2aa143a62734 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:55.286404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836506f-2304-4f8d-94a2-f2754f248c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:55.287042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836506f-2304-4f8d-94a2-f2754f248c63 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:55.287325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836506f-2304-4f8d-94a2-f2754f248c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:55.287603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836506f-2304-4f8d-94a2-f2754f248c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:55.297213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836506f-2304-4f8d-94a2-f2754f248c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:55.298632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5836506f-2304-4f8d-94a2-f2754f248c63 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:55.308146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 750/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:57.398326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d7afb-6d13-47a0-bf2d-338aacd0725d None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:57.399045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d7afb-6d13-47a0-bf2d-338aacd0725d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:57.399175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d7afb-6d13-47a0-bf2d-338aacd0725d None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:57.401164 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 735/1485] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:57.406366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383dd03-0312-4b3f-aa51-223f9457454b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:57.408082 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383dd03-0312-4b3f-aa51-223f9457454b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:57.408082 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383dd03-0312-4b3f-aa51-223f9457454b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:57.425270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9383dd03-0312-4b3f-aa51-223f9457454b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:57.426462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9383dd03-0312-4b3f-aa51-223f9457454b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:57.434527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 751/1486] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:57.472469 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d7afb-6d13-47a0-bf2d-338aacd0725d None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:57.483715 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d7afb-6d13-47a0-bf2d-338aacd0725d None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:57.487257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dce81-0cd6-4c72-82ef-2f732e2fdaa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:57.487890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dce81-0cd6-4c72-82ef-2f732e2fdaa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:57.488174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dce81-0cd6-4c72-82ef-2f732e2fdaa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:57.488454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dce81-0cd6-4c72-82ef-2f732e2fdaa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:57.497474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dce81-0cd6-4c72-82ef-2f732e2fdaa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:57.498908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dce81-0cd6-4c72-82ef-2f732e2fdaa1 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:57.508202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 736/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:05:59.702912 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734cf06-2c8b-42b1-b76e-deb179f8104a None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:59.703438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734cf06-2c8b-42b1-b76e-deb179f8104a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:59.703583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734cf06-2c8b-42b1-b76e-deb179f8104a None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:59.705602 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 752/1488] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:05:59.711584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e28e64-2db1-41ff-9755-891913013af2 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:59.712078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e28e64-2db1-41ff-9755-891913013af2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:59.712237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e28e64-2db1-41ff-9755-891913013af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:59.730450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-66e28e64-2db1-41ff-9755-891913013af2 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:05:59.731646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-66e28e64-2db1-41ff-9755-891913013af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:05:59.739521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 737/1489] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:05:59.781349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734cf06-2c8b-42b1-b76e-deb179f8104a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:05:59.792072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734cf06-2c8b-42b1-b76e-deb179f8104a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:05:59.795603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714c843-6f48-4aa6-bb38-c5d02dac6c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:05:59.796243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714c843-6f48-4aa6-bb38-c5d02dac6c8e service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:05:59.796529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714c843-6f48-4aa6-bb38-c5d02dac6c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:05:59.796829 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714c843-6f48-4aa6-bb38-c5d02dac6c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:05:59.805752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714c843-6f48-4aa6-bb38-c5d02dac6c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:05:59.807700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714c843-6f48-4aa6-bb38-c5d02dac6c8e service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:05:59.817157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 753/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:06:02.216861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea7c17-1336-4110-b029-1453e5fc4b26 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:02.217429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea7c17-1336-4110-b029-1453e5fc4b26 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:02.217429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea7c17-1336-4110-b029-1453e5fc4b26 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:02.218725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 738/1491] 10.222.0.16 () {54 vars in 926 bytes} [Thu Jun 23 13:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:06:02.223966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2c40a-01cf-486f-8a36-f11a5c9907b7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:02.224435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2c40a-01cf-486f-8a36-f11a5c9907b7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:02.224546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2c40a-01cf-486f-8a36-f11a5c9907b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:02.242038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-deb2c40a-01cf-486f-8a36-f11a5c9907b7 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:06:02.243238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-deb2c40a-01cf-486f-8a36-f11a5c9907b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:06:02.251000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 754/1492] 10.222.0.16 () {58 vars in 1023 bytes} [Thu Jun 23 13:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:06:02.290313 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea7c17-1336-4110-b029-1453e5fc4b26 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:06:02.301383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea7c17-1336-4110-b029-1453e5fc4b26 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:06:02.305003 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c762f-1952-4be0-8c10-1c6320798664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:06:02.305643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c762f-1952-4be0-8c10-1c6320798664 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:06:02.305927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c762f-1952-4be0-8c10-1c6320798664 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:06:02.306205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c762f-1952-4be0-8c10-1c6320798664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:06:02.315370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c762f-1952-4be0-8c10-1c6320798664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:06:02.316824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c762f-1952-4be0-8c10-1c6320798664 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:06:02.326972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 739/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:06:12.237008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=33 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:06:12.322415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=33 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:08:05.240615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b79dc5-bf9e-4708-acee-adfdec54c109 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:05.241251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b79dc5-bf9e-4708-acee-adfdec54c109 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:05.241251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b79dc5-bf9e-4708-acee-adfdec54c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:05.259382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-33b79dc5-bf9e-4708-acee-adfdec54c109 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:08:05.260570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-33b79dc5-bf9e-4708-acee-adfdec54c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:08:05.269665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 755/1494] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:08:05.279054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916db17-55f2-4fac-8ac3-f3636a3bbf13 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:05.279545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916db17-55f2-4fac-8ac3-f3636a3bbf13 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:05.279648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916db17-55f2-4fac-8ac3-f3636a3bbf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:05.298142 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-7916db17-55f2-4fac-8ac3-f3636a3bbf13 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:08:05.299357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7916db17-55f2-4fac-8ac3-f3636a3bbf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:08:05.307233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 740/1495] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:08:05.311558 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b79dc5-bf9e-4708-acee-adfdec54c109 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:08:05.321657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b79dc5-bf9e-4708-acee-adfdec54c109 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:08:05.326173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578ca2c-803b-430d-afb3-6ba8236b31c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:08:05.326823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578ca2c-803b-430d-afb3-6ba8236b31c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:05.327112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578ca2c-803b-430d-afb3-6ba8236b31c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:05.327391 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578ca2c-803b-430d-afb3-6ba8236b31c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:05.328114 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578ca2c-803b-430d-afb3-6ba8236b31c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:08:05.328429 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578ca2c-803b-430d-afb3-6ba8236b31c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:08:05.329492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-0578ca2c-803b-430d-afb3-6ba8236b31c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:08:05.329492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 23 13:08:05.329492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: Jun 23 13:08:05.330372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578ca2c-803b-430d-afb3-6ba8236b31c2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:08:05.342281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 756/1496] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:08:05.350550 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916db17-55f2-4fac-8ac3-f3636a3bbf13 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:08:05.359570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916db17-55f2-4fac-8ac3-f3636a3bbf13 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:08:05.364114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77997cb-5a45-4685-9ba4-0167a8aecc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:08:05.364756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77997cb-5a45-4685-9ba4-0167a8aecc1c admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:05.365075 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77997cb-5a45-4685-9ba4-0167a8aecc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:05.365356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77997cb-5a45-4685-9ba4-0167a8aecc1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:05.366045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77997cb-5a45-4685-9ba4-0167a8aecc1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:08:05.367809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: WARNING py.warnings [None req-d77997cb-5a45-4685-9ba4-0167a8aecc1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:08:05.367809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: warnings.warn(msg) Jun 23 13:08:05.367809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: Jun 23 13:08:05.369043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77997cb-5a45-4685-9ba4-0167a8aecc1c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:08:05.472419 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 741/1497] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:08:05 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:08:05.476830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578ca2c-803b-430d-afb3-6ba8236b31c2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:08:05.486643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578ca2c-803b-430d-afb3-6ba8236b31c2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:08:05.542530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937bc45-ade3-407c-915d-22ddde22af9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:08:05.543125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937bc45-ade3-407c-915d-22ddde22af9a admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:05.543410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937bc45-ade3-407c-915d-22ddde22af9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:05.543682 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937bc45-ade3-407c-915d-22ddde22af9a admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:05.544362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937bc45-ade3-407c-915d-22ddde22af9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:08:05.545406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-8937bc45-ade3-407c-915d-22ddde22af9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:08:05.545406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 23 13:08:05.545406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: Jun 23 13:08:05.546610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937bc45-ade3-407c-915d-22ddde22af9a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:08:05.620154 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 757/1498] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:08:05 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:08:05.624256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77997cb-5a45-4685-9ba4-0167a8aecc1c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:08:05.635215 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77997cb-5a45-4685-9ba4-0167a8aecc1c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:08:05.639837 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc32a7-c560-42f8-99fa-abff35b64894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:08:05.640616 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc32a7-c560-42f8-99fa-abff35b64894 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:05.641592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc32a7-c560-42f8-99fa-abff35b64894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:05.641592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc32a7-c560-42f8-99fa-abff35b64894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:05.641986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc32a7-c560-42f8-99fa-abff35b64894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:08:05.643044 dv-cinder-847335-1-smb devstack@keystone.service[80298]: WARNING py.warnings [None req-5fcc32a7-c560-42f8-99fa-abff35b64894 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:08:05.643044 dv-cinder-847335-1-smb devstack@keystone.service[80298]: warnings.warn(msg) Jun 23 13:08:05.643044 dv-cinder-847335-1-smb devstack@keystone.service[80298]: Jun 23 13:08:05.644112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc32a7-c560-42f8-99fa-abff35b64894 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:08:05.657102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 742/1499] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:08:05.661506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937bc45-ade3-407c-915d-22ddde22af9a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:08:05.671251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937bc45-ade3-407c-915d-22ddde22af9a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:08:05.676322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe807924-e32b-404a-91cf-c9b08302e698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:08:05.677000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe807924-e32b-404a-91cf-c9b08302e698 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:05.677281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe807924-e32b-404a-91cf-c9b08302e698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:05.677553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe807924-e32b-404a-91cf-c9b08302e698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:05.678331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe807924-e32b-404a-91cf-c9b08302e698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:08:05.679299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-fe807924-e32b-404a-91cf-c9b08302e698 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:08:05.679299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 23 13:08:05.679299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: Jun 23 13:08:05.680170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe807924-e32b-404a-91cf-c9b08302e698 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:08:05.694278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 758/1500] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:08:05.698214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc32a7-c560-42f8-99fa-abff35b64894 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:08:05.708587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc32a7-c560-42f8-99fa-abff35b64894 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:08:05.713121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c1051-a9a7-4503-b50a-35108b8dcd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:08:05.713994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c1051-a9a7-4503-b50a-35108b8dcd0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:05.714286 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c1051-a9a7-4503-b50a-35108b8dcd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:05.714558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c1051-a9a7-4503-b50a-35108b8dcd0b admin admin] PATH_INFO: `/v3/projects/461bbda7fc7046919fffa50694c927be/users/db697fa4715149e284c92d9e6d8b4698/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:05.729258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c1051-a9a7-4503-b50a-35108b8dcd0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=461bbda7fc7046919fffa50694c927be, user_id=db697fa4715149e284c92d9e6d8b4698, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:08:05.730298 dv-cinder-847335-1-smb devstack@keystone.service[80298]: WARNING py.warnings [None req-9c7c1051-a9a7-4503-b50a-35108b8dcd0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:08:05.730298 dv-cinder-847335-1-smb devstack@keystone.service[80298]: warnings.warn(msg) Jun 23 13:08:05.730298 dv-cinder-847335-1-smb devstack@keystone.service[80298]: Jun 23 13:08:05.732206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c1051-a9a7-4503-b50a-35108b8dcd0b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:08:05.827063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 743/1501] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:08:05 2022] PUT /identity/v3/projects/461bbda7fc7046919fffa50694c927be/users/db697fa4715149e284c92d9e6d8b4698/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:08:05.838331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8de3-c0e8-4773-b479-90c171bb2bca None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:05.838627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8de3-c0e8-4773-b479-90c171bb2bca None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:05.838910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adf8de3-c0e8-4773-b479-90c171bb2bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:05.866248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-5adf8de3-c0e8-4773-b479-90c171bb2bca None None] MFA Rules not processed for user `db697fa4715149e284c92d9e6d8b4698`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:08:05.867230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5adf8de3-c0e8-4773-b479-90c171bb2bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:08:05.930936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 759/1502] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:08:05.944525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490ed58-e825-40f4-8eed-bed47a777b64 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:05.944835 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490ed58-e825-40f4-8eed-bed47a777b64 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:05.945303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490ed58-e825-40f4-8eed-bed47a777b64 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:05.946647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 744/1503] 10.222.0.16 () {54 vars in 963 bytes} [Thu Jun 23 13:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:08:05.951483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec693a5f-8564-4e66-952f-f8cc72fc9fd6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:05.951778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec693a5f-8564-4e66-952f-f8cc72fc9fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:05.952064 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec693a5f-8564-4e66-952f-f8cc72fc9fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:05.970968 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ec693a5f-8564-4e66-952f-f8cc72fc9fd6 None None] MFA Rules not processed for user `75e6ac80e76b41e4976f5a10daad85d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:08:05.972708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ec693a5f-8564-4e66-952f-f8cc72fc9fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:08:06.017264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:08:06.024961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 760/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Thu Jun 23 13:08:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:08:06.032889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490ed58-e825-40f4-8eed-bed47a777b64 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:08:06.044216 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490ed58-e825-40f4-8eed-bed47a777b64 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:08:06.047712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d88d8-3ac8-4435-9b62-894df545b20f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:08:06.048334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d88d8-3ac8-4435-9b62-894df545b20f service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:06.048665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d88d8-3ac8-4435-9b62-894df545b20f service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:06.048976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d88d8-3ac8-4435-9b62-894df545b20f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:06.058691 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d88d8-3ac8-4435-9b62-894df545b20f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:08:06.061696 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d88d8-3ac8-4435-9b62-894df545b20f service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:08:06.069060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 745/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:08:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:08:06.113305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed285a0e-b779-4b96-95ef-d1ef0c740caa None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:06.113592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed285a0e-b779-4b96-95ef-d1ef0c740caa None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:06.113870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed285a0e-b779-4b96-95ef-d1ef0c740caa None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:06.115181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 761/1506] 10.222.0.16 () {52 vars in 829 bytes} [Thu Jun 23 13:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:08:06.118921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d88d8-3ac8-4435-9b62-894df545b20f service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:08:06.181415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d88d8-3ac8-4435-9b62-894df545b20f service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:08:06.185851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:08:06.186713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:06.186993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:06.187267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] PATH_INFO: `/v3/users/db697fa4715149e284c92d9e6d8b4698` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:06.188430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db697fa4715149e284c92d9e6d8b4698)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:08:06.189483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: WARNING py.warnings [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:08:06.189483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: warnings.warn(msg) Jun 23 13:08:06.189483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: Jun 23 13:08:06.190729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:08:06.374721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db697fa4715149e284c92d9e6d8b4698'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:08:06.393823 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db697fa4715149e284c92d9e6d8b4698'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:08:06.454274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db697fa4715149e284c92d9e6d8b4698'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:08:06.454970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db697fa4715149e284c92d9e6d8b4698'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:08:06.456223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db697fa4715149e284c92d9e6d8b4698'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:08:06.465273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:08:06.475862 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 746/1507] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:08:06 2022] DELETE /identity/v3/users/db697fa4715149e284c92d9e6d8b4698 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:08:06.480293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa101-e777-493d-91be-e382f5f61e48 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:06.480783 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa101-e777-493d-91be-e382f5f61e48 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:06.480917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaa101-e777-493d-91be-e382f5f61e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:06.498012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7dfaa101-e777-493d-91be-e382f5f61e48 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:08:06.501705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7dfaa101-e777-493d-91be-e382f5f61e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:08:06.557778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 762/1508] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:08:06.567938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:08:06.569432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:08:06.625545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32a758-6183-4003-90ed-3d6592ddde58 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:08:06.629647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b7156-1d56-4a77-96c0-3daac3050a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:08:06.630293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b7156-1d56-4a77-96c0-3daac3050a71 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:06.630582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b7156-1d56-4a77-96c0-3daac3050a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:06.630864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b7156-1d56-4a77-96c0-3daac3050a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:06.639674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b7156-1d56-4a77-96c0-3daac3050a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:08:06.641169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b7156-1d56-4a77-96c0-3daac3050a71 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:08:06.651546 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 747/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:08:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:08:07.079112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa101-e777-493d-91be-e382f5f61e48 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:08:07.080581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7dfaa101-e777-493d-91be-e382f5f61e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:08:07.093418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaa101-e777-493d-91be-e382f5f61e48 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:08:07.099594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:08:07.100520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:08:07.100830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:08:07.101109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] PATH_INFO: `/v3/projects/461bbda7fc7046919fffa50694c927be` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:08:07.102286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=461bbda7fc7046919fffa50694c927be)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:08:07.103951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:08:07.103951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 23 13:08:07.103951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: Jun 23 13:08:07.105348 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:08:07.208963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '461bbda7fc7046919fffa50694c927be', 'request_id': 'req-eb59ea20-736b-4d33-96aa-f601703ae2a5'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:08:07.260064 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '461bbda7fc7046919fffa50694c927be', 'request_id': 'req-eb59ea20-736b-4d33-96aa-f601703ae2a5'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:08:07.274258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '461bbda7fc7046919fffa50694c927be', 'request_id': 'req-eb59ea20-736b-4d33-96aa-f601703ae2a5'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:08:07.285748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] The token cache is being invalidate because project 461bbda7fc7046919fffa50694c927be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:08:07.286037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:08:07.286771 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-eb59ea20-736b-4d33-96aa-f601703ae2a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:08:07.288326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 763/1510] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:08:07 2022] DELETE /identity/v3/projects/461bbda7fc7046919fffa50694c927be => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:08:16.647124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=29 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:08:17.282150 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:09:53.506373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbc048-38e0-409e-adb6-cffc1f617d11 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:53.506998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbc048-38e0-409e-adb6-cffc1f617d11 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:53.506998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbc048-38e0-409e-adb6-cffc1f617d11 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:53.508324 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 748/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:09:53.513210 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3102b-f433-4c55-af21-be2a22db3921 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:53.513642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3102b-f433-4c55-af21-be2a22db3921 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:53.514305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3102b-f433-4c55-af21-be2a22db3921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:53.537339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-54e3102b-f433-4c55-af21-be2a22db3921 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:09:53.538544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-54e3102b-f433-4c55-af21-be2a22db3921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:09:53.598952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 764/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:09:53.758368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbc048-38e0-409e-adb6-cffc1f617d11 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:53.760019 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-55bbc048-38e0-409e-adb6-cffc1f617d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:09:53.834938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbc048-38e0-409e-adb6-cffc1f617d11 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:53.840201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b278140-7bec-4ee5-adc3-2e36eb89e459 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:53.840857 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b278140-7bec-4ee5-adc3-2e36eb89e459 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:53.841140 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b278140-7bec-4ee5-adc3-2e36eb89e459 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:53.841416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b278140-7bec-4ee5-adc3-2e36eb89e459 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:53.849534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b278140-7bec-4ee5-adc3-2e36eb89e459 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:53.851180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b278140-7bec-4ee5-adc3-2e36eb89e459 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:53.860527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 749/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:09:54.693603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60df3c-80dd-48f0-83b4-faf110f5a255 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:54.694198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60df3c-80dd-48f0-83b4-faf110f5a255 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:54.694198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60df3c-80dd-48f0-83b4-faf110f5a255 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:54.695530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 765/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:09:54.700351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4b2ab-e084-46a0-9328-1017b9f27549 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:54.700781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4b2ab-e084-46a0-9328-1017b9f27549 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:54.700966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c4b2ab-e084-46a0-9328-1017b9f27549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:54.720114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-70c4b2ab-e084-46a0-9328-1017b9f27549 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:09:54.721348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-70c4b2ab-e084-46a0-9328-1017b9f27549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:09:54.729516 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 750/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:09:54.882542 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60df3c-80dd-48f0-83b4-faf110f5a255 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:54.897530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60df3c-80dd-48f0-83b4-faf110f5a255 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:54.902904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9dd7c-1f99-406f-a34b-a71389ca0036 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:54.903543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9dd7c-1f99-406f-a34b-a71389ca0036 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:54.903827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9dd7c-1f99-406f-a34b-a71389ca0036 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:54.904104 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9dd7c-1f99-406f-a34b-a71389ca0036 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:54.912772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9dd7c-1f99-406f-a34b-a71389ca0036 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:54.914511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9dd7c-1f99-406f-a34b-a71389ca0036 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:54.923781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 766/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:09:55.771328 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634071d-f090-458e-bd41-de565d85d041 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:55.772144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634071d-f090-458e-bd41-de565d85d041 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:55.772144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634071d-f090-458e-bd41-de565d85d041 None None] PATH_INFO: `/v3` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:55.773492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 751/1517] 10.222.0.36 () {54 vars in 925 bytes} [Thu Jun 23 13:09:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:09:55.780124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ee7e8-b258-46da-98e3-737774b89eda None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:55.780571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ee7e8-b258-46da-98e3-737774b89eda None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:55.780669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ee7e8-b258-46da-98e3-737774b89eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:55.798890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2c9ee7e8-b258-46da-98e3-737774b89eda None None] MFA Rules not processed for user `69b5745bfb5d4e6ca172bb8fab229e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:09:55.800086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2c9ee7e8-b258-46da-98e3-737774b89eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:09:55.863291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 767/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Jun 23 13:09:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:09:59.898286 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00b400-717d-486d-8358-d8aa00b94340 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:59.898768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00b400-717d-486d-8358-d8aa00b94340 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:59.898863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f00b400-717d-486d-8358-d8aa00b94340 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:59.900269 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 752/1519] 10.222.0.16 () {54 vars in 960 bytes} [Thu Jun 23 13:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:09:59.905878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ba8f-8462-4d93-a5e8-b11bfc15f5d9 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:59.906289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ba8f-8462-4d93-a5e8-b11bfc15f5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:59.906457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76ba8f-8462-4d93-a5e8-b11bfc15f5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:59.925181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1b76ba8f-8462-4d93-a5e8-b11bfc15f5d9 None None] MFA Rules not processed for user `69b5745bfb5d4e6ca172bb8fab229e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:09:59.926425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1b76ba8f-8462-4d93-a5e8-b11bfc15f5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:09:59.935084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 768/1520] 10.222.0.16 () {58 vars in 1057 bytes} [Thu Jun 23 13:09:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:09:59.942767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00b400-717d-486d-8358-d8aa00b94340 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:09:59.955902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f00b400-717d-486d-8358-d8aa00b94340 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:09:59.960846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf55e2-991f-4995-a337-5864cc9f9f7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b5745bfb5d4e6ca172bb8fab229e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:09:59.961479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf55e2-991f-4995-a337-5864cc9f9f7d service placement] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:09:59.961765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf55e2-991f-4995-a337-5864cc9f9f7d service placement] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:09:59.962043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf55e2-991f-4995-a337-5864cc9f9f7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:09:59.970724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf55e2-991f-4995-a337-5864cc9f9f7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:09:59.972326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf55e2-991f-4995-a337-5864cc9f9f7d service placement] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:09:59.981864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 753/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:09:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:10:06.152907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591ec6-5f36-43ad-904e-d81091d91239 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:06.153434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591ec6-5f36-43ad-904e-d81091d91239 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:06.153434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591ec6-5f36-43ad-904e-d81091d91239 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:06.155612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:10:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:10:06.160348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea8c45-d64a-487f-bb2d-bedcecef4b43 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:06.160768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea8c45-d64a-487f-bb2d-bedcecef4b43 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:06.160952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea8c45-d64a-487f-bb2d-bedcecef4b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:06.181049 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-05ea8c45-d64a-487f-bb2d-bedcecef4b43 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:10:06.182273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-05ea8c45-d64a-487f-bb2d-bedcecef4b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:06.190300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:10:06.349600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591ec6-5f36-43ad-904e-d81091d91239 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:10:06.363854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591ec6-5f36-43ad-904e-d81091d91239 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:10:06.369213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48472c10-ad10-43e7-bf95-9ddbe2b4c7ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:10:06.369831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48472c10-ad10-43e7-bf95-9ddbe2b4c7ad service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:06.370109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48472c10-ad10-43e7-bf95-9ddbe2b4c7ad service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:06.370381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48472c10-ad10-43e7-bf95-9ddbe2b4c7ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:06.378627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48472c10-ad10-43e7-bf95-9ddbe2b4c7ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:10:06.380215 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48472c10-ad10-43e7-bf95-9ddbe2b4c7ad service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:10:06.389979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 770/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:10:07.224092 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98007f27-e005-4630-af77-363547485937 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:07.224641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98007f27-e005-4630-af77-363547485937 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:07.224641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98007f27-e005-4630-af77-363547485937 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:07.226073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 13:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:10:07.230816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d98f8-7b2a-49ec-9c62-22d8438e7b69 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:07.231216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d98f8-7b2a-49ec-9c62-22d8438e7b69 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:07.231379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d98f8-7b2a-49ec-9c62-22d8438e7b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:07.259942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f93d98f8-7b2a-49ec-9c62-22d8438e7b69 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:10:07.261250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f93d98f8-7b2a-49ec-9c62-22d8438e7b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:07.271306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 13:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:10:07.425646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98007f27-e005-4630-af77-363547485937 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:10:07.440423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98007f27-e005-4630-af77-363547485937 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:10:07.445831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906e03-8714-4f58-8805-04f3fed5f4c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:10:07.446474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906e03-8714-4f58-8805-04f3fed5f4c4 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:07.446758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906e03-8714-4f58-8805-04f3fed5f4c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:07.447037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906e03-8714-4f58-8805-04f3fed5f4c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:07.455767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906e03-8714-4f58-8805-04f3fed5f4c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:10:07.457418 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906e03-8714-4f58-8805-04f3fed5f4c4 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:10:07.466767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 756/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:10:11.502423 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0bea0-b5a1-4662-a3b3-8ba901565886 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:11.503008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0bea0-b5a1-4662-a3b3-8ba901565886 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:11.503008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0bea0-b5a1-4662-a3b3-8ba901565886 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:11.504349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:10:11.509672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984a38-b94e-4b32-a7ab-e8b7170d491f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:11.510073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984a38-b94e-4b32-a7ab-e8b7170d491f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:11.510224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f984a38-b94e-4b32-a7ab-e8b7170d491f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:11.655849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-9f984a38-b94e-4b32-a7ab-e8b7170d491f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:10:11.657175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9f984a38-b94e-4b32-a7ab-e8b7170d491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:11.666697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:10:11.718814 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0bea0-b5a1-4662-a3b3-8ba901565886 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:10:11.720538 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bdf0bea0-b5a1-4662-a3b3-8ba901565886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:11.791820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0bea0-b5a1-4662-a3b3-8ba901565886 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:10:11.797988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d950428-5fa8-43d2-9f25-c542226d92a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:10:11.799015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d950428-5fa8-43d2-9f25-c542226d92a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:11.799307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d950428-5fa8-43d2-9f25-c542226d92a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:11.799589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d950428-5fa8-43d2-9f25-c542226d92a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:11.811214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d950428-5fa8-43d2-9f25-c542226d92a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:10:11.812896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d950428-5fa8-43d2-9f25-c542226d92a8 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:10:11.819715 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:10:11.825425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 773/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:10:14.226529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691427a-c742-4375-9540-5e6eec069e9d None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:14.227110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691427a-c742-4375-9540-5e6eec069e9d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:14.227110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691427a-c742-4375-9540-5e6eec069e9d None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:14.228575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:10:14.235089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408346d8-62f2-4910-84df-cc2b7fcf192c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:14.235527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408346d8-62f2-4910-84df-cc2b7fcf192c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:14.235662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408346d8-62f2-4910-84df-cc2b7fcf192c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:14.255422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-408346d8-62f2-4910-84df-cc2b7fcf192c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:10:14.256623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-408346d8-62f2-4910-84df-cc2b7fcf192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:14.265029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:10:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:10:14.301837 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691427a-c742-4375-9540-5e6eec069e9d None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:10:14.313577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691427a-c742-4375-9540-5e6eec069e9d None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:10:14.317190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb673c2-b729-4e24-a589-3ab5aad609aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:10:14.317849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb673c2-b729-4e24-a589-3ab5aad609aa service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:14.318129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb673c2-b729-4e24-a589-3ab5aad609aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:14.318687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb673c2-b729-4e24-a589-3ab5aad609aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:14.328792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb673c2-b729-4e24-a589-3ab5aad609aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:10:14.330275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb673c2-b729-4e24-a589-3ab5aad609aa service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:10:14.339938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 759/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:10:18.032365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673b7d-30b0-4816-a7ac-8a4c5968abf4 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:18.032947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673b7d-30b0-4816-a7ac-8a4c5968abf4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:18.032947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d673b7d-30b0-4816-a7ac-8a4c5968abf4 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:18.034384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:10:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:10:18.039413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4442d0-d4e1-40fc-8d32-0bc2216ae9ff None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:18.039819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4442d0-d4e1-40fc-8d32-0bc2216ae9ff None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:18.039976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4442d0-d4e1-40fc-8d32-0bc2216ae9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:18.047005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=62 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:10:18.058691 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-4c4442d0-d4e1-40fc-8d32-0bc2216ae9ff None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:10:18.059921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4c4442d0-d4e1-40fc-8d32-0bc2216ae9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:18.067964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:10:18.375293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d673b7d-30b0-4816-a7ac-8a4c5968abf4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:10:18.377019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2d673b7d-30b0-4816-a7ac-8a4c5968abf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:18.433941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d673b7d-30b0-4816-a7ac-8a4c5968abf4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:10:18.437630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf8084-0bd1-44ed-8d29-5d532d6a3b32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:10:18.438277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf8084-0bd1-44ed-8d29-5d532d6a3b32 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:18.438565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf8084-0bd1-44ed-8d29-5d532d6a3b32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:18.438848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf8084-0bd1-44ed-8d29-5d532d6a3b32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:18.447693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf8084-0bd1-44ed-8d29-5d532d6a3b32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:10:18.449144 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf8084-0bd1-44ed-8d29-5d532d6a3b32 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:10:18.459002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 776/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:10:20.565424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037af4-7184-4255-a18a-f658153c2ca9 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:20.565991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037af4-7184-4255-a18a-f658153c2ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:20.565991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78037af4-7184-4255-a18a-f658153c2ca9 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:20.567340 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 13:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:10:20.572546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e77b-4133-45a3-b519-0d3695e64afa None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:20.573004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e77b-4133-45a3-b519-0d3695e64afa None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:20.573117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e77b-4133-45a3-b519-0d3695e64afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:20.591661 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3803e77b-4133-45a3-b519-0d3695e64afa None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:10:20.592876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3803e77b-4133-45a3-b519-0d3695e64afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:20.600562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 13:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:10:20.905773 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78037af4-7184-4255-a18a-f658153c2ca9 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:10:20.907462 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-78037af4-7184-4255-a18a-f658153c2ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:10:20.920242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78037af4-7184-4255-a18a-f658153c2ca9 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:10:20.923670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ed1f0-ee44-4ec8-a916-0331ffcf1e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:10:20.924294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ed1f0-ee44-4ec8-a916-0331ffcf1e21 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:10:20.924589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ed1f0-ee44-4ec8-a916-0331ffcf1e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:10:20.924872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ed1f0-ee44-4ec8-a916-0331ffcf1e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:10:20.933553 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ed1f0-ee44-4ec8-a916-0331ffcf1e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:10:20.935474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ed1f0-ee44-4ec8-a916-0331ffcf1e21 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:10:20.944636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 762/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:10:30.586154 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=32 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:10:30.940548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=8 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:55.386267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477757f9-602a-40b9-9dcb-3581a6e28bc7 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.386945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477757f9-602a-40b9-9dcb-3581a6e28bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.386945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477757f9-602a-40b9-9dcb-3581a6e28bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.416770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-477757f9-602a-40b9-9dcb-3581a6e28bc7 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.418155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-477757f9-602a-40b9-9dcb-3581a6e28bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.434537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 778/1540] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:55.445388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10314e0c-02c0-4283-9148-9053518ae7d0 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.445986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10314e0c-02c0-4283-9148-9053518ae7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.445986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10314e0c-02c0-4283-9148-9053518ae7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.472021 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-10314e0c-02c0-4283-9148-9053518ae7d0 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.473280 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-10314e0c-02c0-4283-9148-9053518ae7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.488755 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 763/1541] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:11:55.493718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477757f9-602a-40b9-9dcb-3581a6e28bc7 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:55.510962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477757f9-602a-40b9-9dcb-3581a6e28bc7 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:55.517792 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe85072-111d-4f8a-8f29-0b156679fd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:55.518479 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe85072-111d-4f8a-8f29-0b156679fd1b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.518767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe85072-111d-4f8a-8f29-0b156679fd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.519048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe85072-111d-4f8a-8f29-0b156679fd1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.519795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe85072-111d-4f8a-8f29-0b156679fd1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:11:55.520107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe85072-111d-4f8a-8f29-0b156679fd1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:55.522021 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe85072-111d-4f8a-8f29-0b156679fd1b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:55.544292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abfbf5-3f40-40c4-9e4a-1e9fa298015f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.544631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abfbf5-3f40-40c4-9e4a-1e9fa298015f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.545448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99abfbf5-3f40-40c4-9e4a-1e9fa298015f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.550988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 779/1542] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:11:55.565510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddb09c-d5a5-4438-a6cc-0df354a9921a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.565844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddb09c-d5a5-4438-a6cc-0df354a9921a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.566084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddb09c-d5a5-4438-a6cc-0df354a9921a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.586033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-99abfbf5-3f40-40c4-9e4a-1e9fa298015f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.588221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-99abfbf5-3f40-40c4-9e4a-1e9fa298015f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.602165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-19ddb09c-d5a5-4438-a6cc-0df354a9921a None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.603623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-19ddb09c-d5a5-4438-a6cc-0df354a9921a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.605908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 764/1543] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:11:55.607924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14afbdb-b9c2-4a46-91d8-94b4063aad43 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.608547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14afbdb-b9c2-4a46-91d8-94b4063aad43 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.609223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14afbdb-b9c2-4a46-91d8-94b4063aad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.615863 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 780/1544] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:11:55.616687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddb09c-d5a5-4438-a6cc-0df354a9921a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:55.630240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d14afbdb-b9c2-4a46-91d8-94b4063aad43 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.632079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d14afbdb-b9c2-4a46-91d8-94b4063aad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.642530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddb09c-d5a5-4438-a6cc-0df354a9921a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:55.646800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 765/1545] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:55.648874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52709446-4cce-4c11-94e8-531659c12c9d None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.649403 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52709446-4cce-4c11-94e8-531659c12c9d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.650041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52709446-4cce-4c11-94e8-531659c12c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.659500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9090e99-48be-4e61-98e8-b8d13e7d9840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:55.660466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9090e99-48be-4e61-98e8-b8d13e7d9840 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.660758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9090e99-48be-4e61-98e8-b8d13e7d9840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.661073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9090e99-48be-4e61-98e8-b8d13e7d9840 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.661786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9090e99-48be-4e61-98e8-b8d13e7d9840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:55.662911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-a9090e99-48be-4e61-98e8-b8d13e7d9840 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:11:55.662911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 23 13:11:55.662911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: Jun 23 13:11:55.664126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9090e99-48be-4e61-98e8-b8d13e7d9840 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:55.669690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-52709446-4cce-4c11-94e8-531659c12c9d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.671485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-52709446-4cce-4c11-94e8-531659c12c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.679706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 766/1546] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:55.681090 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01842065-7bb1-4616-9518-33f6d1be94fd None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.681381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01842065-7bb1-4616-9518-33f6d1be94fd None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.681675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01842065-7bb1-4616-9518-33f6d1be94fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.700000 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-01842065-7bb1-4616-9518-33f6d1be94fd None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.701264 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-01842065-7bb1-4616-9518-33f6d1be94fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.709403 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 767/1547] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:55.710605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7639d-0f42-48e0-a232-5133c8f6f159 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.710895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7639d-0f42-48e0-a232-5133c8f6f159 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.711175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7639d-0f42-48e0-a232-5133c8f6f159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.729039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-49e7639d-0f42-48e0-a232-5133c8f6f159 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.730238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-49e7639d-0f42-48e0-a232-5133c8f6f159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.738753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 768/1548] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:55.740147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0fc19-14fc-4552-a8b8-4fda96034b81 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.740437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0fc19-14fc-4552-a8b8-4fda96034b81 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.740715 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0fc19-14fc-4552-a8b8-4fda96034b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.758071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 781/1549] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:55.759398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed1fe8-98a9-4575-ac2c-1db97399eba4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.759693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed1fe8-98a9-4575-ac2c-1db97399eba4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.759974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed1fe8-98a9-4575-ac2c-1db97399eba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.760790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d6a0fc19-14fc-4552-a8b8-4fda96034b81 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.762270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d6a0fc19-14fc-4552-a8b8-4fda96034b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.778757 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-83ed1fe8-98a9-4575-ac2c-1db97399eba4 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.781218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-83ed1fe8-98a9-4575-ac2c-1db97399eba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.825179 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 769/1550] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:55.830753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42a892-9c30-413e-afad-3473d69b8a8c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.831052 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42a892-9c30-413e-afad-3473d69b8a8c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.831333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42a892-9c30-413e-afad-3473d69b8a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.842978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 782/1551] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:55.844275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa96a78-2d4b-4e43-a025-0a3ea52870f5 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.844564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa96a78-2d4b-4e43-a025-0a3ea52870f5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.844871 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa96a78-2d4b-4e43-a025-0a3ea52870f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.850765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-dd42a892-9c30-413e-afad-3473d69b8a8c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.853927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-dd42a892-9c30-413e-afad-3473d69b8a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.861396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 770/1552] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:55.862927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74a9ba-8a27-4f9f-ab58-39673223f375 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.863270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74a9ba-8a27-4f9f-ab58-39673223f375 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.863574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74a9ba-8a27-4f9f-ab58-39673223f375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.871190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-4aa96a78-2d4b-4e43-a025-0a3ea52870f5 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.873501 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4aa96a78-2d4b-4e43-a025-0a3ea52870f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.882280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 783/1553] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:55.883530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345611f-ee2f-4c78-96ba-d5f0866a7d32 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.883661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-df74a9ba-8a27-4f9f-ab58-39673223f375 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.883813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345611f-ee2f-4c78-96ba-d5f0866a7d32 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.884107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345611f-ee2f-4c78-96ba-d5f0866a7d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.884810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-df74a9ba-8a27-4f9f-ab58-39673223f375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.900978 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 771/1554] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:55.901967 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74a9ba-8a27-4f9f-ab58-39673223f375 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:55.902805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d345611f-ee2f-4c78-96ba-d5f0866a7d32 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:55.903999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d345611f-ee2f-4c78-96ba-d5f0866a7d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:55.912066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 784/1555] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:55.917368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74a9ba-8a27-4f9f-ab58-39673223f375 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:55.917518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345611f-ee2f-4c78-96ba-d5f0866a7d32 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:55.917657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f2d5e-97e7-4de5-8a26-1f5dc11f0414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:55.917657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f2d5e-97e7-4de5-8a26-1f5dc11f0414 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.917959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f2d5e-97e7-4de5-8a26-1f5dc11f0414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.918190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f2d5e-97e7-4de5-8a26-1f5dc11f0414 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.919043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f2d5e-97e7-4de5-8a26-1f5dc11f0414 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:11:55.919347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f2d5e-97e7-4de5-8a26-1f5dc11f0414 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:55.921308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: WARNING py.warnings [None req-437f2d5e-97e7-4de5-8a26-1f5dc11f0414 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:11:55.921308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: warnings.warn(msg) Jun 23 13:11:55.921308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: Jun 23 13:11:55.922195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437f2d5e-97e7-4de5-8a26-1f5dc11f0414 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:55.925799 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345611f-ee2f-4c78-96ba-d5f0866a7d32 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:55.933275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d33a49-1e29-4c02-bf8d-51261b4d291a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:55.933960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d33a49-1e29-4c02-bf8d-51261b4d291a admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.934243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d33a49-1e29-4c02-bf8d-51261b4d291a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.934550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d33a49-1e29-4c02-bf8d-51261b4d291a admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.936519 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d33a49-1e29-4c02-bf8d-51261b4d291a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:55.937843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d33a49-1e29-4c02-bf8d-51261b4d291a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:55.941919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 772/1556] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:11:55.942777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f2d5e-97e7-4de5-8a26-1f5dc11f0414 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:55.958599 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f2d5e-97e7-4de5-8a26-1f5dc11f0414 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:55.963343 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c8a9d-1ad6-42c5-ac79-327b30eab14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:55.963997 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c8a9d-1ad6-42c5-ac79-327b30eab14f admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.964279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c8a9d-1ad6-42c5-ac79-327b30eab14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.964572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c8a9d-1ad6-42c5-ac79-327b30eab14f admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:55.965325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c8a9d-1ad6-42c5-ac79-327b30eab14f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:11:55.965628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c8a9d-1ad6-42c5-ac79-327b30eab14f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:55.967789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c8a9d-1ad6-42c5-ac79-327b30eab14f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:55.980127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 773/1557] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:11:55.980929 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c8a9d-1ad6-42c5-ac79-327b30eab14f admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:55.992892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c8a9d-1ad6-42c5-ac79-327b30eab14f admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:55.997613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b91eb2-088f-4574-8824-5e0fd6e6010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:55.999024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b91eb2-088f-4574-8824-5e0fd6e6010f admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:55.999312 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b91eb2-088f-4574-8824-5e0fd6e6010f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:55.999590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b91eb2-088f-4574-8824-5e0fd6e6010f admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.000334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b91eb2-088f-4574-8824-5e0fd6e6010f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:11:56.000628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b91eb2-088f-4574-8824-5e0fd6e6010f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.002269 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b91eb2-088f-4574-8824-5e0fd6e6010f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.013029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 785/1558] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:11:55 2022] POST /identity/v3/users => generated 285 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:56.014932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819f8bb-ef8a-49c4-b9a8-5e53d3849a72 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.015211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819f8bb-ef8a-49c4-b9a8-5e53d3849a72 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.015397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 774/1559] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:11:56.015505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819f8bb-ef8a-49c4-b9a8-5e53d3849a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.017229 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b37c3-3219-46be-89b9-f7eaf01ecca3 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.019005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b37c3-3219-46be-89b9-f7eaf01ecca3 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.019005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46b37c3-3219-46be-89b9-f7eaf01ecca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.038827 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e46b37c3-3219-46be-89b9-f7eaf01ecca3 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:56.039276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a819f8bb-ef8a-49c4-b9a8-5e53d3849a72 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:56.040113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e46b37c3-3219-46be-89b9-f7eaf01ecca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:56.040495 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a819f8bb-ef8a-49c4-b9a8-5e53d3849a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:56.048568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 775/1560] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:56.052156 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 786/1561] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:56.052273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b37c3-3219-46be-89b9-f7eaf01ecca3 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.052375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819f8bb-ef8a-49c4-b9a8-5e53d3849a72 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.061706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819f8bb-ef8a-49c4-b9a8-5e53d3849a72 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.062745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46b37c3-3219-46be-89b9-f7eaf01ecca3 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.066462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068951f-69e3-4133-bbe7-7b2edcd88e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.067194 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b773e-6346-4002-8a2d-0da736ed5f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.067343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068951f-69e3-4133-bbe7-7b2edcd88e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.067489 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068951f-69e3-4133-bbe7-7b2edcd88e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.067768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068951f-69e3-4133-bbe7-7b2edcd88e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.067894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b773e-6346-4002-8a2d-0da736ed5f90 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.068098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b773e-6346-4002-8a2d-0da736ed5f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.068368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b773e-6346-4002-8a2d-0da736ed5f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.068499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068951f-69e3-4133-bbe7-7b2edcd88e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:11:56.068824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068951f-69e3-4133-bbe7-7b2edcd88e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.069114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b773e-6346-4002-8a2d-0da736ed5f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:11:56.069415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b773e-6346-4002-8a2d-0da736ed5f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.070430 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068951f-69e3-4133-bbe7-7b2edcd88e3e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.070971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b773e-6346-4002-8a2d-0da736ed5f90 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.082540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 787/1562] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:11:56.083311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068951f-69e3-4133-bbe7-7b2edcd88e3e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.089772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 776/1563] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:11:56.090631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b773e-6346-4002-8a2d-0da736ed5f90 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.095052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068951f-69e3-4133-bbe7-7b2edcd88e3e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.100130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278187c8-03ce-4196-962f-bc5769763c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.100380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b773e-6346-4002-8a2d-0da736ed5f90 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.100785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278187c8-03ce-4196-962f-bc5769763c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.101107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278187c8-03ce-4196-962f-bc5769763c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.101384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278187c8-03ce-4196-962f-bc5769763c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.102071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278187c8-03ce-4196-962f-bc5769763c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.104137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278187c8-03ce-4196-962f-bc5769763c59 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.104834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b1225-d7bd-4f97-84cd-399657eda4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.105478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1225-d7bd-4f97-84cd-399657eda4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.105757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1225-d7bd-4f97-84cd-399657eda4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.106028 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b1225-d7bd-4f97-84cd-399657eda4d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.106700 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b1225-d7bd-4f97-84cd-399657eda4d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.108832 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b1225-d7bd-4f97-84cd-399657eda4d9 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.225763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 788/1564] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/projects => generated 389 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:56.226594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278187c8-03ce-4196-962f-bc5769763c59 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.255502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 777/1565] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:56.256246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b1225-d7bd-4f97-84cd-399657eda4d9 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.274751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:56.293670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:56.293907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278187c8-03ce-4196-962f-bc5769763c59 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.327518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b1225-d7bd-4f97-84cd-399657eda4d9 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.332122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0a881-2050-40fd-a4a9-2ecfc79c128f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.332792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0a881-2050-40fd-a4a9-2ecfc79c128f admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.333103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0a881-2050-40fd-a4a9-2ecfc79c128f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.333382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0a881-2050-40fd-a4a9-2ecfc79c128f admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.334084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0a881-2050-40fd-a4a9-2ecfc79c128f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.336007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f0a881-2050-40fd-a4a9-2ecfc79c128f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.351066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a0054-8365-43bb-ab86-e6fd920713be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.351740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a0054-8365-43bb-ab86-e6fd920713be admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.352021 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a0054-8365-43bb-ab86-e6fd920713be admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.352302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a0054-8365-43bb-ab86-e6fd920713be admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.353085 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a0054-8365-43bb-ab86-e6fd920713be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.354693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a0054-8365-43bb-ab86-e6fd920713be admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.365460 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 789/1566] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:56.366301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a0054-8365-43bb-ab86-e6fd920713be admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.376626 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a0054-8365-43bb-ab86-e6fd920713be admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.381116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a004c8-1186-432c-b45d-bcbdc94f8e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.381728 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a004c8-1186-432c-b45d-bcbdc94f8e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.382011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a004c8-1186-432c-b45d-bcbdc94f8e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.382286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a004c8-1186-432c-b45d-bcbdc94f8e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.382987 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a004c8-1186-432c-b45d-bcbdc94f8e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:11:56.383289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a004c8-1186-432c-b45d-bcbdc94f8e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.384850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a004c8-1186-432c-b45d-bcbdc94f8e01 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.397391 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 790/1567] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:11:56.398360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a004c8-1186-432c-b45d-bcbdc94f8e01 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.409092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a004c8-1186-432c-b45d-bcbdc94f8e01 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.413273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 778/1568] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/projects => generated 393 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:56.413273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0a881-2050-40fd-a4a9-2ecfc79c128f admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.468044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a187a-5248-440d-b73b-99fde4878fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.468713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a187a-5248-440d-b73b-99fde4878fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.469029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a187a-5248-440d-b73b-99fde4878fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.469304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a187a-5248-440d-b73b-99fde4878fb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.470035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a187a-5248-440d-b73b-99fde4878fb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:11:56.470343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a187a-5248-440d-b73b-99fde4878fb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.472003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a187a-5248-440d-b73b-99fde4878fb2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.473342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f0a881-2050-40fd-a4a9-2ecfc79c128f admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.477910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0541674-e657-4f40-a200-600f178c99da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.478501 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0541674-e657-4f40-a200-600f178c99da admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.478785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0541674-e657-4f40-a200-600f178c99da admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.479062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0541674-e657-4f40-a200-600f178c99da admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.479738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0541674-e657-4f40-a200-600f178c99da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.481727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0541674-e657-4f40-a200-600f178c99da admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.483854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 791/1569] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:11:56.484632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a187a-5248-440d-b73b-99fde4878fb2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.495887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a187a-5248-440d-b73b-99fde4878fb2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.501258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e1618-228a-456c-8df8-055ce818a8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.501901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1618-228a-456c-8df8-055ce818a8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.502188 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1618-228a-456c-8df8-055ce818a8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.502464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e1618-228a-456c-8df8-055ce818a8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.503148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e1618-228a-456c-8df8-055ce818a8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.505051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e1618-228a-456c-8df8-055ce818a8e1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.572240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 779/1570] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:56.573174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0541674-e657-4f40-a200-600f178c99da admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.604172 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 792/1571] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:56.608842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e1618-228a-456c-8df8-055ce818a8e1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.639729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0541674-e657-4f40-a200-600f178c99da admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.664738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:56.681904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e1618-228a-456c-8df8-055ce818a8e1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.683898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:56.687070 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a1b00-9299-4cba-bebe-8c71c50d3efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.687746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a1b00-9299-4cba-bebe-8c71c50d3efa admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.688027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a1b00-9299-4cba-bebe-8c71c50d3efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.688305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a1b00-9299-4cba-bebe-8c71c50d3efa admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.689022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a1b00-9299-4cba-bebe-8c71c50d3efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.690931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a1b00-9299-4cba-bebe-8c71c50d3efa admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.699231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c45f8-ef5f-4052-ade0-e5bc9d62e939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.702856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c45f8-ef5f-4052-ade0-e5bc9d62e939 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.702856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c45f8-ef5f-4052-ade0-e5bc9d62e939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.702856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c45f8-ef5f-4052-ade0-e5bc9d62e939 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.702856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c45f8-ef5f-4052-ade0-e5bc9d62e939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.702856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: WARNING py.warnings [None req-429c45f8-ef5f-4052-ade0-e5bc9d62e939 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:11:56.702856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: warnings.warn(msg) Jun 23 13:11:56.702856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: Jun 23 13:11:56.703867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c45f8-ef5f-4052-ade0-e5bc9d62e939 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.803038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 793/1572] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:56.803802 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a1b00-9299-4cba-bebe-8c71c50d3efa admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.813670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a1b00-9299-4cba-bebe-8c71c50d3efa admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.818259 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fab81b-5d8c-4cb1-b9ed-632bd5937068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.818894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fab81b-5d8c-4cb1-b9ed-632bd5937068 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.819180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fab81b-5d8c-4cb1-b9ed-632bd5937068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.819460 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fab81b-5d8c-4cb1-b9ed-632bd5937068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.820177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fab81b-5d8c-4cb1-b9ed-632bd5937068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.821803 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fab81b-5d8c-4cb1-b9ed-632bd5937068 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.834385 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 780/1573] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/users => generated 295 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:56.834385 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c45f8-ef5f-4052-ade0-e5bc9d62e939 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.834697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 794/1574] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:56.834697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fab81b-5d8c-4cb1-b9ed-632bd5937068 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.845153 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fab81b-5d8c-4cb1-b9ed-632bd5937068 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.845762 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c45f8-ef5f-4052-ade0-e5bc9d62e939 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.849906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae37c6a-7a1a-4154-949b-bd44825957c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.850554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae37c6a-7a1a-4154-949b-bd44825957c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.850730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9345b7a-2382-4c01-81c5-1082c4dc0cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.850843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae37c6a-7a1a-4154-949b-bd44825957c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.851123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae37c6a-7a1a-4154-949b-bd44825957c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.851404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9345b7a-2382-4c01-81c5-1082c4dc0cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.851693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9345b7a-2382-4c01-81c5-1082c4dc0cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.851802 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae37c6a-7a1a-4154-949b-bd44825957c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.851973 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9345b7a-2382-4c01-81c5-1082c4dc0cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.852664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9345b7a-2382-4c01-81c5-1082c4dc0cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.853715 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae37c6a-7a1a-4154-949b-bd44825957c7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.854644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9345b7a-2382-4c01-81c5-1082c4dc0cb6 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:56.968236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 795/1575] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:56.969332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae37c6a-7a1a-4154-949b-bd44825957c7 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.979277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae37c6a-7a1a-4154-949b-bd44825957c7 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:56.984679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390ba58-d438-4bb2-82de-84316f8b874e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:56.984897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 781/1576] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:56.985769 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390ba58-d438-4bb2-82de-84316f8b874e admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:56.985920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9345b7a-2382-4c01-81c5-1082c4dc0cb6 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:56.986366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390ba58-d438-4bb2-82de-84316f8b874e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:56.986648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390ba58-d438-4bb2-82de-84316f8b874e admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:56.987343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390ba58-d438-4bb2-82de-84316f8b874e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:56.989417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390ba58-d438-4bb2-82de-84316f8b874e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.053287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9345b7a-2382-4c01-81c5-1082c4dc0cb6 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.057863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50bc71-20e2-4aca-88cb-5a6c01e631e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.058531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50bc71-20e2-4aca-88cb-5a6c01e631e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.058816 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50bc71-20e2-4aca-88cb-5a6c01e631e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.059092 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50bc71-20e2-4aca-88cb-5a6c01e631e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.059781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50bc71-20e2-4aca-88cb-5a6c01e631e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.062353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50bc71-20e2-4aca-88cb-5a6c01e631e5 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.093719 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 796/1577] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:57.094602 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390ba58-d438-4bb2-82de-84316f8b874e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.157932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390ba58-d438-4bb2-82de-84316f8b874e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.162604 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31119a23-2974-4bcb-a88b-db7bf687fe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.163277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31119a23-2974-4bcb-a88b-db7bf687fe77 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.163612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31119a23-2974-4bcb-a88b-db7bf687fe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.163894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31119a23-2974-4bcb-a88b-db7bf687fe77 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.164650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31119a23-2974-4bcb-a88b-db7bf687fe77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.166622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31119a23-2974-4bcb-a88b-db7bf687fe77 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.195731 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 782/1578] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:11:56 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:57.196713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50bc71-20e2-4aca-88cb-5a6c01e631e5 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.206572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50bc71-20e2-4aca-88cb-5a6c01e631e5 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.211202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8c551-35e3-4e84-a321-c54e84af5047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.211827 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8c551-35e3-4e84-a321-c54e84af5047 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.212111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8c551-35e3-4e84-a321-c54e84af5047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.212388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8c551-35e3-4e84-a321-c54e84af5047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.213141 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8c551-35e3-4e84-a321-c54e84af5047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.214739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8c551-35e3-4e84-a321-c54e84af5047 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.225233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 783/1579] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.226069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8c551-35e3-4e84-a321-c54e84af5047 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.236002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8c551-35e3-4e84-a321-c54e84af5047 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.240583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade1e8-451f-405c-8608-cdb1286f1e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.241236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade1e8-451f-405c-8608-cdb1286f1e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.241524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade1e8-451f-405c-8608-cdb1286f1e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.241805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade1e8-451f-405c-8608-cdb1286f1e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.242511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ade1e8-451f-405c-8608-cdb1286f1e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.244056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ade1e8-451f-405c-8608-cdb1286f1e16 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.255016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 784/1580] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.255763 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade1e8-451f-405c-8608-cdb1286f1e16 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.264971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade1e8-451f-405c-8608-cdb1286f1e16 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.269573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44c84-4096-469a-91f4-a37ce76e478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.270685 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44c84-4096-469a-91f4-a37ce76e478b admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.270971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44c84-4096-469a-91f4-a37ce76e478b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.271247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e44c84-4096-469a-91f4-a37ce76e478b admin admin] PATH_INFO: `/v3/projects/e49e0502fa164821948d5594c048d809/users/d0b450aa924f4ac399d010afcccfd18d/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.273848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 797/1581] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:11:57 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:57.274710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31119a23-2974-4bcb-a88b-db7bf687fe77 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.284393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31119a23-2974-4bcb-a88b-db7bf687fe77 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.286039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e44c84-4096-469a-91f4-a37ce76e478b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49e0502fa164821948d5594c048d809, user_id=d0b450aa924f4ac399d010afcccfd18d, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.288734 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e44c84-4096-469a-91f4-a37ce76e478b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.289048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e6dc8-6f89-407a-afea-e65446bebcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.289700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e6dc8-6f89-407a-afea-e65446bebcbd admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.289981 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e6dc8-6f89-407a-afea-e65446bebcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.290257 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e6dc8-6f89-407a-afea-e65446bebcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.291107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e6dc8-6f89-407a-afea-e65446bebcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.292778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e6dc8-6f89-407a-afea-e65446bebcbd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.303269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 798/1582] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.304444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e6dc8-6f89-407a-afea-e65446bebcbd admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.314249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e6dc8-6f89-407a-afea-e65446bebcbd admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.318677 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9fabc-1c4d-454f-a585-3e7a268703c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.319304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9fabc-1c4d-454f-a585-3e7a268703c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.319591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9fabc-1c4d-454f-a585-3e7a268703c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.319867 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9fabc-1c4d-454f-a585-3e7a268703c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.320535 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9fabc-1c4d-454f-a585-3e7a268703c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.322468 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f9fabc-1c4d-454f-a585-3e7a268703c5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.350414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 785/1583] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:11:57 2022] PUT /identity/v3/projects/e49e0502fa164821948d5594c048d809/users/d0b450aa924f4ac399d010afcccfd18d/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:11:57.351219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44c84-4096-469a-91f4-a37ce76e478b admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.390978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 799/1584] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:11:57 2022] POST /identity/v3/users => generated 288 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:57.391879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9fabc-1c4d-454f-a585-3e7a268703c5 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.401918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9fabc-1c4d-454f-a585-3e7a268703c5 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.413350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:57.418537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e44c84-4096-469a-91f4-a37ce76e478b admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.424766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b3a2b-3176-4845-9385-a95e72dbd418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.425632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b3a2b-3176-4845-9385-a95e72dbd418 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.425919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b3a2b-3176-4845-9385-a95e72dbd418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.426195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b3a2b-3176-4845-9385-a95e72dbd418 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.426884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b3a2b-3176-4845-9385-a95e72dbd418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.429367 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b3a2b-3176-4845-9385-a95e72dbd418 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.444963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:57.461779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ded187-ecb4-450d-8bd5-fdb2adc58f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.462458 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ded187-ecb4-450d-8bd5-fdb2adc58f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.462747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ded187-ecb4-450d-8bd5-fdb2adc58f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.463029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ded187-ecb4-450d-8bd5-fdb2adc58f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.463762 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ded187-ecb4-450d-8bd5-fdb2adc58f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.465399 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ded187-ecb4-450d-8bd5-fdb2adc58f65 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.475210 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 800/1585] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.476003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ded187-ecb4-450d-8bd5-fdb2adc58f65 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.486113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ded187-ecb4-450d-8bd5-fdb2adc58f65 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.492247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306dd20-d2f7-49bd-b497-682b8474959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.492917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306dd20-d2f7-49bd-b497-682b8474959c admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.493202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306dd20-d2f7-49bd-b497-682b8474959c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.493479 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306dd20-d2f7-49bd-b497-682b8474959c admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.494188 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306dd20-d2f7-49bd-b497-682b8474959c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.495840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306dd20-d2f7-49bd-b497-682b8474959c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.502451 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 786/1586] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:11:57 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:57.502451 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b3a2b-3176-4845-9385-a95e72dbd418 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.507695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 801/1587] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.511315 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306dd20-d2f7-49bd-b497-682b8474959c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.511446 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b3a2b-3176-4845-9385-a95e72dbd418 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.515271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cd3f7-53c3-4d6b-9c64-84a0bf9415f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.516543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd3f7-53c3-4d6b-9c64-84a0bf9415f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.516859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd3f7-53c3-4d6b-9c64-84a0bf9415f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.517143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd3f7-53c3-4d6b-9c64-84a0bf9415f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.517920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cd3f7-53c3-4d6b-9c64-84a0bf9415f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.519547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cd3f7-53c3-4d6b-9c64-84a0bf9415f1 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.520642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306dd20-d2f7-49bd-b497-682b8474959c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.525236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2911535-828c-4378-a986-a325928bdeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.525926 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2911535-828c-4378-a986-a325928bdeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.526204 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2911535-828c-4378-a986-a325928bdeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.526480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2911535-828c-4378-a986-a325928bdeb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.527201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2911535-828c-4378-a986-a325928bdeb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.528766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2911535-828c-4378-a986-a325928bdeb2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.529938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 787/1588] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.530732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cd3f7-53c3-4d6b-9c64-84a0bf9415f1 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.542334 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 802/1589] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.542334 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783e99e-0e3f-49fb-889b-881f18938805 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.542622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cd3f7-53c3-4d6b-9c64-84a0bf9415f1 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.542734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783e99e-0e3f-49fb-889b-881f18938805 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.542734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783e99e-0e3f-49fb-889b-881f18938805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.546983 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4fa28-192c-41a7-9090-233ccd160a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.547636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4fa28-192c-41a7-9090-233ccd160a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.547922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4fa28-192c-41a7-9090-233ccd160a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.548201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4fa28-192c-41a7-9090-233ccd160a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.548968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4fa28-192c-41a7-9090-233ccd160a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.550599 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4fa28-192c-41a7-9090-233ccd160a64 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.566958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 788/1590] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.566958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4fa28-192c-41a7-9090-233ccd160a64 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.568253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2783e99e-0e3f-49fb-889b-881f18938805 None None] MFA Rules not processed for user `d0b450aa924f4ac399d010afcccfd18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:57.569588 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2783e99e-0e3f-49fb-889b-881f18938805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:57.575449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4fa28-192c-41a7-9090-233ccd160a64 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.581291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1e07e-6336-4d49-83d7-0f6d414bc2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.581947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1e07e-6336-4d49-83d7-0f6d414bc2ab admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.582222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1e07e-6336-4d49-83d7-0f6d414bc2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.582492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1e07e-6336-4d49-83d7-0f6d414bc2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.583253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1e07e-6336-4d49-83d7-0f6d414bc2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.584867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1e07e-6336-4d49-83d7-0f6d414bc2ab admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.595341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 789/1591] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.596131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1e07e-6336-4d49-83d7-0f6d414bc2ab admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.605447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1e07e-6336-4d49-83d7-0f6d414bc2ab admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.610564 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98d90-9fa5-4691-892c-7128c1b2df22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.611198 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98d90-9fa5-4691-892c-7128c1b2df22 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.611479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98d90-9fa5-4691-892c-7128c1b2df22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.611748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e98d90-9fa5-4691-892c-7128c1b2df22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.612463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e98d90-9fa5-4691-892c-7128c1b2df22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.614064 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e98d90-9fa5-4691-892c-7128c1b2df22 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.624741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 790/1592] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.628582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98d90-9fa5-4691-892c-7128c1b2df22 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.637856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e98d90-9fa5-4691-892c-7128c1b2df22 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.638140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 803/1593] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:57.639624 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783e99e-0e3f-49fb-889b-881f18938805 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.647184 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d15b92-7a51-4715-afac-afa18005ffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.652874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15b92-7a51-4715-afac-afa18005ffeb admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.652874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15b92-7a51-4715-afac-afa18005ffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.652874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15b92-7a51-4715-afac-afa18005ffeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.652874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d15b92-7a51-4715-afac-afa18005ffeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.653257 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783e99e-0e3f-49fb-889b-881f18938805 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.653348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d15b92-7a51-4715-afac-afa18005ffeb admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.654741 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ea771-9800-49ae-8592-f43d9db3c964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.655651 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ea771-9800-49ae-8592-f43d9db3c964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.655966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ea771-9800-49ae-8592-f43d9db3c964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.656246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ea771-9800-49ae-8592-f43d9db3c964 admin admin] PATH_INFO: `/v3/projects/c89160b5ba1b4eb2ad8955a6423f4cde/users/b90c08b70d854eacbd2583d11ad67193/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.661183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 791/1594] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.661995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d15b92-7a51-4715-afac-afa18005ffeb admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.671402 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ea771-9800-49ae-8592-f43d9db3c964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89160b5ba1b4eb2ad8955a6423f4cde, user_id=b90c08b70d854eacbd2583d11ad67193, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.672097 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d15b92-7a51-4715-afac-afa18005ffeb admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.672452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-f27ea771-9800-49ae-8592-f43d9db3c964 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:11:57.672452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 23 13:11:57.672452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: Jun 23 13:11:57.674525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27ea771-9800-49ae-8592-f43d9db3c964 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.677025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87db1b-b61b-4861-9577-6cf3782ebe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.677891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87db1b-b61b-4861-9577-6cf3782ebe3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.678198 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87db1b-b61b-4861-9577-6cf3782ebe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.678472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87db1b-b61b-4861-9577-6cf3782ebe3d admin admin] PATH_INFO: `/v3/projects/e388fe87f8c04d45a8442115c3ff6393/users/f7d95bfecf5d4d82b51094e0bf9fbedf/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.693304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87db1b-b61b-4861-9577-6cf3782ebe3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e388fe87f8c04d45a8442115c3ff6393, user_id=f7d95bfecf5d4d82b51094e0bf9fbedf, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.695967 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87db1b-b61b-4861-9577-6cf3782ebe3d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.727101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 804/1595] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:11:57 2022] PUT /identity/v3/projects/c89160b5ba1b4eb2ad8955a6423f4cde/users/b90c08b70d854eacbd2583d11ad67193/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:11:57.727910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ea771-9800-49ae-8592-f43d9db3c964 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.745328 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 792/1596] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:11:57 2022] PUT /identity/v3/projects/e388fe87f8c04d45a8442115c3ff6393/users/f7d95bfecf5d4d82b51094e0bf9fbedf/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:11:57.746263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87db1b-b61b-4861-9577-6cf3782ebe3d admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.790554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27ea771-9800-49ae-8592-f43d9db3c964 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.813060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87db1b-b61b-4861-9577-6cf3782ebe3d admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.816792 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:57.817688 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdd86f-838f-42b1-9542-e49a74e8d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.818511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdd86f-838f-42b1-9542-e49a74e8d0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.818790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdd86f-838f-42b1-9542-e49a74e8d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.819061 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bdd86f-838f-42b1-9542-e49a74e8d0f3 admin admin] PATH_INFO: `/v3/projects/52984a97d6634da18f17156d1617e384/users/824c74155450401ba02db90ff00aa9e3/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.833455 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdd86f-838f-42b1-9542-e49a74e8d0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52984a97d6634da18f17156d1617e384, user_id=824c74155450401ba02db90ff00aa9e3, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.836122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bdd86f-838f-42b1-9542-e49a74e8d0f3 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.847708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5329a-eb0d-4cfe-96b0-eac57303b234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.848379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5329a-eb0d-4cfe-96b0-eac57303b234 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.848670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5329a-eb0d-4cfe-96b0-eac57303b234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.848980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5329a-eb0d-4cfe-96b0-eac57303b234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.849723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5329a-eb0d-4cfe-96b0-eac57303b234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.851300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5329a-eb0d-4cfe-96b0-eac57303b234 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.862200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 805/1597] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.863040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5329a-eb0d-4cfe-96b0-eac57303b234 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.873228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5329a-eb0d-4cfe-96b0-eac57303b234 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.877941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3358-7768-405c-8372-9f633fd73961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.878601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3358-7768-405c-8372-9f633fd73961 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.878884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3358-7768-405c-8372-9f633fd73961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.879164 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3358-7768-405c-8372-9f633fd73961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.879882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf3358-7768-405c-8372-9f633fd73961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.881509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf3358-7768-405c-8372-9f633fd73961 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.892314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 806/1598] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:57.893643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3358-7768-405c-8372-9f633fd73961 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.905428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3358-7768-405c-8372-9f633fd73961 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.911374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 793/1599] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:11:57 2022] PUT /identity/v3/projects/52984a97d6634da18f17156d1617e384/users/824c74155450401ba02db90ff00aa9e3/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:11:57.912235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdd86f-838f-42b1-9542-e49a74e8d0f3 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:57.964495 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:57.967360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73506ee8-894d-4a58-abf2-104a16f3100e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.969788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73506ee8-894d-4a58-abf2-104a16f3100e admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.970076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73506ee8-894d-4a58-abf2-104a16f3100e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.970362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73506ee8-894d-4a58-abf2-104a16f3100e admin admin] PATH_INFO: `/v3/projects/dddde9d76d9b409e8bf22aa003b2e5dc/users/7344e4b33b80494092fcb4100883f4e2/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.986138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bdd86f-838f-42b1-9542-e49a74e8d0f3 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:57.989275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73506ee8-894d-4a58-abf2-104a16f3100e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dddde9d76d9b409e8bf22aa003b2e5dc, user_id=7344e4b33b80494092fcb4100883f4e2, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.990731 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde53f8d-0175-4bb8-bc15-4681ef1f5f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:57.991387 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde53f8d-0175-4bb8-bc15-4681ef1f5f62 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:57.991668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde53f8d-0175-4bb8-bc15-4681ef1f5f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:57.991940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde53f8d-0175-4bb8-bc15-4681ef1f5f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:57.992685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73506ee8-894d-4a58-abf2-104a16f3100e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:57.992788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde53f8d-0175-4bb8-bc15-4681ef1f5f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:57.995046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde53f8d-0175-4bb8-bc15-4681ef1f5f62 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:58.085766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 807/1600] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:11:57 2022] PUT /identity/v3/projects/dddde9d76d9b409e8bf22aa003b2e5dc/users/7344e4b33b80494092fcb4100883f4e2/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:11:58.086663 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73506ee8-894d-4a58-abf2-104a16f3100e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:58.089683 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 794/1601] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:11:57 2022] POST /identity/v3/projects => generated 367 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:58.089683 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62000f6b-2812-4d94-bb42-d923a05987bf None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.089683 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62000f6b-2812-4d94-bb42-d923a05987bf None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.089683 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62000f6b-2812-4d94-bb42-d923a05987bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.118002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-62000f6b-2812-4d94-bb42-d923a05987bf None None] MFA Rules not processed for user `b90c08b70d854eacbd2583d11ad67193`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:58.119266 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-62000f6b-2812-4d94-bb42-d923a05987bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:58.156079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73506ee8-894d-4a58-abf2-104a16f3100e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:58.191262 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 795/1602] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:58.192623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fb6d3-525f-467d-a61e-40ba32c484b2 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.193078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fb6d3-525f-467d-a61e-40ba32c484b2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.193374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fb6d3-525f-467d-a61e-40ba32c484b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.199714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:58.212102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-455fb6d3-525f-467d-a61e-40ba32c484b2 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:58.214964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-455fb6d3-525f-467d-a61e-40ba32c484b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:58.216180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d2c07-25d0-4649-90ca-142e053dad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:58.217140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d2c07-25d0-4649-90ca-142e053dad98 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.217447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d2c07-25d0-4649-90ca-142e053dad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.217731 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d2c07-25d0-4649-90ca-142e053dad98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.218466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d2c07-25d0-4649-90ca-142e053dad98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:58.220063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7d2c07-25d0-4649-90ca-142e053dad98 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:58.221571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 796/1603] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:58.222366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fb6d3-525f-467d-a61e-40ba32c484b2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:58.231526 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 808/1604] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:58.231686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fb6d3-525f-467d-a61e-40ba32c484b2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:58.232350 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d2c07-25d0-4649-90ca-142e053dad98 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:58.239097 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eac7d-66b8-4aa7-ae88-e328887e11dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:58.239980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eac7d-66b8-4aa7-ae88-e328887e11dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.240253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eac7d-66b8-4aa7-ae88-e328887e11dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.240523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eac7d-66b8-4aa7-ae88-e328887e11dd admin admin] PATH_INFO: `/v3/projects/03629e63ad5d4686811609a7b43e3e0d/users/f57590f413d14639882da6e938d25313/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.244348 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7d2c07-25d0-4649-90ca-142e053dad98 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:58.249699 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac9efb-0575-47a9-b0ee-1af2cd97fce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:58.250580 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac9efb-0575-47a9-b0ee-1af2cd97fce1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.250866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac9efb-0575-47a9-b0ee-1af2cd97fce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.251145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac9efb-0575-47a9-b0ee-1af2cd97fce1 admin admin] PATH_INFO: `/v3/projects/aa453b2676664cb1b1df9709dd347ae9/users/4e8df306f69246389ebd6505bfbd1d76/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.257517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eac7d-66b8-4aa7-ae88-e328887e11dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=03629e63ad5d4686811609a7b43e3e0d, user_id=f57590f413d14639882da6e938d25313, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:58.261859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eac7d-66b8-4aa7-ae88-e328887e11dd admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:58.267530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac9efb-0575-47a9-b0ee-1af2cd97fce1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa453b2676664cb1b1df9709dd347ae9, user_id=4e8df306f69246389ebd6505bfbd1d76, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:58.271354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac9efb-0575-47a9-b0ee-1af2cd97fce1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:58.379431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 797/1605] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:11:58 2022] PUT /identity/v3/projects/03629e63ad5d4686811609a7b43e3e0d/users/f57590f413d14639882da6e938d25313/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:11:58.380894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df3878-cbd3-4385-b83f-719018b0e390 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.381214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df3878-cbd3-4385-b83f-719018b0e390 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.381494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84df3878-cbd3-4385-b83f-719018b0e390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.398892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-84df3878-cbd3-4385-b83f-719018b0e390 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:58.400077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-84df3878-cbd3-4385-b83f-719018b0e390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:58.425187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 809/1606] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:11:58 2022] PUT /identity/v3/projects/aa453b2676664cb1b1df9709dd347ae9/users/4e8df306f69246389ebd6505bfbd1d76/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:11:58.426563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac9efb-0575-47a9-b0ee-1af2cd97fce1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:58.464210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 798/1607] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:58.466005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7ca50-9c15-45e2-b81a-008b5f262e16 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.466366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7ca50-9c15-45e2-b81a-008b5f262e16 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.467277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7ca50-9c15-45e2-b81a-008b5f262e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.493992 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-7aa7ca50-9c15-45e2-b81a-008b5f262e16 None None] MFA Rules not processed for user `7344e4b33b80494092fcb4100883f4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:58.495186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7aa7ca50-9c15-45e2-b81a-008b5f262e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:58.497613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac9efb-0575-47a9-b0ee-1af2cd97fce1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:58.503112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6f1b3-225b-4793-9819-8fdb65978a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:58.503790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6f1b3-225b-4793-9819-8fdb65978a94 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.504075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6f1b3-225b-4793-9819-8fdb65978a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.504362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6f1b3-225b-4793-9819-8fdb65978a94 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.505087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6f1b3-225b-4793-9819-8fdb65978a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:58.507002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6f1b3-225b-4793-9819-8fdb65978a94 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:58.516553 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:58.562991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 799/1608] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:58.563970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7ca50-9c15-45e2-b81a-008b5f262e16 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:58.575795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa7ca50-9c15-45e2-b81a-008b5f262e16 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:58.581063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7f757-c28b-4a75-a702-277e3084ae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:58.581798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7f757-c28b-4a75-a702-277e3084ae67 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.582253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7f757-c28b-4a75-a702-277e3084ae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.582368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7f757-c28b-4a75-a702-277e3084ae67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.583100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7f757-c28b-4a75-a702-277e3084ae67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:58.585021 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7f757-c28b-4a75-a702-277e3084ae67 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:58.625132 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 810/1609] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:11:58 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:58.626117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6f1b3-225b-4793-9819-8fdb65978a94 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:58.679721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6f1b3-225b-4793-9819-8fdb65978a94 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:58.683460 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d51a50-55de-4385-9a9f-bf1d57cb6041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:58.687582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d51a50-55de-4385-9a9f-bf1d57cb6041 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.687582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d51a50-55de-4385-9a9f-bf1d57cb6041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.687582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d51a50-55de-4385-9a9f-bf1d57cb6041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.694215 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d51a50-55de-4385-9a9f-bf1d57cb6041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:58.695640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d51a50-55de-4385-9a9f-bf1d57cb6041 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:58.705206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 811/1610] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:11:58.706106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d51a50-55de-4385-9a9f-bf1d57cb6041 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:58.716723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d51a50-55de-4385-9a9f-bf1d57cb6041 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:58.722269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b026fd-d684-4847-9108-b9713f753a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:58.723057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b026fd-d684-4847-9108-b9713f753a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.731768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 800/1611] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:11:58 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:58.732023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b026fd-d684-4847-9108-b9713f753a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.732023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b026fd-d684-4847-9108-b9713f753a8a admin admin] PATH_INFO: `/v3/projects/ca4ec99d0138476e9232c9b026041966/users/49262765416243a0be91135df74ec914/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.732908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5d5d6-e466-47db-a0ac-764242f2ec24 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.732908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5d5d6-e466-47db-a0ac-764242f2ec24 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.732908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f5d5d6-e466-47db-a0ac-764242f2ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.739910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b026fd-d684-4847-9108-b9713f753a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4ec99d0138476e9232c9b026041966, user_id=49262765416243a0be91135df74ec914, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:58.742641 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b026fd-d684-4847-9108-b9713f753a8a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:58.754657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-74f5d5d6-e466-47db-a0ac-764242f2ec24 None None] MFA Rules not processed for user `f57590f413d14639882da6e938d25313`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:58.757371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-74f5d5d6-e466-47db-a0ac-764242f2ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:58.818758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 801/1612] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:58.820180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc8847-f0cd-4312-bfb3-627867cd370c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.820491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc8847-f0cd-4312-bfb3-627867cd370c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.820833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc8847-f0cd-4312-bfb3-627867cd370c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.838655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-01bc8847-f0cd-4312-bfb3-627867cd370c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:58.839955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-01bc8847-f0cd-4312-bfb3-627867cd370c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:58.850355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 812/1613] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:11:58 2022] PUT /identity/v3/projects/ca4ec99d0138476e9232c9b026041966/users/49262765416243a0be91135df74ec914/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:11:58.851408 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b026fd-d684-4847-9108-b9713f753a8a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:58.888613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:58.918463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 802/1614] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:58.919254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b026fd-d684-4847-9108-b9713f753a8a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:58.921314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e760c72-de1d-40ae-9bd7-e83510d9e5e5 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.921794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e760c72-de1d-40ae-9bd7-e83510d9e5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.922022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e760c72-de1d-40ae-9bd7-e83510d9e5e5 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.924430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 803/1615] 10.222.0.16 () {54 vars in 961 bytes} [Thu Jun 23 13:11:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:11:58.925285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e760c72-de1d-40ae-9bd7-e83510d9e5e5 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:58.931482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58362fe5-7a42-4566-b405-0c0d2bff1325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:58.932106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58362fe5-7a42-4566-b405-0c0d2bff1325 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.932387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58362fe5-7a42-4566-b405-0c0d2bff1325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.932667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58362fe5-7a42-4566-b405-0c0d2bff1325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.939971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e760c72-de1d-40ae-9bd7-e83510d9e5e5 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:58.942904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58362fe5-7a42-4566-b405-0c0d2bff1325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:58.944401 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58362fe5-7a42-4566-b405-0c0d2bff1325 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:58.945907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8426df3-8ec9-409a-b657-411fac10c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:58.946753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8426df3-8ec9-409a-b657-411fac10c318 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.947108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8426df3-8ec9-409a-b657-411fac10c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.947491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8426df3-8ec9-409a-b657-411fac10c318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.948297 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8426df3-8ec9-409a-b657-411fac10c318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:58.950144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8426df3-8ec9-409a-b657-411fac10c318 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:58.957779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 813/1616] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:11:58.958648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58362fe5-7a42-4566-b405-0c0d2bff1325 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:58.964464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 804/1617] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:58.964464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b056e47-fd70-471b-8ea5-4186f1ed59ec None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.964464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b056e47-fd70-471b-8ea5-4186f1ed59ec None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.964464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b056e47-fd70-471b-8ea5-4186f1ed59ec None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.965317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 805/1618] 10.222.0.16 () {54 vars in 961 bytes} [Thu Jun 23 13:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:11:58.966336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1655d2-8d6c-476b-8ac9-3bdbde8f89cf None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.967288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1655d2-8d6c-476b-8ac9-3bdbde8f89cf None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.967557 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1655d2-8d6c-476b-8ac9-3bdbde8f89cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.975161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58362fe5-7a42-4566-b405-0c0d2bff1325 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:58.983987 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f89e3-8079-44c4-aa69-ac19288a1068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:58.984674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f89e3-8079-44c4-aa69-ac19288a1068 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:58.984989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f89e3-8079-44c4-aa69-ac19288a1068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:58.985261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f89e3-8079-44c4-aa69-ac19288a1068 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:58.985958 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f89e3-8079-44c4-aa69-ac19288a1068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:58.986183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-9b1655d2-8d6c-476b-8ac9-3bdbde8f89cf None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:58.987398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9b1655d2-8d6c-476b-8ac9-3bdbde8f89cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:58.987898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f89e3-8079-44c4-aa69-ac19288a1068 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:58.995578 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 806/1619] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:58.996454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1655d2-8d6c-476b-8ac9-3bdbde8f89cf None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:58.997852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9b1655d2-8d6c-476b-8ac9-3bdbde8f89cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:59.010144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1655d2-8d6c-476b-8ac9-3bdbde8f89cf None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:59.013829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64307563-350a-46ed-a3ce-7e59fe593cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:59.014466 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64307563-350a-46ed-a3ce-7e59fe593cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.014748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64307563-350a-46ed-a3ce-7e59fe593cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.015021 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64307563-350a-46ed-a3ce-7e59fe593cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.024430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64307563-350a-46ed-a3ce-7e59fe593cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:59.025973 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64307563-350a-46ed-a3ce-7e59fe593cf2 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:59.031488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:59.036287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 807/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:11:59.037674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6fa08-a6c9-4f94-a109-bf83557da20e None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.037985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6fa08-a6c9-4f94-a109-bf83557da20e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.038215 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6fa08-a6c9-4f94-a109-bf83557da20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.057080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-1bc6fa08-a6c9-4f94-a109-bf83557da20e None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:59.059144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1bc6fa08-a6c9-4f94-a109-bf83557da20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:59.080486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 814/1621] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:11:58 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:11:59.080486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f89e3-8079-44c4-aa69-ac19288a1068 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:59.091007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f89e3-8079-44c4-aa69-ac19288a1068 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:59.098827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0ed1-ea7d-4282-a224-a058dfd90847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:59.099983 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0ed1-ea7d-4282-a224-a058dfd90847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.100382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0ed1-ea7d-4282-a224-a058dfd90847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.100756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ba0ed1-ea7d-4282-a224-a058dfd90847 admin admin] PATH_INFO: `/v3/projects/fc4ce2a9540f441c95947f8f0f1aac04/users/2bba8de1f9974f1584ecda487e51dccc/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.124718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba0ed1-ea7d-4282-a224-a058dfd90847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4ce2a9540f441c95947f8f0f1aac04, user_id=2bba8de1f9974f1584ecda487e51dccc, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:59.128943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ba0ed1-ea7d-4282-a224-a058dfd90847 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:59.159312 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 808/1622] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Jun 23 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:59.160644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041421d-1232-4354-8490-490e9916bbb2 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.160969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041421d-1232-4354-8490-490e9916bbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.161313 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041421d-1232-4354-8490-490e9916bbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.185742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-f041421d-1232-4354-8490-490e9916bbb2 None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:59.185742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f041421d-1232-4354-8490-490e9916bbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:59.194220 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 809/1623] 10.222.0.16 () {58 vars in 1058 bytes} [Thu Jun 23 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:59.195250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041421d-1232-4354-8490-490e9916bbb2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:59.205675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041421d-1232-4354-8490-490e9916bbb2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:59.214780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9762a7-8bc2-47a9-8635-dbbfa3173c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:59.214780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9762a7-8bc2-47a9-8635-dbbfa3173c87 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.214780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9762a7-8bc2-47a9-8635-dbbfa3173c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.214780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9762a7-8bc2-47a9-8635-dbbfa3173c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.222300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9762a7-8bc2-47a9-8635-dbbfa3173c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:59.224314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9762a7-8bc2-47a9-8635-dbbfa3173c87 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:59.238509 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 810/1624] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:11:59.238509 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9762a7-8bc2-47a9-8635-dbbfa3173c87 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:59.240780 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 815/1625] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:11:59 2022] PUT /identity/v3/projects/fc4ce2a9540f441c95947f8f0f1aac04/users/2bba8de1f9974f1584ecda487e51dccc/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:11:59.244200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0ed1-ea7d-4282-a224-a058dfd90847 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:59.245439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9762a7-8bc2-47a9-8635-dbbfa3173c87 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:59.321764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07f15-1b9a-4ffb-83b9-b2d315f66f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:59.322780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07f15-1b9a-4ffb-83b9-b2d315f66f10 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.322899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07f15-1b9a-4ffb-83b9-b2d315f66f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.323159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f07f15-1b9a-4ffb-83b9-b2d315f66f10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.323900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07f15-1b9a-4ffb-83b9-b2d315f66f10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:59.325561 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f07f15-1b9a-4ffb-83b9-b2d315f66f10 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:59.332309 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ba0ed1-ea7d-4282-a224-a058dfd90847 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:59.338204 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fabd03-36e5-4be9-96c4-f1d2b895a3db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:59.341113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fabd03-36e5-4be9-96c4-f1d2b895a3db service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.341270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 811/1626] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:59.341371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fabd03-36e5-4be9-96c4-f1d2b895a3db service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.341371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fabd03-36e5-4be9-96c4-f1d2b895a3db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.342452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07f15-1b9a-4ffb-83b9-b2d315f66f10 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:59.364787 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f07f15-1b9a-4ffb-83b9-b2d315f66f10 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:59.366904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942d7aa-f925-40a0-9175-1d5f868a1ed7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:59.367562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942d7aa-f925-40a0-9175-1d5f868a1ed7 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.367895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942d7aa-f925-40a0-9175-1d5f868a1ed7 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.368181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942d7aa-f925-40a0-9175-1d5f868a1ed7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.424867 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fabd03-36e5-4be9-96c4-f1d2b895a3db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:59.426768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fabd03-36e5-4be9-96c4-f1d2b895a3db service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:59.438781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 816/1627] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:11:59.448165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942d7aa-f925-40a0-9175-1d5f868a1ed7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:59.449906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3942d7aa-f925-40a0-9175-1d5f868a1ed7 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:59.451799 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fabd03-36e5-4be9-96c4-f1d2b895a3db service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:59.461902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 812/1628] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:11:59.463035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942d7aa-f925-40a0-9175-1d5f868a1ed7 service nova] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:59.480881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fabd03-36e5-4be9-96c4-f1d2b895a3db service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:59.482345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3942d7aa-f925-40a0-9175-1d5f868a1ed7 service nova] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:59.487378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6864f-e86b-4176-aa5e-62352f89b8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:59.488615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6864f-e86b-4176-aa5e-62352f89b8d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.488983 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6864f-e86b-4176-aa5e-62352f89b8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.489267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6864f-e86b-4176-aa5e-62352f89b8d1 admin admin] PATH_INFO: `/v3/projects/27df07e48efb4729a11018f87f4b2114/users/847dd2f24a4c431e90c0d7163e258403/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.493851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:59.503427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8613d-7617-4e4e-8928-3e769cba94ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:59.504372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8613d-7617-4e4e-8928-3e769cba94ca admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.507319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8613d-7617-4e4e-8928-3e769cba94ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.507692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8613d-7617-4e4e-8928-3e769cba94ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.508540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8613d-7617-4e4e-8928-3e769cba94ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:59.510831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8613d-7617-4e4e-8928-3e769cba94ca admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:59.519313 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6864f-e86b-4176-aa5e-62352f89b8d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27df07e48efb4729a11018f87f4b2114, user_id=847dd2f24a4c431e90c0d7163e258403, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:59.524239 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6864f-e86b-4176-aa5e-62352f89b8d1 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:59.546019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 817/1629] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:11:59.548238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8613d-7617-4e4e-8928-3e769cba94ca admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:59.575684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8613d-7617-4e4e-8928-3e769cba94ca admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:59.593603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf2f0a-d039-46dd-afb1-10802eca76d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:59.594667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf2f0a-d039-46dd-afb1-10802eca76d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.595862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf2f0a-d039-46dd-afb1-10802eca76d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.596267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf2f0a-d039-46dd-afb1-10802eca76d0 admin admin] PATH_INFO: `/v3/projects/fc4ce2a9540f441c95947f8f0f1aac04/users/2bba8de1f9974f1584ecda487e51dccc/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.600006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf2f0a-d039-46dd-afb1-10802eca76d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4ce2a9540f441c95947f8f0f1aac04, user_id=2bba8de1f9974f1584ecda487e51dccc, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:59.606970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faf2f0a-d039-46dd-afb1-10802eca76d0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:59.611349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 813/1630] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:11:59 2022] PUT /identity/v3/projects/27df07e48efb4729a11018f87f4b2114/users/847dd2f24a4c431e90c0d7163e258403/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:11:59.614620 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6864f-e86b-4176-aa5e-62352f89b8d1 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:59.625576 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:11:59.648931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 818/1631] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:11:59 2022] PUT /identity/v3/projects/fc4ce2a9540f441c95947f8f0f1aac04/users/2bba8de1f9974f1584ecda487e51dccc/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:11:59.652127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada02f4-9b5a-4615-8481-20a9ddee4a90 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.653237 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada02f4-9b5a-4615-8481-20a9ddee4a90 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.653650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada02f4-9b5a-4615-8481-20a9ddee4a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.687140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-eada02f4-9b5a-4615-8481-20a9ddee4a90 None None] MFA Rules not processed for user `2bba8de1f9974f1584ecda487e51dccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:11:59.688585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-eada02f4-9b5a-4615-8481-20a9ddee4a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:11:59.747907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6864f-e86b-4176-aa5e-62352f89b8d1 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:59.772436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 819/1632] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:11:59.788101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada02f4-9b5a-4615-8481-20a9ddee4a90 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:59.906285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bc9f0-45f2-4f2f-a9fc-fb47777018e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:59.906285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bc9f0-45f2-4f2f-a9fc-fb47777018e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.906285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bc9f0-45f2-4f2f-a9fc-fb47777018e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.909655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bc9f0-45f2-4f2f-a9fc-fb47777018e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.913420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bc9f0-45f2-4f2f-a9fc-fb47777018e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:59.917369 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bc9f0-45f2-4f2f-a9fc-fb47777018e6 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:59.928474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 814/1633] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:11:59.932431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bc9f0-45f2-4f2f-a9fc-fb47777018e6 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:11:59.933215 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada02f4-9b5a-4615-8481-20a9ddee4a90 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:59.950329 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ffa64-15b9-4bfa-8811-22e8810e1576 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:59.952244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bc9f0-45f2-4f2f-a9fc-fb47777018e6 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:11:59.953690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ffa64-15b9-4bfa-8811-22e8810e1576 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.953690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ffa64-15b9-4bfa-8811-22e8810e1576 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.953690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ffa64-15b9-4bfa-8811-22e8810e1576 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.954506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bf67a-05a7-4b8a-b5f1-0f858f1025bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:11:59.956580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf67a-05a7-4b8a-b5f1-0f858f1025bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.956580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf67a-05a7-4b8a-b5f1-0f858f1025bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.956580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bf67a-05a7-4b8a-b5f1-0f858f1025bb admin admin] PATH_INFO: `/v3/projects/27df07e48efb4729a11018f87f4b2114/users/847dd2f24a4c431e90c0d7163e258403/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.958109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bf67a-05a7-4b8a-b5f1-0f858f1025bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=27df07e48efb4729a11018f87f4b2114, user_id=847dd2f24a4c431e90c0d7163e258403, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:59.963727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bf67a-05a7-4b8a-b5f1-0f858f1025bb admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:59.973970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ffa64-15b9-4bfa-8811-22e8810e1576 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:11:59.977989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ffa64-15b9-4bfa-8811-22e8810e1576 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:11:59.984081 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 815/1634] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:11:59 2022] PUT /identity/v3/projects/27df07e48efb4729a11018f87f4b2114/users/847dd2f24a4c431e90c0d7163e258403/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:11:59.992191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b4fb2-fcc8-4f48-8a1b-aee938017aa1 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.992614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b4fb2-fcc8-4f48-8a1b-aee938017aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.993346 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b4fb2-fcc8-4f48-8a1b-aee938017aa1 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:11:59.995697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 816/1635] 10.222.0.16 () {54 vars in 912 bytes} [Thu Jun 23 13:11:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:11:59.997894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9ee82-b3ee-4444-83d1-475ccd0f7716 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:11:59.998589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9ee82-b3ee-4444-83d1-475ccd0f7716 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:11:59.998976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9ee82-b3ee-4444-83d1-475ccd0f7716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:00.002171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 820/1636] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:11:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:00.008179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700ae1-f84f-4e8c-9e61-8949d6ff566c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:00.008496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700ae1-f84f-4e8c-9e61-8949d6ff566c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:00.008778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700ae1-f84f-4e8c-9e61-8949d6ff566c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:00.056431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-50700ae1-f84f-4e8c-9e61-8949d6ff566c None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:00.059564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-50700ae1-f84f-4e8c-9e61-8949d6ff566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:00.080213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-87f9ee82-b3ee-4444-83d1-475ccd0f7716 None None] MFA Rules not processed for user `847dd2f24a4c431e90c0d7163e258403`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:00.086190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-87f9ee82-b3ee-4444-83d1-475ccd0f7716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:00.182057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 821/1637] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:12:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:00.188127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf2c23-a5a0-4869-aae5-64e577eb87d0 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:00.188127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf2c23-a5a0-4869-aae5-64e577eb87d0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:00.188127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf2c23-a5a0-4869-aae5-64e577eb87d0 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:00.188127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 822/1638] 10.222.0.16 () {54 vars in 912 bytes} [Thu Jun 23 13:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:12:00.188127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf2c23-a5a0-4869-aae5-64e577eb87d0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:00.213808 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:00.226919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:00.244581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 817/1639] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:11:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:00.247257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35d467-779e-46a8-a652-c0e83e3c3a9c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:00.249695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35d467-779e-46a8-a652-c0e83e3c3a9c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:00.250334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35d467-779e-46a8-a652-c0e83e3c3a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:00.259398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf2c23-a5a0-4869-aae5-64e577eb87d0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:00.264078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46b5e-dd8a-485c-aaa9-d0aa3a0341dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:00.268356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46b5e-dd8a-485c-aaa9-d0aa3a0341dd service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:00.268356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46b5e-dd8a-485c-aaa9-d0aa3a0341dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:00.268356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46b5e-dd8a-485c-aaa9-d0aa3a0341dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:00.280045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-6b35d467-779e-46a8-a652-c0e83e3c3a9c None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:00.283158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6b35d467-779e-46a8-a652-c0e83e3c3a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:00.299624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 818/1640] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:12:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:00.301705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35d467-779e-46a8-a652-c0e83e3c3a9c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:00.324645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35d467-779e-46a8-a652-c0e83e3c3a9c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:00.334112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845525cc-fdb3-40bc-85c3-56879419e821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:00.335372 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845525cc-fdb3-40bc-85c3-56879419e821 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:00.336258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845525cc-fdb3-40bc-85c3-56879419e821 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:00.336258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845525cc-fdb3-40bc-85c3-56879419e821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:00.358477 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845525cc-fdb3-40bc-85c3-56879419e821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:00.360234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845525cc-fdb3-40bc-85c3-56879419e821 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:00.363841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c46b5e-dd8a-485c-aaa9-d0aa3a0341dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:00.366023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c46b5e-dd8a-485c-aaa9-d0aa3a0341dd service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:00.383124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 819/1641] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:00.397299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 823/1642] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:01.439244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845525cc-fdb3-40bc-85c3-56879419e821 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:01.450641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845525cc-fdb3-40bc-85c3-56879419e821 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:01.455699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d893286-28cd-4584-a7f8-2970076a0478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:01.456376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d893286-28cd-4584-a7f8-2970076a0478 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:01.456711 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d893286-28cd-4584-a7f8-2970076a0478 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:01.457339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d893286-28cd-4584-a7f8-2970076a0478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:01.482435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d893286-28cd-4584-a7f8-2970076a0478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:01.484302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d893286-28cd-4584-a7f8-2970076a0478 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:01.498475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 820/1643] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:01.616327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46b5e-dd8a-485c-aaa9-d0aa3a0341dd service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:01.629311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c46b5e-dd8a-485c-aaa9-d0aa3a0341dd service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:01.636336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd56140-f62b-48bd-acb3-c6c90010622f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:01.637760 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd56140-f62b-48bd-acb3-c6c90010622f service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:01.638747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd56140-f62b-48bd-acb3-c6c90010622f service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:01.639800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd56140-f62b-48bd-acb3-c6c90010622f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:01.662240 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd56140-f62b-48bd-acb3-c6c90010622f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:01.667013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd56140-f62b-48bd-acb3-c6c90010622f service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:01.691231 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 824/1644] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:02.090083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d893286-28cd-4584-a7f8-2970076a0478 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:02.227955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d893286-28cd-4584-a7f8-2970076a0478 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:02.235472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:02.236664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:02.237384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:02.237822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] PATH_INFO: `/v3/users/7344e4b33b80494092fcb4100883f4e2` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:02.239282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7344e4b33b80494092fcb4100883f4e2)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:02.242819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:02.510655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7344e4b33b80494092fcb4100883f4e2'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:02.540307 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7344e4b33b80494092fcb4100883f4e2'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:02.662422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7344e4b33b80494092fcb4100883f4e2'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:02.663117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7344e4b33b80494092fcb4100883f4e2'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:02.663747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7344e4b33b80494092fcb4100883f4e2'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:02.683378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 821/1645] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:02 2022] DELETE /identity/v3/users/7344e4b33b80494092fcb4100883f4e2 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:02.686376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a818a-2ea0-421b-a16d-a48936c46ba8 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:02.686376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a818a-2ea0-421b-a16d-a48936c46ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:02.686376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a818a-2ea0-421b-a16d-a48936c46ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:02.708573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1b2a818a-2ea0-421b-a16d-a48936c46ba8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:02.710264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1b2a818a-2ea0-421b-a16d-a48936c46ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:02.838619 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 825/1646] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:02.854389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:02.855924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:02.993515 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:03.021666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e640c1a-55f4-4abc-a2de-278bc94fc817 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:03.026064 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a812cde-a742-40ab-bac8-90a2013a7875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:03.027104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a812cde-a742-40ab-bac8-90a2013a7875 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:03.027104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a812cde-a742-40ab-bac8-90a2013a7875 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:03.027265 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a812cde-a742-40ab-bac8-90a2013a7875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:03.043740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a812cde-a742-40ab-bac8-90a2013a7875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:03.045822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a812cde-a742-40ab-bac8-90a2013a7875 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:03.074396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 822/1647] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:03.194779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a818a-2ea0-421b-a16d-a48936c46ba8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:03.196375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1b2a818a-2ea0-421b-a16d-a48936c46ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:03.229017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a818a-2ea0-421b-a16d-a48936c46ba8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:03.239658 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e87b6d-c46f-4f41-ac40-f88dddafbe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:03.242822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e87b6d-c46f-4f41-ac40-f88dddafbe22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:03.243246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e87b6d-c46f-4f41-ac40-f88dddafbe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:03.243842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e87b6d-c46f-4f41-ac40-f88dddafbe22 admin admin] PATH_INFO: `/v3/users/b90c08b70d854eacbd2583d11ad67193` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:03.258240 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e87b6d-c46f-4f41-ac40-f88dddafbe22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90c08b70d854eacbd2583d11ad67193)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:03.264347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: WARNING py.warnings [None req-10e87b6d-c46f-4f41-ac40-f88dddafbe22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:12:03.264347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: warnings.warn(msg) Jun 23 13:12:03.264347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: Jun 23 13:12:03.265334 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e87b6d-c46f-4f41-ac40-f88dddafbe22 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:03.707457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a812cde-a742-40ab-bac8-90a2013a7875 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:03.710155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2a812cde-a742-40ab-bac8-90a2013a7875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:03.724286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-10e87b6d-c46f-4f41-ac40-f88dddafbe22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90c08b70d854eacbd2583d11ad67193'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:03.732505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a812cde-a742-40ab-bac8-90a2013a7875 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:03.745496 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:03.749006 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:03.750090 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:03.750517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] PATH_INFO: `/v3/projects/dddde9d76d9b409e8bf22aa003b2e5dc` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:03.755376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dddde9d76d9b409e8bf22aa003b2e5dc)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:03.757241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: WARNING py.warnings [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 13:12:03.757241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: warnings.warn(msg) Jun 23 13:12:03.757241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: Jun 23 13:12:03.759304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:03.791214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:03.813681 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-10e87b6d-c46f-4f41-ac40-f88dddafbe22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90c08b70d854eacbd2583d11ad67193'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:03.966402 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-10e87b6d-c46f-4f41-ac40-f88dddafbe22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90c08b70d854eacbd2583d11ad67193'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:03.967246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-10e87b6d-c46f-4f41-ac40-f88dddafbe22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90c08b70d854eacbd2583d11ad67193'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:03.968027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-10e87b6d-c46f-4f41-ac40-f88dddafbe22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90c08b70d854eacbd2583d11ad67193'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:04.035385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 826/1648] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:03 2022] DELETE /identity/v3/users/b90c08b70d854eacbd2583d11ad67193 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:04.038552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fbcea-9ce4-4614-b247-b981a181906f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:04.040339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fbcea-9ce4-4614-b247-b981a181906f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:04.040662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fbcea-9ce4-4614-b247-b981a181906f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:04.094150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dddde9d76d9b409e8bf22aa003b2e5dc', 'request_id': 'req-a808a130-9ceb-459b-8568-253ac60bece8'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:04.101348 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-428fbcea-9ce4-4614-b247-b981a181906f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:04.105054 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-428fbcea-9ce4-4614-b247-b981a181906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:04.177295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dddde9d76d9b409e8bf22aa003b2e5dc', 'request_id': 'req-a808a130-9ceb-459b-8568-253ac60bece8'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:04.196766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dddde9d76d9b409e8bf22aa003b2e5dc', 'request_id': 'req-a808a130-9ceb-459b-8568-253ac60bece8'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:04.225772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] The token cache is being invalidate because project dddde9d76d9b409e8bf22aa003b2e5dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:04.227633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:04.228499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a808a130-9ceb-459b-8568-253ac60bece8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:04.234874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 823/1649] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:03 2022] DELETE /identity/v3/projects/dddde9d76d9b409e8bf22aa003b2e5dc => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:04.237050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a47b4-dde9-4ced-bf17-05aa737bf0b9 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:04.239234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a47b4-dde9-4ced-bf17-05aa737bf0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:04.239366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a47b4-dde9-4ced-bf17-05aa737bf0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:04.287682 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 827/1650] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:04.291576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-234a47b4-dde9-4ced-bf17-05aa737bf0b9 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:04.293250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-234a47b4-dde9-4ced-bf17-05aa737bf0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:04.301834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fbcea-9ce4-4614-b247-b981a181906f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:04.303287 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-428fbcea-9ce4-4614-b247-b981a181906f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:04.315682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 824/1651] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:04.317217 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287aee-925a-4add-bc02-8e8c035379bb None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:04.319996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287aee-925a-4add-bc02-8e8c035379bb None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:04.320312 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48287aee-925a-4add-bc02-8e8c035379bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:04.368385 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-48287aee-925a-4add-bc02-8e8c035379bb None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:04.372610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-48287aee-925a-4add-bc02-8e8c035379bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:04.398952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 825/1652] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:04.404795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48287aee-925a-4add-bc02-8e8c035379bb None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:04.458099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48287aee-925a-4add-bc02-8e8c035379bb None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:04.476382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f69240-db01-4052-9cb8-f9c4b6d4ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:04.477321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f69240-db01-4052-9cb8-f9c4b6d4ba10 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:04.478010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f69240-db01-4052-9cb8-f9c4b6d4ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:04.478459 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f69240-db01-4052-9cb8-f9c4b6d4ba10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:04.479759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f69240-db01-4052-9cb8-f9c4b6d4ba10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:04.482230 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f69240-db01-4052-9cb8-f9c4b6d4ba10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:04.484610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f69240-db01-4052-9cb8-f9c4b6d4ba10 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:04.499331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fbcea-9ce4-4614-b247-b981a181906f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:04.511792 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcf480-54ce-44b1-823a-9f97af8e761a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:04.512518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcf480-54ce-44b1-823a-9f97af8e761a service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:04.512864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcf480-54ce-44b1-823a-9f97af8e761a service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:04.513919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcf480-54ce-44b1-823a-9f97af8e761a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:04.529880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 826/1653] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:04.529880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f69240-db01-4052-9cb8-f9c4b6d4ba10 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:04.536096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcf480-54ce-44b1-823a-9f97af8e761a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:04.538058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcf480-54ce-44b1-823a-9f97af8e761a service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:04.544198 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f69240-db01-4052-9cb8-f9c4b6d4ba10 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:04.559741 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 828/1654] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:04.569692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc53ad4-5291-417a-b8d6-0889b2b5a689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:04.569692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc53ad4-5291-417a-b8d6-0889b2b5a689 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:04.571652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc53ad4-5291-417a-b8d6-0889b2b5a689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:04.572011 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc53ad4-5291-417a-b8d6-0889b2b5a689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:04.574898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc53ad4-5291-417a-b8d6-0889b2b5a689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:04.578965 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc53ad4-5291-417a-b8d6-0889b2b5a689 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:04.719370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcf480-54ce-44b1-823a-9f97af8e761a service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:04.728918 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 827/1655] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:04 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:04.739175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcf480-54ce-44b1-823a-9f97af8e761a service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:04.868222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd626440-f086-4003-b175-4645977ee0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:04.869119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd626440-f086-4003-b175-4645977ee0de admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:04.869597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd626440-f086-4003-b175-4645977ee0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:04.870243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd626440-f086-4003-b175-4645977ee0de admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:04.871257 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd626440-f086-4003-b175-4645977ee0de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:04.885092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd626440-f086-4003-b175-4645977ee0de admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:04.915661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc53ad4-5291-417a-b8d6-0889b2b5a689 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:04.917595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7dc53ad4-5291-417a-b8d6-0889b2b5a689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:04.947780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc53ad4-5291-417a-b8d6-0889b2b5a689 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:04.957858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0830d0-e976-4781-bb84-01a873360da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:04.958760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0830d0-e976-4781-bb84-01a873360da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:04.959041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0830d0-e976-4781-bb84-01a873360da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:04.959316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0830d0-e976-4781-bb84-01a873360da4 admin admin] PATH_INFO: `/v3/users/f57590f413d14639882da6e938d25313` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:04.963901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0830d0-e976-4781-bb84-01a873360da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57590f413d14639882da6e938d25313)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:04.967976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0830d0-e976-4781-bb84-01a873360da4 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:05.033656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 829/1656] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:04 2022] POST /identity/v3/users => generated 283 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:05.040459 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd626440-f086-4003-b175-4645977ee0de admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:05.063059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd626440-f086-4003-b175-4645977ee0de admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:05.077801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67aa70-06a3-4d6b-a36a-25a415239098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:05.079089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67aa70-06a3-4d6b-a36a-25a415239098 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:05.079661 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67aa70-06a3-4d6b-a36a-25a415239098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:05.080220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67aa70-06a3-4d6b-a36a-25a415239098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:05.081957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67aa70-06a3-4d6b-a36a-25a415239098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:05.084118 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67aa70-06a3-4d6b-a36a-25a415239098 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:05.104848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 830/1657] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:05.106026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67aa70-06a3-4d6b-a36a-25a415239098 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:05.119584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67aa70-06a3-4d6b-a36a-25a415239098 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:05.128412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61ba52-843d-456a-96a4-f9ed49032b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:05.129296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61ba52-843d-456a-96a4-f9ed49032b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:05.129680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61ba52-843d-456a-96a4-f9ed49032b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:05.130096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61ba52-843d-456a-96a4-f9ed49032b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:05.131053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61ba52-843d-456a-96a4-f9ed49032b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:05.133083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61ba52-843d-456a-96a4-f9ed49032b95 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:05.160043 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 831/1658] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:05.163860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61ba52-843d-456a-96a4-f9ed49032b95 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:05.175470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61ba52-843d-456a-96a4-f9ed49032b95 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:05.182609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2fb61-6bc9-46ea-a1e8-9f60a57c75c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:05.183780 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2fb61-6bc9-46ea-a1e8-9f60a57c75c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:05.184221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2fb61-6bc9-46ea-a1e8-9f60a57c75c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:05.184685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2fb61-6bc9-46ea-a1e8-9f60a57c75c8 admin admin] PATH_INFO: `/v3/projects/0713e9202b4c46ba949d091344c04899/users/5df945c65e1e4eac958d7b1b32be6716/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:05.213321 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2fb61-6bc9-46ea-a1e8-9f60a57c75c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0713e9202b4c46ba949d091344c04899, user_id=5df945c65e1e4eac958d7b1b32be6716, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:05.218633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2fb61-6bc9-46ea-a1e8-9f60a57c75c8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:05.257325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5d0830d0-e976-4781-bb84-01a873360da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57590f413d14639882da6e938d25313'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:05.273664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5d0830d0-e976-4781-bb84-01a873360da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57590f413d14639882da6e938d25313'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:05.312208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 832/1659] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:05 2022] PUT /identity/v3/projects/0713e9202b4c46ba949d091344c04899/users/5df945c65e1e4eac958d7b1b32be6716/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:05.316993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d651c-fd30-4abf-b793-d545ffca34d9 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:05.316993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d651c-fd30-4abf-b793-d545ffca34d9 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:05.316993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d651c-fd30-4abf-b793-d545ffca34d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:05.337404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:05.366125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8c6d651c-fd30-4abf-b793-d545ffca34d9 None None] MFA Rules not processed for user `5df945c65e1e4eac958d7b1b32be6716`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:05.367798 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8c6d651c-fd30-4abf-b793-d545ffca34d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:05.390149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5d0830d0-e976-4781-bb84-01a873360da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57590f413d14639882da6e938d25313'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:05.390882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5d0830d0-e976-4781-bb84-01a873360da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57590f413d14639882da6e938d25313'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:05.392036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5d0830d0-e976-4781-bb84-01a873360da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57590f413d14639882da6e938d25313'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:05.419036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 828/1660] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:04 2022] DELETE /identity/v3/users/f57590f413d14639882da6e938d25313 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:05.422151 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9994328-5c7d-4d6b-bc75-b5afba0f8620 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:05.422687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9994328-5c7d-4d6b-bc75-b5afba0f8620 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:05.423054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9994328-5c7d-4d6b-bc75-b5afba0f8620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:05.456693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d9994328-5c7d-4d6b-bc75-b5afba0f8620 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:05.458163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d9994328-5c7d-4d6b-bc75-b5afba0f8620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:05.473846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 833/1661] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:05.480458 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d651c-fd30-4abf-b793-d545ffca34d9 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:05.489729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8c6d651c-fd30-4abf-b793-d545ffca34d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:05.545730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:05.583218 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 829/1662] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:05.636866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9994328-5c7d-4d6b-bc75-b5afba0f8620 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:05.641028 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d9994328-5c7d-4d6b-bc75-b5afba0f8620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:05.824109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9994328-5c7d-4d6b-bc75-b5afba0f8620 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:05.847503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b5f1-b8fe-45f3-bc6a-2aa9e498cad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:05.847503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b5f1-b8fe-45f3-bc6a-2aa9e498cad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:05.847503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b5f1-b8fe-45f3-bc6a-2aa9e498cad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:05.847503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9b5f1-b8fe-45f3-bc6a-2aa9e498cad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:05.872492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9b5f1-b8fe-45f3-bc6a-2aa9e498cad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:05.874309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9b5f1-b8fe-45f3-bc6a-2aa9e498cad2 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:05.889462 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 830/1663] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:06.037550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d651c-fd30-4abf-b793-d545ffca34d9 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:06.056139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4108a71-f3ee-4131-8689-bea57f8b386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:06.057369 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4108a71-f3ee-4131-8689-bea57f8b386a admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:06.057859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4108a71-f3ee-4131-8689-bea57f8b386a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:06.058315 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4108a71-f3ee-4131-8689-bea57f8b386a admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:06.059576 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4108a71-f3ee-4131-8689-bea57f8b386a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:06.062534 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4108a71-f3ee-4131-8689-bea57f8b386a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:06.226427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 834/1664] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:05 2022] POST /identity/v3/projects => generated 365 bytes in 747 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:06.230592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b5f1-b8fe-45f3-bc6a-2aa9e498cad2 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:06.253404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9b5f1-b8fe-45f3-bc6a-2aa9e498cad2 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:06.420729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ada9c-9a1a-41c1-a1d0-9a6ae40b4964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:06.421521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ada9c-9a1a-41c1-a1d0-9a6ae40b4964 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:06.421812 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ada9c-9a1a-41c1-a1d0-9a6ae40b4964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:06.422150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ada9c-9a1a-41c1-a1d0-9a6ae40b4964 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:06.422920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ada9c-9a1a-41c1-a1d0-9a6ae40b4964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:06.429329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ada9c-9a1a-41c1-a1d0-9a6ae40b4964 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:06.562748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 831/1665] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:06 2022] POST /identity/v3/users => generated 289 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:06.566281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4108a71-f3ee-4131-8689-bea57f8b386a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:06.586411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4108a71-f3ee-4131-8689-bea57f8b386a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:06.605746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed7fdd-cb5a-4e59-9ec8-782441944e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:06.606862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed7fdd-cb5a-4e59-9ec8-782441944e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:06.607388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed7fdd-cb5a-4e59-9ec8-782441944e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:06.608957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed7fdd-cb5a-4e59-9ec8-782441944e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:06.610165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed7fdd-cb5a-4e59-9ec8-782441944e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:06.612099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed7fdd-cb5a-4e59-9ec8-782441944e36 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:06.630773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 835/1666] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:06.632038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ada9c-9a1a-41c1-a1d0-9a6ae40b4964 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:06.646257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ada9c-9a1a-41c1-a1d0-9a6ae40b4964 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:06.666387 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ada6e7-dd17-4cbe-94ab-3d0ae5180a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:06.667873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ada6e7-dd17-4cbe-94ab-3d0ae5180a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:06.668146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ada6e7-dd17-4cbe-94ab-3d0ae5180a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:06.673422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ada6e7-dd17-4cbe-94ab-3d0ae5180a39 admin admin] PATH_INFO: `/v3/projects/c3dbb93fc77045a9acfa8263ad9d0123/users/b32e30f74872406e83a0c12062e9d9d1/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:06.721315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ada6e7-dd17-4cbe-94ab-3d0ae5180a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3dbb93fc77045a9acfa8263ad9d0123, user_id=b32e30f74872406e83a0c12062e9d9d1, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:06.740715 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ada6e7-dd17-4cbe-94ab-3d0ae5180a39 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:06.876427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 832/1667] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:06 2022] PUT /identity/v3/projects/c3dbb93fc77045a9acfa8263ad9d0123/users/b32e30f74872406e83a0c12062e9d9d1/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:06.880643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed7fdd-cb5a-4e59-9ec8-782441944e36 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:06.908609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed7fdd-cb5a-4e59-9ec8-782441944e36 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:06.970151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:07.090843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965bf1c-b0b4-4c1b-9a26-e637b15cbfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:07.093119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965bf1c-b0b4-4c1b-9a26-e637b15cbfac admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:07.093611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965bf1c-b0b4-4c1b-9a26-e637b15cbfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:07.094087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965bf1c-b0b4-4c1b-9a26-e637b15cbfac admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:07.095136 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965bf1c-b0b4-4c1b-9a26-e637b15cbfac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:07.097550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0965bf1c-b0b4-4c1b-9a26-e637b15cbfac admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:07.149509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 836/1668] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:07.153824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ada6e7-dd17-4cbe-94ab-3d0ae5180a39 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:07.160097 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:07.168196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ada6e7-dd17-4cbe-94ab-3d0ae5180a39 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:07.177664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989742cf-b387-45c7-87b7-41e59da55e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:07.188024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989742cf-b387-45c7-87b7-41e59da55e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:07.188024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989742cf-b387-45c7-87b7-41e59da55e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:07.188024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989742cf-b387-45c7-87b7-41e59da55e7c admin admin] PATH_INFO: `/v3/projects/c3dbb93fc77045a9acfa8263ad9d0123/users/b32e30f74872406e83a0c12062e9d9d1/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:07.188024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989742cf-b387-45c7-87b7-41e59da55e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3dbb93fc77045a9acfa8263ad9d0123, user_id=b32e30f74872406e83a0c12062e9d9d1, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:07.188024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989742cf-b387-45c7-87b7-41e59da55e7c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:07.205907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 833/1669] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:07 2022] PUT /identity/v3/projects/c3dbb93fc77045a9acfa8263ad9d0123/users/b32e30f74872406e83a0c12062e9d9d1/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:07.215426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81547fad-6f6c-4dc8-81ce-0518bceaea88 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:07.216047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81547fad-6f6c-4dc8-81ce-0518bceaea88 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:07.216554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81547fad-6f6c-4dc8-81ce-0518bceaea88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:07.293088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-81547fad-6f6c-4dc8-81ce-0518bceaea88 None None] MFA Rules not processed for user `b32e30f74872406e83a0c12062e9d9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:07.298466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-81547fad-6f6c-4dc8-81ce-0518bceaea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:07.302945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989742cf-b387-45c7-87b7-41e59da55e7c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:07.305294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-989742cf-b387-45c7-87b7-41e59da55e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:07.401738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 837/1670] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:07.413176 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81547fad-6f6c-4dc8-81ce-0518bceaea88 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:07.417562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-81547fad-6f6c-4dc8-81ce-0518bceaea88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:07.507266 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989742cf-b387-45c7-87b7-41e59da55e7c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:07.523596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:07.524644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:07.525617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:07.526025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] PATH_INFO: `/v3/projects/c89160b5ba1b4eb2ad8955a6423f4cde` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:07.527902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89160b5ba1b4eb2ad8955a6423f4cde)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:07.533798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:07.568718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81547fad-6f6c-4dc8-81ce-0518bceaea88 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:07.578568 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523a536-a98b-4574-a7f1-a115c142d0e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:07.582273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523a536-a98b-4574-a7f1-a115c142d0e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:07.582273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523a536-a98b-4574-a7f1-a115c142d0e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:07.582273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523a536-a98b-4574-a7f1-a115c142d0e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:07.606132 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523a536-a98b-4574-a7f1-a115c142d0e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:07.611046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523a536-a98b-4574-a7f1-a115c142d0e4 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:07.635919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 838/1671] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:07.744934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89160b5ba1b4eb2ad8955a6423f4cde', 'request_id': 'req-99c6b578-6bc5-4b36-a036-bc5412a0ae98'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:07.831615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89160b5ba1b4eb2ad8955a6423f4cde', 'request_id': 'req-99c6b578-6bc5-4b36-a036-bc5412a0ae98'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:07.836962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89160b5ba1b4eb2ad8955a6423f4cde', 'request_id': 'req-99c6b578-6bc5-4b36-a036-bc5412a0ae98'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:07.878481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] The token cache is being invalidate because project c89160b5ba1b4eb2ad8955a6423f4cde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:07.882901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:07.890979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:07.890979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 834/1672] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:07 2022] DELETE /identity/v3/projects/c89160b5ba1b4eb2ad8955a6423f4cde => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:07.893928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523a536-a98b-4574-a7f1-a115c142d0e4 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:07.912689 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523a536-a98b-4574-a7f1-a115c142d0e4 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:08.032386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:08.034701 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:08.054832 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:08.055988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:08.056269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:08.056543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] PATH_INFO: `/v3/users/847dd2f24a4c431e90c0d7163e258403` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:08.063712 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=847dd2f24a4c431e90c0d7163e258403)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:08.064917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:08.084075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:08.247274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c6b578-6bc5-4b36-a036-bc5412a0ae98 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:08.275869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:08.284147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:08.284977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:08.284977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] PATH_INFO: `/v3/users/d0b450aa924f4ac399d010afcccfd18d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:08.290461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b450aa924f4ac399d010afcccfd18d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:08.300177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:08.339808 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '847dd2f24a4c431e90c0d7163e258403'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:08.378746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '847dd2f24a4c431e90c0d7163e258403'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:08.385784 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:08.475873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '847dd2f24a4c431e90c0d7163e258403'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:08.477550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '847dd2f24a4c431e90c0d7163e258403'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:08.478467 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '847dd2f24a4c431e90c0d7163e258403'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:08.511428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 839/1673] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:07 2022] DELETE /identity/v3/users/847dd2f24a4c431e90c0d7163e258403 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:08.516383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:08.519208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:08.652849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b450aa924f4ac399d010afcccfd18d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:08.691786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b450aa924f4ac399d010afcccfd18d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:08.694143 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4acb9e-4443-48bf-a6c8-76a20a832424 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:08.704475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326f36f-e2c7-4dbe-9042-b9c3c1b4cfa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:08.705222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326f36f-e2c7-4dbe-9042-b9c3c1b4cfa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:08.705510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326f36f-e2c7-4dbe-9042-b9c3c1b4cfa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:08.705795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326f36f-e2c7-4dbe-9042-b9c3c1b4cfa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:08.708163 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e326f36f-e2c7-4dbe-9042-b9c3c1b4cfa2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:08.767585 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b450aa924f4ac399d010afcccfd18d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:08.768245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b450aa924f4ac399d010afcccfd18d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:08.768957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b450aa924f4ac399d010afcccfd18d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:08.801781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 835/1674] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:08 2022] DELETE /identity/v3/users/d0b450aa924f4ac399d010afcccfd18d => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:08.801781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:08.817792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:08.894475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326f36f-e2c7-4dbe-9042-b9c3c1b4cfa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:08.896250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326f36f-e2c7-4dbe-9042-b9c3c1b4cfa2 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:08.925470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 840/1675] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:08.929244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d389aaa-dab9-48b0-b9f2-5d5ada4c0662 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:08.929523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d389aaa-dab9-48b0-b9f2-5d5ada4c0662 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:08.929791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d389aaa-dab9-48b0-b9f2-5d5ada4c0662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:09.000601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7d389aaa-dab9-48b0-b9f2-5d5ada4c0662 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:09.003646 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7d389aaa-dab9-48b0-b9f2-5d5ada4c0662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:09.029058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279f18f-c034-40ea-ba16-cb4d7084a48e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:09.038392 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 841/1676] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:09.046625 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32493fb-6e6a-4ea6-b7de-881a962c4744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:09.047762 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32493fb-6e6a-4ea6-b7de-881a962c4744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:09.048048 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32493fb-6e6a-4ea6-b7de-881a962c4744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:09.050462 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32493fb-6e6a-4ea6-b7de-881a962c4744 admin admin] PATH_INFO: `/v3/projects/03629e63ad5d4686811609a7b43e3e0d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:09.053678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32493fb-6e6a-4ea6-b7de-881a962c4744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03629e63ad5d4686811609a7b43e3e0d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:09.060454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32493fb-6e6a-4ea6-b7de-881a962c4744 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:09.119907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d389aaa-dab9-48b0-b9f2-5d5ada4c0662 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:09.121659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7d389aaa-dab9-48b0-b9f2-5d5ada4c0662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:09.149402 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:09.266816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d389aaa-dab9-48b0-b9f2-5d5ada4c0662 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:09.280735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300eebe-238c-4d63-b005-8d4b34497ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:09.281103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300eebe-238c-4d63-b005-8d4b34497ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:09.281340 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300eebe-238c-4d63-b005-8d4b34497ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:09.281618 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300eebe-238c-4d63-b005-8d4b34497ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:09.301929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300eebe-238c-4d63-b005-8d4b34497ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:09.303409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300eebe-238c-4d63-b005-8d4b34497ef3 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:09.335401 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 842/1677] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:09.357084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c32493fb-6e6a-4ea6-b7de-881a962c4744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03629e63ad5d4686811609a7b43e3e0d', 'request_id': 'req-c32493fb-6e6a-4ea6-b7de-881a962c4744'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:09.442152 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c32493fb-6e6a-4ea6-b7de-881a962c4744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03629e63ad5d4686811609a7b43e3e0d', 'request_id': 'req-c32493fb-6e6a-4ea6-b7de-881a962c4744'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:09.452904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c32493fb-6e6a-4ea6-b7de-881a962c4744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03629e63ad5d4686811609a7b43e3e0d', 'request_id': 'req-c32493fb-6e6a-4ea6-b7de-881a962c4744'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:09.480278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c32493fb-6e6a-4ea6-b7de-881a962c4744 admin admin] The token cache is being invalidate because project 03629e63ad5d4686811609a7b43e3e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:09.481104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c32493fb-6e6a-4ea6-b7de-881a962c4744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:09.483100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c32493fb-6e6a-4ea6-b7de-881a962c4744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:09.488859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 836/1678] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:08 2022] DELETE /identity/v3/projects/03629e63ad5d4686811609a7b43e3e0d => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:09.490752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44cb9a-a01a-4324-a225-cd3e84f131ae None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:09.491220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44cb9a-a01a-4324-a225-cd3e84f131ae None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:09.491306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44cb9a-a01a-4324-a225-cd3e84f131ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:09.549457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fc44cb9a-a01a-4324-a225-cd3e84f131ae None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:09.550963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fc44cb9a-a01a-4324-a225-cd3e84f131ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:09.754928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 843/1679] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:09.756679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed44d5f-4d03-4dc4-bcf4-f32e7dd64219 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:09.757320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed44d5f-4d03-4dc4-bcf4-f32e7dd64219 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:09.757594 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed44d5f-4d03-4dc4-bcf4-f32e7dd64219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:09.807513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-eed44d5f-4d03-4dc4-bcf4-f32e7dd64219 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:09.808786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-eed44d5f-4d03-4dc4-bcf4-f32e7dd64219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:09.843539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 837/1680] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:09.847089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44cb9a-a01a-4324-a225-cd3e84f131ae None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:09.877051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44cb9a-a01a-4324-a225-cd3e84f131ae None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:09.890186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151e6bd-d393-4ef0-8415-42a5c14474a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:09.895042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151e6bd-d393-4ef0-8415-42a5c14474a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:09.895689 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151e6bd-d393-4ef0-8415-42a5c14474a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:09.896000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151e6bd-d393-4ef0-8415-42a5c14474a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:09.896823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151e6bd-d393-4ef0-8415-42a5c14474a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:09.897140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151e6bd-d393-4ef0-8415-42a5c14474a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:09.898944 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e151e6bd-d393-4ef0-8415-42a5c14474a9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:09.914545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 844/1681] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:12:09.919260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed44d5f-4d03-4dc4-bcf4-f32e7dd64219 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:09.938416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed44d5f-4d03-4dc4-bcf4-f32e7dd64219 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:09.944217 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3383d-a104-4134-a2fc-b5e0ebe27153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:09.945059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3383d-a104-4134-a2fc-b5e0ebe27153 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:09.945449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3383d-a104-4134-a2fc-b5e0ebe27153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:09.945829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b3383d-a104-4134-a2fc-b5e0ebe27153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:09.947741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3383d-a104-4134-a2fc-b5e0ebe27153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:09.949836 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b3383d-a104-4134-a2fc-b5e0ebe27153 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:11.143377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151e6bd-d393-4ef0-8415-42a5c14474a9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:11.145469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e151e6bd-d393-4ef0-8415-42a5c14474a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:11.154214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 838/1682] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:09 2022] POST /identity/v3/projects => generated 385 bytes in 1236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:11.158018 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3383d-a104-4134-a2fc-b5e0ebe27153 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:11.171255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151e6bd-d393-4ef0-8415-42a5c14474a9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:11.289666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b3383d-a104-4134-a2fc-b5e0ebe27153 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:11.298194 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02908d-8614-46b4-b212-78cc3eb8e9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:11.298912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02908d-8614-46b4-b212-78cc3eb8e9ee admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:11.299898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02908d-8614-46b4-b212-78cc3eb8e9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:11.301081 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02908d-8614-46b4-b212-78cc3eb8e9ee admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:11.301772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02908d-8614-46b4-b212-78cc3eb8e9ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:11.306900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02908d-8614-46b4-b212-78cc3eb8e9ee admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:11.348141 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796585b-e0bc-4021-b2e4-996d6f00ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:11.349079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796585b-e0bc-4021-b2e4-996d6f00ab85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:11.349370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796585b-e0bc-4021-b2e4-996d6f00ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:11.349748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796585b-e0bc-4021-b2e4-996d6f00ab85 admin admin] PATH_INFO: `/v3/projects/27df07e48efb4729a11018f87f4b2114` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:11.351625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796585b-e0bc-4021-b2e4-996d6f00ab85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27df07e48efb4729a11018f87f4b2114)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:11.355899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796585b-e0bc-4021-b2e4-996d6f00ab85 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:11.403856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 839/1683] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:11 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:11.408044 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02908d-8614-46b4-b212-78cc3eb8e9ee admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:11.432149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02908d-8614-46b4-b212-78cc3eb8e9ee admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:11.446979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65259b-27ad-403e-b5ac-7a11e4f9c70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:11.447649 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65259b-27ad-403e-b5ac-7a11e4f9c70d admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:11.447995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65259b-27ad-403e-b5ac-7a11e4f9c70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:11.448327 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65259b-27ad-403e-b5ac-7a11e4f9c70d admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:11.451593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65259b-27ad-403e-b5ac-7a11e4f9c70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:11.454933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65259b-27ad-403e-b5ac-7a11e4f9c70d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:11.476956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 840/1684] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:11.482938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65259b-27ad-403e-b5ac-7a11e4f9c70d admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:11.494017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65259b-27ad-403e-b5ac-7a11e4f9c70d admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:11.505080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c46fe-332d-4573-803d-0e4c035dd637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:11.514430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c46fe-332d-4573-803d-0e4c035dd637 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:11.514738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c46fe-332d-4573-803d-0e4c035dd637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:11.515030 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c46fe-332d-4573-803d-0e4c035dd637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:11.519517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c46fe-332d-4573-803d-0e4c035dd637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:11.527503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c46fe-332d-4573-803d-0e4c035dd637 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:11.542537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5796585b-e0bc-4021-b2e4-996d6f00ab85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27df07e48efb4729a11018f87f4b2114', 'request_id': 'req-5796585b-e0bc-4021-b2e4-996d6f00ab85'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:11.558390 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 841/1685] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:11.559128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c46fe-332d-4573-803d-0e4c035dd637 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:11.570971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c46fe-332d-4573-803d-0e4c035dd637 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:11.623364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5796585b-e0bc-4021-b2e4-996d6f00ab85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27df07e48efb4729a11018f87f4b2114', 'request_id': 'req-5796585b-e0bc-4021-b2e4-996d6f00ab85'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:11.631147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5796585b-e0bc-4021-b2e4-996d6f00ab85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27df07e48efb4729a11018f87f4b2114', 'request_id': 'req-5796585b-e0bc-4021-b2e4-996d6f00ab85'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:11.659983 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5796585b-e0bc-4021-b2e4-996d6f00ab85 admin admin] The token cache is being invalidate because project 27df07e48efb4729a11018f87f4b2114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:11.660407 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5796585b-e0bc-4021-b2e4-996d6f00ab85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:11.664196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5796585b-e0bc-4021-b2e4-996d6f00ab85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:11.669465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 845/1686] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:11 2022] DELETE /identity/v3/projects/27df07e48efb4729a11018f87f4b2114 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:11.676363 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95147db1-5eef-4d56-b1fa-62e4b02e5e58 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:11.676660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95147db1-5eef-4d56-b1fa-62e4b02e5e58 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:11.677078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95147db1-5eef-4d56-b1fa-62e4b02e5e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:11.691287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:11.695665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc593588-8611-4f57-8559-aff330936903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:11.696679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593588-8611-4f57-8559-aff330936903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:11.696957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593588-8611-4f57-8559-aff330936903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:11.697247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593588-8611-4f57-8559-aff330936903 admin admin] PATH_INFO: `/v3/projects/83fe43aa6250455eb4abf73deff28303/users/663bebe17ff34ffd804f26d71ede2498/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:11.723154 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-95147db1-5eef-4d56-b1fa-62e4b02e5e58 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:11.724482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-95147db1-5eef-4d56-b1fa-62e4b02e5e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:11.737863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc593588-8611-4f57-8559-aff330936903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83fe43aa6250455eb4abf73deff28303, user_id=663bebe17ff34ffd804f26d71ede2498, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:11.746229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 846/1687] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:11.746565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc593588-8611-4f57-8559-aff330936903 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:11.758976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb801e-990d-4c67-b53f-ff802fbbdf5f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:11.759285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb801e-990d-4c67-b53f-ff802fbbdf5f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:11.759700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb801e-990d-4c67-b53f-ff802fbbdf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:11.787810 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c1fb801e-990d-4c67-b53f-ff802fbbdf5f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:11.787810 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c1fb801e-990d-4c67-b53f-ff802fbbdf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:11.810121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 847/1688] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:11.810990 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb801e-990d-4c67-b53f-ff802fbbdf5f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:11.823247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb801e-990d-4c67-b53f-ff802fbbdf5f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:11.832064 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5f3f2-046a-4f6a-a946-e4b37658b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:11.832928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5f3f2-046a-4f6a-a946-e4b37658b7da admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:11.839664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5f3f2-046a-4f6a-a946-e4b37658b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:11.839664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5f3f2-046a-4f6a-a946-e4b37658b7da admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:11.839664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5f3f2-046a-4f6a-a946-e4b37658b7da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:11.839664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5f3f2-046a-4f6a-a946-e4b37658b7da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:11.839664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f5f3f2-046a-4f6a-a946-e4b37658b7da admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:11.853039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 842/1689] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:11 2022] PUT /identity/v3/projects/83fe43aa6250455eb4abf73deff28303/users/663bebe17ff34ffd804f26d71ede2498/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:11.853511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 848/1690] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:11.853817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c67d04-cf7a-4351-91e8-83ebe7dd1d71 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:11.854116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c67d04-cf7a-4351-91e8-83ebe7dd1d71 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:11.854549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c67d04-cf7a-4351-91e8-83ebe7dd1d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:11.855927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5f3f2-046a-4f6a-a946-e4b37658b7da admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:11.875474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5f3f2-046a-4f6a-a946-e4b37658b7da admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:11.931264 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-a3c67d04-cf7a-4351-91e8-83ebe7dd1d71 None None] MFA Rules not processed for user `663bebe17ff34ffd804f26d71ede2498`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:11.940621 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-a3c67d04-cf7a-4351-91e8-83ebe7dd1d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:12.019836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f42f1-e423-4dae-ba57-d7e3d7169726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:12.021088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f42f1-e423-4dae-ba57-d7e3d7169726 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:12.022105 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f42f1-e423-4dae-ba57-d7e3d7169726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:12.022811 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f42f1-e423-4dae-ba57-d7e3d7169726 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:12.023667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f42f1-e423-4dae-ba57-d7e3d7169726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:12.026814 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f42f1-e423-4dae-ba57-d7e3d7169726 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:12.159705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 849/1691] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:11 2022] POST /identity/v3/projects => generated 385 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:12.160993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f42f1-e423-4dae-ba57-d7e3d7169726 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:12.196281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 843/1692] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:12.197438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c67d04-cf7a-4351-91e8-83ebe7dd1d71 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:12.200511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-a3c67d04-cf7a-4351-91e8-83ebe7dd1d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:12.232147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c67d04-cf7a-4351-91e8-83ebe7dd1d71 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:12.414192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f42f1-e423-4dae-ba57-d7e3d7169726 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:12.433042 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560d89f-f7c4-4b1c-acdd-6caeef3c5536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:12.433730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560d89f-f7c4-4b1c-acdd-6caeef3c5536 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:12.434016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560d89f-f7c4-4b1c-acdd-6caeef3c5536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:12.434299 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560d89f-f7c4-4b1c-acdd-6caeef3c5536 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:12.439892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560d89f-f7c4-4b1c-acdd-6caeef3c5536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:12.444093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650beaa1-0eba-45f7-8482-ff29d7540cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:12.444819 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650beaa1-0eba-45f7-8482-ff29d7540cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:12.445107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650beaa1-0eba-45f7-8482-ff29d7540cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:12.445207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4560d89f-f7c4-4b1c-acdd-6caeef3c5536 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:12.445420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650beaa1-0eba-45f7-8482-ff29d7540cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:12.446367 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650beaa1-0eba-45f7-8482-ff29d7540cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:12.453425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650beaa1-0eba-45f7-8482-ff29d7540cd6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:12.558148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 844/1693] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:12 2022] POST /identity/v3/projects => generated 387 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:12.561716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560d89f-f7c4-4b1c-acdd-6caeef3c5536 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:12.611682 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 850/1694] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:12 2022] POST /identity/v3/users => generated 293 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:12.613027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650beaa1-0eba-45f7-8482-ff29d7540cd6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:12.615751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-650beaa1-0eba-45f7-8482-ff29d7540cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:12.634782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650beaa1-0eba-45f7-8482-ff29d7540cd6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:12.775951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:12.785655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560d89f-f7c4-4b1c-acdd-6caeef3c5536 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:12.790296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:12.791621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:12.792023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:12.792493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] PATH_INFO: `/v3/projects/e49e0502fa164821948d5594c048d809` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:12.794773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49e0502fa164821948d5594c048d809)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:12.797912 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:12.799628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5e190-b633-4bba-b539-63e8d9f7303e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:12.800950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5e190-b633-4bba-b539-63e8d9f7303e admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:12.801430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5e190-b633-4bba-b539-63e8d9f7303e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:12.801716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5e190-b633-4bba-b539-63e8d9f7303e admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:12.802436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5e190-b633-4bba-b539-63e8d9f7303e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:12.806186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e5e190-b633-4bba-b539-63e8d9f7303e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:12.933955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 845/1695] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:12 2022] POST /identity/v3/users => generated 300 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:12.935493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5e190-b633-4bba-b539-63e8d9f7303e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:12.973699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e5e190-b633-4bba-b539-63e8d9f7303e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:12.989920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49e0502fa164821948d5594c048d809', 'request_id': 'req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:13.093720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49e0502fa164821948d5594c048d809', 'request_id': 'req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:13.104551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49e0502fa164821948d5594c048d809', 'request_id': 'req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:13.157956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] The token cache is being invalidate because project e49e0502fa164821948d5594c048d809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:13.158263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:13.164954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:13.178444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 851/1696] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:12 2022] DELETE /identity/v3/projects/e49e0502fa164821948d5594c048d809 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:13.179528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:13.190249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:13.265386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094ed51-92f0-436a-ab3b-ce033cb119e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:13.267442 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094ed51-92f0-436a-ab3b-ce033cb119e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:13.267846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094ed51-92f0-436a-ab3b-ce033cb119e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:13.269949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094ed51-92f0-436a-ab3b-ce033cb119e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:13.271693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094ed51-92f0-436a-ab3b-ce033cb119e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:13.274866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094ed51-92f0-436a-ab3b-ce033cb119e4 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:13.317294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 846/1697] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:13.318462 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094ed51-92f0-436a-ab3b-ce033cb119e4 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:13.331458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7094ed51-92f0-436a-ab3b-ce033cb119e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:13.333659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea6b5a-fca0-4c4f-ac61-5f94319b8316 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:13.350905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e1c85-a487-4946-90aa-878e58a32849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:13.352087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e1c85-a487-4946-90aa-878e58a32849 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:13.352380 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e1c85-a487-4946-90aa-878e58a32849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:13.352657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e1c85-a487-4946-90aa-878e58a32849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:13.353442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e1c85-a487-4946-90aa-878e58a32849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:13.358552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e1c85-a487-4946-90aa-878e58a32849 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:13.364235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094ed51-92f0-436a-ab3b-ce033cb119e4 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:13.373998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8c49c-eaed-4195-a227-268b5bd088d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:13.375653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8c49c-eaed-4195-a227-268b5bd088d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:13.376065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8c49c-eaed-4195-a227-268b5bd088d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:13.376453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8c49c-eaed-4195-a227-268b5bd088d5 admin admin] PATH_INFO: `/v3/users/2bba8de1f9974f1584ecda487e51dccc` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:13.379919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 852/1698] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:13.379919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e1c85-a487-4946-90aa-878e58a32849 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:13.380141 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8c49c-eaed-4195-a227-268b5bd088d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bba8de1f9974f1584ecda487e51dccc)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:13.380319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ea9e1c85-a487-4946-90aa-878e58a32849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:13.383346 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8c49c-eaed-4195-a227-268b5bd088d5 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:13.399367 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e1c85-a487-4946-90aa-878e58a32849 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:13.405118 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de4b9-c4ad-4f5f-8224-2e6e2d8aa49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:13.405813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de4b9-c4ad-4f5f-8224-2e6e2d8aa49f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:13.406461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de4b9-c4ad-4f5f-8224-2e6e2d8aa49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:13.406573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496de4b9-c4ad-4f5f-8224-2e6e2d8aa49f admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:13.407314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496de4b9-c4ad-4f5f-8224-2e6e2d8aa49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:13.409225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496de4b9-c4ad-4f5f-8224-2e6e2d8aa49f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:13.426781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 853/1699] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:13.427974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de4b9-c4ad-4f5f-8224-2e6e2d8aa49f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:13.477629 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496de4b9-c4ad-4f5f-8224-2e6e2d8aa49f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:13.485966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a735859-3c38-4917-9fb7-faac67a2059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:13.488023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a735859-3c38-4917-9fb7-faac67a2059b admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:13.488967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a735859-3c38-4917-9fb7-faac67a2059b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:13.489242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a735859-3c38-4917-9fb7-faac67a2059b admin admin] PATH_INFO: `/v3/projects/c84bd3ded9514766bf200bf7277c0287/users/5e45b058654e4d2ea08d9629d1e3ec14/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:13.515757 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a735859-3c38-4917-9fb7-faac67a2059b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84bd3ded9514766bf200bf7277c0287, user_id=5e45b058654e4d2ea08d9629d1e3ec14, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:13.521335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a735859-3c38-4917-9fb7-faac67a2059b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:13.628359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 854/1700] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:13 2022] PUT /identity/v3/projects/c84bd3ded9514766bf200bf7277c0287/users/5e45b058654e4d2ea08d9629d1e3ec14/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:13.638719 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a735859-3c38-4917-9fb7-faac67a2059b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:13.731702 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:13.766615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d0f8c49c-eaed-4195-a227-268b5bd088d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bba8de1f9974f1584ecda487e51dccc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:13.775826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a735859-3c38-4917-9fb7-faac67a2059b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:13.796051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4d2b5-dad2-4537-af9a-edec94a333b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:13.797411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d2b5-dad2-4537-af9a-edec94a333b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:13.797872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d2b5-dad2-4537-af9a-edec94a333b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:13.798343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4d2b5-dad2-4537-af9a-edec94a333b2 admin admin] PATH_INFO: `/v3/projects/fe0ef0214af240ba83a6dbeda4c8a3a4/users/1dae095ac1ad479281866a76dcbc4f40/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:13.806363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d0f8c49c-eaed-4195-a227-268b5bd088d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bba8de1f9974f1584ecda487e51dccc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:13.830481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4d2b5-dad2-4537-af9a-edec94a333b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0ef0214af240ba83a6dbeda4c8a3a4, user_id=1dae095ac1ad479281866a76dcbc4f40, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:13.834564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4d2b5-dad2-4537-af9a-edec94a333b2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:13.871019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:13.938771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d0f8c49c-eaed-4195-a227-268b5bd088d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bba8de1f9974f1584ecda487e51dccc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:13.940472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d0f8c49c-eaed-4195-a227-268b5bd088d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bba8de1f9974f1584ecda487e51dccc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:13.941243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d0f8c49c-eaed-4195-a227-268b5bd088d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bba8de1f9974f1584ecda487e51dccc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:13.976974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 855/1701] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:13 2022] PUT /identity/v3/projects/fe0ef0214af240ba83a6dbeda4c8a3a4/users/1dae095ac1ad479281866a76dcbc4f40/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:13.978220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4d2b5-dad2-4537-af9a-edec94a333b2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:13.982081 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7fa4d2b5-dad2-4537-af9a-edec94a333b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:13.995176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 847/1702] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:13 2022] DELETE /identity/v3/users/2bba8de1f9974f1584ecda487e51dccc => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:13.996592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e847aa-4558-4c99-8c48-33e2fc52e4c7 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:13.997811 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e847aa-4558-4c99-8c48-33e2fc52e4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:13.998219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e847aa-4558-4c99-8c48-33e2fc52e4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:14.098393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d1e847aa-4558-4c99-8c48-33e2fc52e4c7 None None] MFA Rules not processed for user `4e8df306f69246389ebd6505bfbd1d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:14.099646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d1e847aa-4558-4c99-8c48-33e2fc52e4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:14.181219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4d2b5-dad2-4537-af9a-edec94a333b2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:14.290940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 848/1703] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:14.296358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a473913-5e6d-4578-80d0-dd5b41efe7fb None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:14.297503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a473913-5e6d-4578-80d0-dd5b41efe7fb None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:14.299718 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a473913-5e6d-4578-80d0-dd5b41efe7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:14.365565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a059a79-43ef-4e9d-b587-c917d8e74661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:14.365565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a059a79-43ef-4e9d-b587-c917d8e74661 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:14.365565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a059a79-43ef-4e9d-b587-c917d8e74661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:14.365565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a059a79-43ef-4e9d-b587-c917d8e74661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:14.374504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a059a79-43ef-4e9d-b587-c917d8e74661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:14.381955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a059a79-43ef-4e9d-b587-c917d8e74661 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:14.395987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-0a473913-5e6d-4578-80d0-dd5b41efe7fb None None] MFA Rules not processed for user `49262765416243a0be91135df74ec914`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:14.399403 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0a473913-5e6d-4578-80d0-dd5b41efe7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:14.411500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 856/1704] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:13 2022] GET /identity/v3/roles => generated 1420 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:14.415211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2466d25-7fbb-4846-8a5f-ac79d1652291 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:14.416720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2466d25-7fbb-4846-8a5f-ac79d1652291 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:14.417074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2466d25-7fbb-4846-8a5f-ac79d1652291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:14.495938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e2466d25-7fbb-4846-8a5f-ac79d1652291 None None] MFA Rules not processed for user `1dae095ac1ad479281866a76dcbc4f40`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:14.499562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e2466d25-7fbb-4846-8a5f-ac79d1652291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:14.606548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 849/1705] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:14.607440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a473913-5e6d-4578-80d0-dd5b41efe7fb None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:14.608834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0a473913-5e6d-4578-80d0-dd5b41efe7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:14.694190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 857/1706] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:14.696293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2466d25-7fbb-4846-8a5f-ac79d1652291 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:14.725512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2466d25-7fbb-4846-8a5f-ac79d1652291 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:14.731841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07745e3-e0ca-41c9-81fa-05f453d75e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:14.732754 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07745e3-e0ca-41c9-81fa-05f453d75e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:14.733072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07745e3-e0ca-41c9-81fa-05f453d75e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:14.733336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07745e3-e0ca-41c9-81fa-05f453d75e98 admin admin] PATH_INFO: `/v3/projects/c84bd3ded9514766bf200bf7277c0287/users/5e45b058654e4d2ea08d9629d1e3ec14/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:14.738030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07745e3-e0ca-41c9-81fa-05f453d75e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c84bd3ded9514766bf200bf7277c0287, user_id=5e45b058654e4d2ea08d9629d1e3ec14, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:14.745418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07745e3-e0ca-41c9-81fa-05f453d75e98 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:14.780750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 858/1707] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:14 2022] PUT /identity/v3/projects/c84bd3ded9514766bf200bf7277c0287/users/5e45b058654e4d2ea08d9629d1e3ec14/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:14.786379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbbb47-5a82-48bb-81eb-5588cf2b8523 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:14.786685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbbb47-5a82-48bb-81eb-5588cf2b8523 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:14.786974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cbbb47-5a82-48bb-81eb-5588cf2b8523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:14.819791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a473913-5e6d-4578-80d0-dd5b41efe7fb None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:14.857185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c0cbbb47-5a82-48bb-81eb-5588cf2b8523 None None] MFA Rules not processed for user `f7d95bfecf5d4d82b51094e0bf9fbedf`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:14.858578 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c0cbbb47-5a82-48bb-81eb-5588cf2b8523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:14.921083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:14.963690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc66f3c-82e7-40c6-9f3c-f559aef43e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:14.965328 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc66f3c-82e7-40c6-9f3c-f559aef43e8a service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:14.965760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc66f3c-82e7-40c6-9f3c-f559aef43e8a service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:14.966477 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc66f3c-82e7-40c6-9f3c-f559aef43e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:15.057440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 859/1708] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:15.059096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c352ed-4ec2-4169-861b-cb4d992dd3ac None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:15.061671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c352ed-4ec2-4169-861b-cb4d992dd3ac None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:15.065885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c352ed-4ec2-4169-861b-cb4d992dd3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:15.077596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc66f3c-82e7-40c6-9f3c-f559aef43e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:15.079919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc66f3c-82e7-40c6-9f3c-f559aef43e8a service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:15.104404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 850/1709] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:15.106724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc66f3c-82e7-40c6-9f3c-f559aef43e8a service nova] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:15.111883 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9fc66f3c-82e7-40c6-9f3c-f559aef43e8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:15.144069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-47c352ed-4ec2-4169-861b-cb4d992dd3ac None None] MFA Rules not processed for user `49262765416243a0be91135df74ec914`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:15.147133 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-47c352ed-4ec2-4169-861b-cb4d992dd3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:15.286641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc66f3c-82e7-40c6-9f3c-f559aef43e8a service nova] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:15.303307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 860/1710] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:15.305303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e9172-e064-4d4c-840a-e60042a79bf5 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:15.305637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ab997-5a09-4bfc-b50b-0d6fdab0199e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:15.306179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e9172-e064-4d4c-840a-e60042a79bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:15.306330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ab997-5a09-4bfc-b50b-0d6fdab0199e admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:15.306623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ab997-5a09-4bfc-b50b-0d6fdab0199e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:15.306859 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e9172-e064-4d4c-840a-e60042a79bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:15.306948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ab997-5a09-4bfc-b50b-0d6fdab0199e admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:15.307755 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ab997-5a09-4bfc-b50b-0d6fdab0199e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:15.310723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ab997-5a09-4bfc-b50b-0d6fdab0199e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:15.356897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b02e9172-e064-4d4c-840a-e60042a79bf5 None None] MFA Rules not processed for user `5e45b058654e4d2ea08d9629d1e3ec14`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:15.358383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b02e9172-e064-4d4c-840a-e60042a79bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:15.466131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 851/1711] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:15 2022] POST /identity/v3/projects => generated 387 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:15.467429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ab997-5a09-4bfc-b50b-0d6fdab0199e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:15.473066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e55ab997-5a09-4bfc-b50b-0d6fdab0199e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:15.611684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 861/1712] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:15.612787 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e9172-e064-4d4c-840a-e60042a79bf5 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:15.641837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e9172-e064-4d4c-840a-e60042a79bf5 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:15.661690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ab997-5a09-4bfc-b50b-0d6fdab0199e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:15.674086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c9875-1ae7-4128-b7a8-64eb92764892 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:15.674744 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9875-1ae7-4128-b7a8-64eb92764892 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:15.674981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9875-1ae7-4128-b7a8-64eb92764892 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:15.675541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c9875-1ae7-4128-b7a8-64eb92764892 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:15.803657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917aaee-2903-4a72-aaa3-971643a3334d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:15.818346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917aaee-2903-4a72-aaa3-971643a3334d admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:15.819058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917aaee-2903-4a72-aaa3-971643a3334d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:15.819538 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917aaee-2903-4a72-aaa3-971643a3334d admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:15.833640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917aaee-2903-4a72-aaa3-971643a3334d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:15.835559 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917aaee-2903-4a72-aaa3-971643a3334d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:15.888533 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c9875-1ae7-4128-b7a8-64eb92764892 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:15.891576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c9875-1ae7-4128-b7a8-64eb92764892 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:15.949164 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 852/1713] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:15.961610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c9875-1ae7-4128-b7a8-64eb92764892 service nova] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:15.991383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c9875-1ae7-4128-b7a8-64eb92764892 service nova] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:16.008239 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 862/1714] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:15 2022] POST /identity/v3/users => generated 294 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:16.009525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917aaee-2903-4a72-aaa3-971643a3334d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:16.017650 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0396486-93ad-480c-9ca2-89af98003b2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:16.018246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0396486-93ad-480c-9ca2-89af98003b2d service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:16.018605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0396486-93ad-480c-9ca2-89af98003b2d service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:16.018870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0396486-93ad-480c-9ca2-89af98003b2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:16.021311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a917aaee-2903-4a72-aaa3-971643a3334d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:16.180084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0396486-93ad-480c-9ca2-89af98003b2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:16.181777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0396486-93ad-480c-9ca2-89af98003b2d service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:16.206999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 853/1715] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:16.208058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0396486-93ad-480c-9ca2-89af98003b2d service nova] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:16.254500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917aaee-2903-4a72-aaa3-971643a3334d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:16.268517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0396486-93ad-480c-9ca2-89af98003b2d service nova] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:16.269815 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ef252-ecac-4a0f-b07b-5d1fa20f81ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:16.280475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ef252-ecac-4a0f-b07b-5d1fa20f81ea service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:16.282639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ef252-ecac-4a0f-b07b-5d1fa20f81ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:16.283303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ef252-ecac-4a0f-b07b-5d1fa20f81ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:16.290780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42110e9-32c2-4ed0-866c-ea75085e6dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:16.291491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42110e9-32c2-4ed0-866c-ea75085e6dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:16.291780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42110e9-32c2-4ed0-866c-ea75085e6dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:16.296329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42110e9-32c2-4ed0-866c-ea75085e6dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:16.297240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42110e9-32c2-4ed0-866c-ea75085e6dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:16.303715 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42110e9-32c2-4ed0-866c-ea75085e6dcb admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:16.478671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 854/1716] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:16.478671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42110e9-32c2-4ed0-866c-ea75085e6dcb admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:16.478671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-a42110e9-32c2-4ed0-866c-ea75085e6dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:16.478671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42110e9-32c2-4ed0-866c-ea75085e6dcb admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:16.482366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ef252-ecac-4a0f-b07b-5d1fa20f81ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:16.482366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ef252-ecac-4a0f-b07b-5d1fa20f81ea service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:16.483815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934ca24-e823-44b6-a93b-55a2ed926b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:16.483815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934ca24-e823-44b6-a93b-55a2ed926b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:16.483815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934ca24-e823-44b6-a93b-55a2ed926b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:16.483815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934ca24-e823-44b6-a93b-55a2ed926b3d admin admin] PATH_INFO: `/v3/projects/fc4ce2a9540f441c95947f8f0f1aac04` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:16.484206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934ca24-e823-44b6-a93b-55a2ed926b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4ce2a9540f441c95947f8f0f1aac04)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:16.484206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934ca24-e823-44b6-a93b-55a2ed926b3d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:16.513260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 863/1717] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:16.514472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ef252-ecac-4a0f-b07b-5d1fa20f81ea service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:16.540722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ef252-ecac-4a0f-b07b-5d1fa20f81ea service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:16.547742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4132e5-05f5-438a-8ada-182d8550aa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:16.548512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4132e5-05f5-438a-8ada-182d8550aa67 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:16.548999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4132e5-05f5-438a-8ada-182d8550aa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:16.555124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4132e5-05f5-438a-8ada-182d8550aa67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:16.555124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4132e5-05f5-438a-8ada-182d8550aa67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:16.555124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4132e5-05f5-438a-8ada-182d8550aa67 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:16.579330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 864/1718] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:16.592853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:16.594469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4132e5-05f5-438a-8ada-182d8550aa67 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:16.613486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4132e5-05f5-438a-8ada-182d8550aa67 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:16.641145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd4b8b-92ab-4a0f-b1e8-6064cd6706cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:16.641145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd4b8b-92ab-4a0f-b1e8-6064cd6706cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:16.641145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd4b8b-92ab-4a0f-b1e8-6064cd6706cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:16.641145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd4b8b-92ab-4a0f-b1e8-6064cd6706cb admin admin] PATH_INFO: `/v3/projects/d68621d354d74ae38f900294a317de84/users/8254c0e633c8450d9adb2e2e5792e7bd/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:16.672459 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd4b8b-92ab-4a0f-b1e8-6064cd6706cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68621d354d74ae38f900294a317de84, user_id=8254c0e633c8450d9adb2e2e5792e7bd, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:16.675796 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd4b8b-92ab-4a0f-b1e8-6064cd6706cb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:16.686236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:16.800371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 865/1719] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:16 2022] PUT /identity/v3/projects/d68621d354d74ae38f900294a317de84/users/8254c0e633c8450d9adb2e2e5792e7bd/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:16.801705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd4b8b-92ab-4a0f-b1e8-6064cd6706cb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:16.846275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-3934ca24-e823-44b6-a93b-55a2ed926b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4ce2a9540f441c95947f8f0f1aac04', 'request_id': 'req-3934ca24-e823-44b6-a93b-55a2ed926b3d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:16.998404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-3934ca24-e823-44b6-a93b-55a2ed926b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4ce2a9540f441c95947f8f0f1aac04', 'request_id': 'req-3934ca24-e823-44b6-a93b-55a2ed926b3d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:17.019086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-3934ca24-e823-44b6-a93b-55a2ed926b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4ce2a9540f441c95947f8f0f1aac04', 'request_id': 'req-3934ca24-e823-44b6-a93b-55a2ed926b3d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:17.038324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd4b8b-92ab-4a0f-b1e8-6064cd6706cb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:17.062423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-3934ca24-e823-44b6-a93b-55a2ed926b3d admin admin] The token cache is being invalidate because project fc4ce2a9540f441c95947f8f0f1aac04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:17.063398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-3934ca24-e823-44b6-a93b-55a2ed926b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:17.080159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-3934ca24-e823-44b6-a93b-55a2ed926b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:17.084820 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 855/1720] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:16 2022] DELETE /identity/v3/projects/fc4ce2a9540f441c95947f8f0f1aac04 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:17.089154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623d45e-5bba-4d13-8df7-b32e0060c65c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:17.089438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623d45e-5bba-4d13-8df7-b32e0060c65c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:17.089720 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623d45e-5bba-4d13-8df7-b32e0060c65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:17.193108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-5623d45e-5bba-4d13-8df7-b32e0060c65c None None] MFA Rules not processed for user `8254c0e633c8450d9adb2e2e5792e7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:17.193108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5623d45e-5bba-4d13-8df7-b32e0060c65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:17.207776 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:17.208692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:17.209007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:17.209280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] PATH_INFO: `/v3/users/663bebe17ff34ffd804f26d71ede2498` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:17.225538 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=663bebe17ff34ffd804f26d71ede2498)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:17.227756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:17.411234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 856/1721] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:17.411773 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441e823-ae5e-432f-a1a5-3bd0d21b6292 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:17.412070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441e823-ae5e-432f-a1a5-3bd0d21b6292 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:17.412355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441e823-ae5e-432f-a1a5-3bd0d21b6292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:17.488366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-7441e823-ae5e-432f-a1a5-3bd0d21b6292 None None] MFA Rules not processed for user `824c74155450401ba02db90ff00aa9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:17.504314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7441e823-ae5e-432f-a1a5-3bd0d21b6292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:17.509594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '663bebe17ff34ffd804f26d71ede2498'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:17.594368 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '663bebe17ff34ffd804f26d71ede2498'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:17.685977 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '663bebe17ff34ffd804f26d71ede2498'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:17.686651 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '663bebe17ff34ffd804f26d71ede2498'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:17.698978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '663bebe17ff34ffd804f26d71ede2498'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:17.699128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 857/1722] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:17.699128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c560fc8-b8cb-45ce-8f61-fb31d6be1e24 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:17.699128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c560fc8-b8cb-45ce-8f61-fb31d6be1e24 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:17.699128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c560fc8-b8cb-45ce-8f61-fb31d6be1e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:17.708856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 866/1723] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:16 2022] DELETE /identity/v3/users/663bebe17ff34ffd804f26d71ede2498 => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:17.709448 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:17.712381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:17.768018 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-2c560fc8-b8cb-45ce-8f61-fb31d6be1e24 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:17.773877 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2c560fc8-b8cb-45ce-8f61-fb31d6be1e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:17.901131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd30246-774c-4761-a535-974227f8e311 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:17.918181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3579565-320d-4cb7-9cfe-a28e0388cc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:17.922124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3579565-320d-4cb7-9cfe-a28e0388cc58 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:17.922449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3579565-320d-4cb7-9cfe-a28e0388cc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:17.922727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3579565-320d-4cb7-9cfe-a28e0388cc58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:17.923456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3579565-320d-4cb7-9cfe-a28e0388cc58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:17.940644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3579565-320d-4cb7-9cfe-a28e0388cc58 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:17.976141 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 858/1724] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:17.977739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de0668-8a1b-4f03-b2d0-80d63147384f None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:17.978139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de0668-8a1b-4f03-b2d0-80d63147384f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:17.978525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de0668-8a1b-4f03-b2d0-80d63147384f None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:17.979988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 859/1725] 10.222.0.16 () {54 vars in 912 bytes} [Thu Jun 23 13:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:12:17.981790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b342825-8bc5-4564-b444-1728ec988c27 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:17.982142 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b342825-8bc5-4564-b444-1728ec988c27 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:17.984911 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b342825-8bc5-4564-b444-1728ec988c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:18.021665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-4b342825-8bc5-4564-b444-1728ec988c27 None None] MFA Rules not processed for user `824c74155450401ba02db90ff00aa9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:18.023469 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4b342825-8bc5-4564-b444-1728ec988c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:18.081359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 867/1726] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:17 2022] POST /identity/v3/projects => generated 387 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:18.084778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd1be4-4bff-4edc-9c50-5e08ef5c75a4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:18.087570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd1be4-4bff-4edc-9c50-5e08ef5c75a4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:18.087570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd1be4-4bff-4edc-9c50-5e08ef5c75a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:18.140067 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-96fd1be4-4bff-4edc-9c50-5e08ef5c75a4 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:18.141897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 860/1727] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:18.142781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-96fd1be4-4bff-4edc-9c50-5e08ef5c75a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:18.143569 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf628f24-28da-489a-bf42-3cd46df94bcc None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:18.143863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf628f24-28da-489a-bf42-3cd46df94bcc None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:18.144179 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf628f24-28da-489a-bf42-3cd46df94bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:18.192565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-cf628f24-28da-489a-bf42-3cd46df94bcc None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:18.193845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cf628f24-28da-489a-bf42-3cd46df94bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:18.262029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 868/1728] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:18.264483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3c3ff-a5d6-4b33-81e7-f2363dc8e02a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:18.265021 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3c3ff-a5d6-4b33-81e7-f2363dc8e02a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:18.270748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3c3ff-a5d6-4b33-81e7-f2363dc8e02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:18.273948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 861/1729] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:18.275612 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf628f24-28da-489a-bf42-3cd46df94bcc None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:18.286916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf628f24-28da-489a-bf42-3cd46df94bcc None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:18.299639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd956e-bde6-469a-8749-2d77daf95977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:18.301033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd956e-bde6-469a-8749-2d77daf95977 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:18.301326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd956e-bde6-469a-8749-2d77daf95977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:18.301605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd956e-bde6-469a-8749-2d77daf95977 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:18.302322 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd956e-bde6-469a-8749-2d77daf95977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:18.307264 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd956e-bde6-469a-8749-2d77daf95977 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:18.322052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c1d3c3ff-a5d6-4b33-81e7-f2363dc8e02a None None] MFA Rules not processed for user `83858713769b41af800bab317602bf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:18.323742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c1d3c3ff-a5d6-4b33-81e7-f2363dc8e02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:18.395465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 869/1730] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:12:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:18.398952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3c3ff-a5d6-4b33-81e7-f2363dc8e02a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:18.400398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c1d3c3ff-a5d6-4b33-81e7-f2363dc8e02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:18.425488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 862/1731] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:18 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:18.426633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd956e-bde6-469a-8749-2d77daf95977 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:18.430167 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d5dd956e-bde6-469a-8749-2d77daf95977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:18.466723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd956e-bde6-469a-8749-2d77daf95977 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:18.480912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1904a2-dada-4d80-b78e-e6d15a48036c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:18.481179 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1904a2-dada-4d80-b78e-e6d15a48036c service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:18.481469 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1904a2-dada-4d80-b78e-e6d15a48036c service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:18.481754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1904a2-dada-4d80-b78e-e6d15a48036c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:18.510226 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1904a2-dada-4d80-b78e-e6d15a48036c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:18.511730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1904a2-dada-4d80-b78e-e6d15a48036c service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:18.538586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 863/1732] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:18.541627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3c3ff-a5d6-4b33-81e7-f2363dc8e02a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:18.542227 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1904a2-dada-4d80-b78e-e6d15a48036c service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:18.549241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d4f23-9a6e-4576-85be-627bdb8b94fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:18.550117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d4f23-9a6e-4576-85be-627bdb8b94fa service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:18.550543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d4f23-9a6e-4576-85be-627bdb8b94fa service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:18.550877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d4f23-9a6e-4576-85be-627bdb8b94fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:18.555984 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9b4d4f23-9a6e-4576-85be-627bdb8b94fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:18.575738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1904a2-dada-4d80-b78e-e6d15a48036c service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:18.592319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76feea-5770-4033-8da1-e072cdfa8e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:18.593229 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76feea-5770-4033-8da1-e072cdfa8e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:18.593577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76feea-5770-4033-8da1-e072cdfa8e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:18.593927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76feea-5770-4033-8da1-e072cdfa8e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:18.594749 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76feea-5770-4033-8da1-e072cdfa8e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:18.595130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76feea-5770-4033-8da1-e072cdfa8e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:18.596891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e76feea-5770-4033-8da1-e072cdfa8e2c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:18.619948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 864/1733] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:18.619948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76feea-5770-4033-8da1-e072cdfa8e2c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:18.632146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76feea-5770-4033-8da1-e072cdfa8e2c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:18.636896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e8c5f-d3f8-498c-b217-a5f467cbaca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:18.637970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e8c5f-d3f8-498c-b217-a5f467cbaca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:18.638363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e8c5f-d3f8-498c-b217-a5f467cbaca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:18.639372 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e8c5f-d3f8-498c-b217-a5f467cbaca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:18.709338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e8c5f-d3f8-498c-b217-a5f467cbaca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:18.710786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e8c5f-d3f8-498c-b217-a5f467cbaca0 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:18.738786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d4f23-9a6e-4576-85be-627bdb8b94fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:18.742753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d4f23-9a6e-4576-85be-627bdb8b94fa service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:18.749962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 865/1734] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:18.755115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e8c5f-d3f8-498c-b217-a5f467cbaca0 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:18.781169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e8c5f-d3f8-498c-b217-a5f467cbaca0 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:18.786182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 870/1735] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:18.786182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d4f23-9a6e-4576-85be-627bdb8b94fa service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:18.797656 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf03692-710d-425e-b011-296065aebd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:18.798667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf03692-710d-425e-b011-296065aebd5c admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:18.799886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf03692-710d-425e-b011-296065aebd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:18.800316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf03692-710d-425e-b011-296065aebd5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:18.803799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf03692-710d-425e-b011-296065aebd5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:18.807020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf03692-710d-425e-b011-296065aebd5c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:18.839413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d4f23-9a6e-4576-85be-627bdb8b94fa service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:18.855282 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb406f-57aa-43d9-a604-8bb0887334d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:18.856925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb406f-57aa-43d9-a604-8bb0887334d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:18.857363 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb406f-57aa-43d9-a604-8bb0887334d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:18.857779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb406f-57aa-43d9-a604-8bb0887334d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:18.868019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb406f-57aa-43d9-a604-8bb0887334d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:18.871526 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb406f-57aa-43d9-a604-8bb0887334d5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:18.877590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 866/1736] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:18.879861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf03692-710d-425e-b011-296065aebd5c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:18.923604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf03692-710d-425e-b011-296065aebd5c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:18.943579 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0a797-49a0-4733-9e68-379e6f402875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:18.944245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0a797-49a0-4733-9e68-379e6f402875 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:18.944530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0a797-49a0-4733-9e68-379e6f402875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:18.944831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0a797-49a0-4733-9e68-379e6f402875 admin admin] PATH_INFO: `/v3/projects/e938b3c8d71349debca6f74efd9232fc/users/a9d117e2a4844f03a2328049e69217cf/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:18.997499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0a797-49a0-4733-9e68-379e6f402875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e938b3c8d71349debca6f74efd9232fc, user_id=a9d117e2a4844f03a2328049e69217cf, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:19.000439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0a797-49a0-4733-9e68-379e6f402875 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:19.002925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 871/1737] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:18 2022] POST /identity/v3/projects => generated 401 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:19.007161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb406f-57aa-43d9-a604-8bb0887334d5 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:19.060112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 867/1738] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:18 2022] PUT /identity/v3/projects/e938b3c8d71349debca6f74efd9232fc/users/a9d117e2a4844f03a2328049e69217cf/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:19.066184 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0a797-49a0-4733-9e68-379e6f402875 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:19.085053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:19.167212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb406f-57aa-43d9-a604-8bb0887334d5 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:19.242033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:19.248037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0a797-49a0-4733-9e68-379e6f402875 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:19.267351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85533900-3f28-4a8b-80ef-086d27be4544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:19.272620 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85533900-3f28-4a8b-80ef-086d27be4544 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:19.272620 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85533900-3f28-4a8b-80ef-086d27be4544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:19.272620 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85533900-3f28-4a8b-80ef-086d27be4544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:19.272620 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85533900-3f28-4a8b-80ef-086d27be4544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:19.283288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85533900-3f28-4a8b-80ef-086d27be4544 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:19.313525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a64b2-a878-4238-a8a1-b34de61d805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:19.313525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a64b2-a878-4238-a8a1-b34de61d805e admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:19.313780 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a64b2-a878-4238-a8a1-b34de61d805e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:19.313864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a64b2-a878-4238-a8a1-b34de61d805e admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:19.314544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a64b2-a878-4238-a8a1-b34de61d805e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:19.316505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a64b2-a878-4238-a8a1-b34de61d805e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:19.321291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 868/1739] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:12:19.329966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85533900-3f28-4a8b-80ef-086d27be4544 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:19.348360 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85533900-3f28-4a8b-80ef-086d27be4544 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:19.368614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeddbd7-6bd0-47c6-9fcd-5468156686a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:19.369619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeddbd7-6bd0-47c6-9fcd-5468156686a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:19.369906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeddbd7-6bd0-47c6-9fcd-5468156686a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:19.370187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeddbd7-6bd0-47c6-9fcd-5468156686a3 admin admin] PATH_INFO: `/v3/projects/e938b3c8d71349debca6f74efd9232fc/users/a9d117e2a4844f03a2328049e69217cf/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:19.373683 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeddbd7-6bd0-47c6-9fcd-5468156686a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e938b3c8d71349debca6f74efd9232fc, user_id=a9d117e2a4844f03a2328049e69217cf, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:19.378073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeddbd7-6bd0-47c6-9fcd-5468156686a3 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:19.426661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 869/1740] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:19 2022] PUT /identity/v3/projects/e938b3c8d71349debca6f74efd9232fc/users/a9d117e2a4844f03a2328049e69217cf/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:19.428932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f028-be4a-4e95-b57a-0578759e5273 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:19.428932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f028-be4a-4e95-b57a-0578759e5273 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:19.429180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839f028-be4a-4e95-b57a-0578759e5273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:19.454711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 872/1741] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:19 2022] POST /identity/v3/users => generated 301 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:19.457367 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a64b2-a878-4238-a8a1-b34de61d805e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:19.490989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a64b2-a878-4238-a8a1-b34de61d805e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:19.514738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-3839f028-be4a-4e95-b57a-0578759e5273 None None] MFA Rules not processed for user `a9d117e2a4844f03a2328049e69217cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:19.516679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-3839f028-be4a-4e95-b57a-0578759e5273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:19.563741 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0d39a-02cf-4a22-b15c-168fd77e81dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:19.564439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0d39a-02cf-4a22-b15c-168fd77e81dc admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:19.564742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0d39a-02cf-4a22-b15c-168fd77e81dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:19.565061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0d39a-02cf-4a22-b15c-168fd77e81dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:19.565866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0d39a-02cf-4a22-b15c-168fd77e81dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:19.567549 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0d39a-02cf-4a22-b15c-168fd77e81dc admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:19.582233 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 873/1742] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:19.583756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0d39a-02cf-4a22-b15c-168fd77e81dc admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:19.612126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0d39a-02cf-4a22-b15c-168fd77e81dc admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:19.626818 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9bc2d-81f4-4d38-bc27-6cbcb38ba312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:19.627081 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9bc2d-81f4-4d38-bc27-6cbcb38ba312 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:19.627432 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9bc2d-81f4-4d38-bc27-6cbcb38ba312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:19.629560 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff9bc2d-81f4-4d38-bc27-6cbcb38ba312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:19.630409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9bc2d-81f4-4d38-bc27-6cbcb38ba312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:19.632266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff9bc2d-81f4-4d38-bc27-6cbcb38ba312 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:19.659960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 874/1743] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:19.661313 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9bc2d-81f4-4d38-bc27-6cbcb38ba312 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:19.687887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff9bc2d-81f4-4d38-bc27-6cbcb38ba312 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:19.702286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb481c93-0c0d-4d1b-b920-bd7cd0aaa03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:19.702286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481c93-0c0d-4d1b-b920-bd7cd0aaa03a admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:19.702827 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 870/1744] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:19.702924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481c93-0c0d-4d1b-b920-bd7cd0aaa03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:19.703311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb481c93-0c0d-4d1b-b920-bd7cd0aaa03a admin admin] PATH_INFO: `/v3/projects/6d249a0d66e64b6f9ccf535221942be1/users/2d7700d5bbc748a896b23047513f66f3/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:19.720006 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839f028-be4a-4e95-b57a-0578759e5273 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:19.721596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-3839f028-be4a-4e95-b57a-0578759e5273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:19.773249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb481c93-0c0d-4d1b-b920-bd7cd0aaa03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d249a0d66e64b6f9ccf535221942be1, user_id=2d7700d5bbc748a896b23047513f66f3, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:19.773249 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb481c93-0c0d-4d1b-b920-bd7cd0aaa03a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:19.841640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839f028-be4a-4e95-b57a-0578759e5273 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:19.853948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f18bd7-b516-4b35-9dea-a219c8743823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:19.854634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f18bd7-b516-4b35-9dea-a219c8743823 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:19.854916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f18bd7-b516-4b35-9dea-a219c8743823 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:19.855192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f18bd7-b516-4b35-9dea-a219c8743823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:19.902631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f18bd7-b516-4b35-9dea-a219c8743823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:19.904347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f18bd7-b516-4b35-9dea-a219c8743823 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:19.927494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 875/1745] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:19 2022] PUT /identity/v3/projects/6d249a0d66e64b6f9ccf535221942be1/users/2d7700d5bbc748a896b23047513f66f3/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:19.927815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 871/1746] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:19.938837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7009ce-62ef-420e-b122-db7a10bd7292 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:19.939147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7009ce-62ef-420e-b122-db7a10bd7292 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:19.939507 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7009ce-62ef-420e-b122-db7a10bd7292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:20.000517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ce7009ce-62ef-420e-b122-db7a10bd7292 None None] MFA Rules not processed for user `2d7700d5bbc748a896b23047513f66f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:20.012747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ce7009ce-62ef-420e-b122-db7a10bd7292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:20.076387 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:20.222919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 876/1747] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:19 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:20.228556 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f18bd7-b516-4b35-9dea-a219c8743823 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:20.253021 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f18bd7-b516-4b35-9dea-a219c8743823 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:20.329853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ba07-34c5-416f-9236-c15843ae091a None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:20.330416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ba07-34c5-416f-9236-c15843ae091a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:20.330908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738ba07-34c5-416f-9236-c15843ae091a None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:20.332740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 877/1748] 10.222.0.16 () {54 vars in 912 bytes} [Thu Jun 23 13:12:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:12:20.338359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7acf34-022e-4b24-9f68-e7c30edf7a03 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:20.339080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7acf34-022e-4b24-9f68-e7c30edf7a03 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:20.339909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7acf34-022e-4b24-9f68-e7c30edf7a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:20.367727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:20.370427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1c7acf34-022e-4b24-9f68-e7c30edf7a03 None None] MFA Rules not processed for user `83858713769b41af800bab317602bf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:20.376931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1c7acf34-022e-4b24-9f68-e7c30edf7a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:20.423794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea237229-05df-4199-9ffe-9a08d1c7c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:20.424864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea237229-05df-4199-9ffe-9a08d1c7c251 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:20.425235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea237229-05df-4199-9ffe-9a08d1c7c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:20.425839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea237229-05df-4199-9ffe-9a08d1c7c251 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:20.428350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea237229-05df-4199-9ffe-9a08d1c7c251 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:20.430823 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea237229-05df-4199-9ffe-9a08d1c7c251 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:20.530367 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 878/1749] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:12:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:20.531428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7acf34-022e-4b24-9f68-e7c30edf7a03 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:20.537865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1c7acf34-022e-4b24-9f68-e7c30edf7a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:20.587456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7acf34-022e-4b24-9f68-e7c30edf7a03 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:20.587996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 872/1750] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:20 2022] POST /identity/v3/projects => generated 401 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:20.588416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea237229-05df-4199-9ffe-9a08d1c7c251 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:20.594219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ea237229-05df-4199-9ffe-9a08d1c7c251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:20.602584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b1ef02-883f-47ce-a3f7-fc381a37deb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:20.603480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1ef02-883f-47ce-a3f7-fc381a37deb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:20.603761 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1ef02-883f-47ce-a3f7-fc381a37deb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:20.604038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b1ef02-883f-47ce-a3f7-fc381a37deb7 admin admin] PATH_INFO: `/v3/projects/83fe43aa6250455eb4abf73deff28303` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:20.607490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1ef02-883f-47ce-a3f7-fc381a37deb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83fe43aa6250455eb4abf73deff28303)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:20.616448 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b1ef02-883f-47ce-a3f7-fc381a37deb7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:20.775230 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea237229-05df-4199-9ffe-9a08d1c7c251 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:20.813562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de170e-e9fd-4480-ab08-38c4108eb981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:20.814709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de170e-e9fd-4480-ab08-38c4108eb981 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:20.814989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de170e-e9fd-4480-ab08-38c4108eb981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:20.815957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de170e-e9fd-4480-ab08-38c4108eb981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:20.841428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-70b1ef02-883f-47ce-a3f7-fc381a37deb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83fe43aa6250455eb4abf73deff28303', 'request_id': 'req-70b1ef02-883f-47ce-a3f7-fc381a37deb7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:20.842409 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de170e-e9fd-4480-ab08-38c4108eb981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:20.844035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de170e-e9fd-4480-ab08-38c4108eb981 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:20.873893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 873/1751] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:20.878133 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de170e-e9fd-4480-ab08-38c4108eb981 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:20.926912 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-70b1ef02-883f-47ce-a3f7-fc381a37deb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83fe43aa6250455eb4abf73deff28303', 'request_id': 'req-70b1ef02-883f-47ce-a3f7-fc381a37deb7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:20.935524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-70b1ef02-883f-47ce-a3f7-fc381a37deb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83fe43aa6250455eb4abf73deff28303', 'request_id': 'req-70b1ef02-883f-47ce-a3f7-fc381a37deb7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:20.960751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-70b1ef02-883f-47ce-a3f7-fc381a37deb7 admin admin] The token cache is being invalidate because project 83fe43aa6250455eb4abf73deff28303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:20.962764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-70b1ef02-883f-47ce-a3f7-fc381a37deb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:20.966263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-70b1ef02-883f-47ce-a3f7-fc381a37deb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:20.971040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 879/1752] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:20 2022] DELETE /identity/v3/projects/83fe43aa6250455eb4abf73deff28303 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:20.973354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc0285-576e-4faf-b4b7-abb13df8f785 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:20.977200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc0285-576e-4faf-b4b7-abb13df8f785 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:20.977664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc0285-576e-4faf-b4b7-abb13df8f785 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:20.979322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 880/1753] 10.222.0.16 () {54 vars in 960 bytes} [Thu Jun 23 13:12:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:12:20.981986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc0285-576e-4faf-b4b7-abb13df8f785 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:20.991659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-cabc0285-576e-4faf-b4b7-abb13df8f785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:21.049977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de170e-e9fd-4480-ab08-38c4108eb981 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:21.176767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc0285-576e-4faf-b4b7-abb13df8f785 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:21.197269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:21.198170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:21.198454 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:21.198730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] PATH_INFO: `/v3/users/5e45b058654e4d2ea08d9629d1e3ec14` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:21.201700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e45b058654e4d2ea08d9629d1e3ec14)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:21.203646 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:21.209108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3df8ba-bb6f-49c7-b999-7abd6734508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:21.209654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3df8ba-bb6f-49c7-b999-7abd6734508c admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:21.209935 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3df8ba-bb6f-49c7-b999-7abd6734508c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:21.210210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3df8ba-bb6f-49c7-b999-7abd6734508c admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:21.224084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3df8ba-bb6f-49c7-b999-7abd6734508c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:21.224084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3df8ba-bb6f-49c7-b999-7abd6734508c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:21.436939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 874/1754] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:20 2022] POST /identity/v3/users => generated 307 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:21.440676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba49eb-5e2f-4534-857f-d39a8c34e976 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:21.443220 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba49eb-5e2f-4534-857f-d39a8c34e976 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:21.445473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba49eb-5e2f-4534-857f-d39a8c34e976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:21.566305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d1ba49eb-5e2f-4534-857f-d39a8c34e976 None None] MFA Rules not processed for user `69b5745bfb5d4e6ca172bb8fab229e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:21.580964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d1ba49eb-5e2f-4534-857f-d39a8c34e976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:21.587921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e45b058654e4d2ea08d9629d1e3ec14'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:21.612605 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e45b058654e4d2ea08d9629d1e3ec14'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:21.668145 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:21.710235 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e45b058654e4d2ea08d9629d1e3ec14'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:21.711091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e45b058654e4d2ea08d9629d1e3ec14'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:21.712062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e45b058654e4d2ea08d9629d1e3ec14'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:21.745576 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 881/1755] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:20 2022] DELETE /identity/v3/users/5e45b058654e4d2ea08d9629d1e3ec14 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:21.747088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:21.754688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:21.928083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 875/1756] 10.222.0.16 () {58 vars in 1057 bytes} [Thu Jun 23 13:12:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:21.929616 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba49eb-5e2f-4534-857f-d39a8c34e976 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:21.936761 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52497d23-98d2-420c-bbe7-958060d2a579 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:21.938897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d1ba49eb-5e2f-4534-857f-d39a8c34e976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:21.942214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:21.944985 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9a84f-e81f-48d7-b0b6-76ae9b00eade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:21.949322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9a84f-e81f-48d7-b0b6-76ae9b00eade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:21.949322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9a84f-e81f-48d7-b0b6-76ae9b00eade admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:21.949322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9a84f-e81f-48d7-b0b6-76ae9b00eade admin admin] PATH_INFO: `/v3/users/5df945c65e1e4eac958d7b1b32be6716` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:21.949322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9a84f-e81f-48d7-b0b6-76ae9b00eade admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df945c65e1e4eac958d7b1b32be6716)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:21.952137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9a84f-e81f-48d7-b0b6-76ae9b00eade admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:22.022162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba49eb-5e2f-4534-857f-d39a8c34e976 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:22.041584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05800b7d-e2e8-4e55-b585-a6d61080683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:22.042646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05800b7d-e2e8-4e55-b585-a6d61080683b admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:22.043084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05800b7d-e2e8-4e55-b585-a6d61080683b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:22.043580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05800b7d-e2e8-4e55-b585-a6d61080683b admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:22.044606 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05800b7d-e2e8-4e55-b585-a6d61080683b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:22.048394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05800b7d-e2e8-4e55-b585-a6d61080683b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:22.084349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 876/1757] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:22.086494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05800b7d-e2e8-4e55-b585-a6d61080683b admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:22.091264 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-05800b7d-e2e8-4e55-b585-a6d61080683b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:22.193286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-37e9a84f-e81f-48d7-b0b6-76ae9b00eade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df945c65e1e4eac958d7b1b32be6716'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:22.237053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-37e9a84f-e81f-48d7-b0b6-76ae9b00eade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df945c65e1e4eac958d7b1b32be6716'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:22.272647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05800b7d-e2e8-4e55-b585-a6d61080683b admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:22.281422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a0436-2d27-4a3e-bbee-45f71e36dcc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b5745bfb5d4e6ca172bb8fab229e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:22.282287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a0436-2d27-4a3e-bbee-45f71e36dcc1 service placement] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:22.282675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a0436-2d27-4a3e-bbee-45f71e36dcc1 service placement] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:22.283089 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a0436-2d27-4a3e-bbee-45f71e36dcc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:22.285149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-188a0436-2d27-4a3e-bbee-45f71e36dcc1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:22.301653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a0436-2d27-4a3e-bbee-45f71e36dcc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:22.306737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a0436-2d27-4a3e-bbee-45f71e36dcc1 service placement] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:22.321890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 877/1758] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:22.323902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a0436-2d27-4a3e-bbee-45f71e36dcc1 service placement] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:22.335506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a0436-2d27-4a3e-bbee-45f71e36dcc1 service placement] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:22.343555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-37e9a84f-e81f-48d7-b0b6-76ae9b00eade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df945c65e1e4eac958d7b1b32be6716'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:22.347661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486a900-3530-4bf3-98ef-ac4ae1a081c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b5745bfb5d4e6ca172bb8fab229e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:22.347804 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-37e9a84f-e81f-48d7-b0b6-76ae9b00eade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df945c65e1e4eac958d7b1b32be6716'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:22.347889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486a900-3530-4bf3-98ef-ac4ae1a081c3 service placement] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:22.347966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-37e9a84f-e81f-48d7-b0b6-76ae9b00eade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df945c65e1e4eac958d7b1b32be6716'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:22.348041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486a900-3530-4bf3-98ef-ac4ae1a081c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:22.348041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486a900-3530-4bf3-98ef-ac4ae1a081c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:22.348447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d486a900-3530-4bf3-98ef-ac4ae1a081c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:22.370441 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486a900-3530-4bf3-98ef-ac4ae1a081c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:22.374053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486a900-3530-4bf3-98ef-ac4ae1a081c3 service placement] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:22.386590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 882/1759] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:21 2022] DELETE /identity/v3/users/5df945c65e1e4eac958d7b1b32be6716 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:22.389190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271182dd-8342-42a4-8c75-2a72788107c0 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:22.393135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271182dd-8342-42a4-8c75-2a72788107c0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:22.393420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271182dd-8342-42a4-8c75-2a72788107c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:22.413524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 878/1760] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:22.417017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d555bc-a2a8-4cab-a2ad-4b23ecc96f5d None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:22.417319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d555bc-a2a8-4cab-a2ad-4b23ecc96f5d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:22.417608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d555bc-a2a8-4cab-a2ad-4b23ecc96f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:22.458089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-271182dd-8342-42a4-8c75-2a72788107c0 None None] MFA Rules not processed for user `824c74155450401ba02db90ff00aa9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:22.459362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-271182dd-8342-42a4-8c75-2a72788107c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:22.495058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-92d555bc-a2a8-4cab-a2ad-4b23ecc96f5d None None] MFA Rules not processed for user `4e8df306f69246389ebd6505bfbd1d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:22.497141 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-92d555bc-a2a8-4cab-a2ad-4b23ecc96f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:22.623585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 883/1761] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:22.625554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271182dd-8342-42a4-8c75-2a72788107c0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:22.630954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-271182dd-8342-42a4-8c75-2a72788107c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:22.722556 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 879/1762] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:22.722556 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d555bc-a2a8-4cab-a2ad-4b23ecc96f5d None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:22.737318 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-92d555bc-a2a8-4cab-a2ad-4b23ecc96f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:22.821861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271182dd-8342-42a4-8c75-2a72788107c0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:22.841358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884639e-c8da-4535-ba9b-6fc46d5be14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:22.844198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884639e-c8da-4535-ba9b-6fc46d5be14a admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:22.875804 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884639e-c8da-4535-ba9b-6fc46d5be14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:22.875804 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884639e-c8da-4535-ba9b-6fc46d5be14a admin admin] PATH_INFO: `/v3/projects/0b4b58cec7ad4574a6a9f470b4387475/users/bd0f717f10db4e65b0d9b7a70c0252b7/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:22.931557 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d555bc-a2a8-4cab-a2ad-4b23ecc96f5d None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:22.942785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884639e-c8da-4535-ba9b-6fc46d5be14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4b58cec7ad4574a6a9f470b4387475, user_id=bd0f717f10db4e65b0d9b7a70c0252b7, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:22.944064 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52596cb2-c7c5-46c1-8b79-7fd1081562c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:22.945118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596cb2-c7c5-46c1-8b79-7fd1081562c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:22.945568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596cb2-c7c5-46c1-8b79-7fd1081562c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:22.946009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52596cb2-c7c5-46c1-8b79-7fd1081562c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:22.951022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884639e-c8da-4535-ba9b-6fc46d5be14a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:22.952268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-52596cb2-c7c5-46c1-8b79-7fd1081562c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:23.048059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:23.059710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52596cb2-c7c5-46c1-8b79-7fd1081562c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:23.059710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52596cb2-c7c5-46c1-8b79-7fd1081562c0 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:23.067601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 884/1763] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:22 2022] PUT /identity/v3/projects/0b4b58cec7ad4574a6a9f470b4387475/users/bd0f717f10db4e65b0d9b7a70c0252b7/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:23.067601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6bc85-3745-403f-8500-e7229f7739ea None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:23.067601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6bc85-3745-403f-8500-e7229f7739ea None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:23.067601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6bc85-3745-403f-8500-e7229f7739ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:23.083877 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 880/1764] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:23.084959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52596cb2-c7c5-46c1-8b79-7fd1081562c0 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:23.113110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52596cb2-c7c5-46c1-8b79-7fd1081562c0 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:23.140770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6cb6bc85-3745-403f-8500-e7229f7739ea None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:23.157182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6cb6bc85-3745-403f-8500-e7229f7739ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:23.323612 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381987b7-7ad3-454e-81ce-23696eec40f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:23.332612 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381987b7-7ad3-454e-81ce-23696eec40f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:23.334309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381987b7-7ad3-454e-81ce-23696eec40f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:23.334765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381987b7-7ad3-454e-81ce-23696eec40f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:23.341814 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381987b7-7ad3-454e-81ce-23696eec40f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:23.343800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381987b7-7ad3-454e-81ce-23696eec40f5 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:23.354913 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 885/1765] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:23.357376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6bc85-3745-403f-8500-e7229f7739ea None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:23.360755 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6cb6bc85-3745-403f-8500-e7229f7739ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:23.387818 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6bc85-3745-403f-8500-e7229f7739ea None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:23.390148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 881/1766] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:23.391099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381987b7-7ad3-454e-81ce-23696eec40f5 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:23.396009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-381987b7-7ad3-454e-81ce-23696eec40f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:23.404779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:23.406027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:23.408422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:23.411262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c admin admin] PATH_INFO: `/v3/projects/c84bd3ded9514766bf200bf7277c0287` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:23.415912 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c84bd3ded9514766bf200bf7277c0287)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:23.420900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:23.422088 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:23.541610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381987b7-7ad3-454e-81ce-23696eec40f5 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:23.549556 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dde9e6-46a8-4d22-b777-a3b8b15ca6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:23.550341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dde9e6-46a8-4d22-b777-a3b8b15ca6fd service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:23.550467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dde9e6-46a8-4d22-b777-a3b8b15ca6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:23.550794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dde9e6-46a8-4d22-b777-a3b8b15ca6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:23.597394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dde9e6-46a8-4d22-b777-a3b8b15ca6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:23.600925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dde9e6-46a8-4d22-b777-a3b8b15ca6fd service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:23.616050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 882/1767] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:23.617122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dde9e6-46a8-4d22-b777-a3b8b15ca6fd service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:23.647746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dde9e6-46a8-4d22-b777-a3b8b15ca6fd service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:23.662616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c84bd3ded9514766bf200bf7277c0287', 'request_id': 'req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:23.742746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb9c44a-5506-47a8-89ad-b7c2c826ab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:23.744562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9c44a-5506-47a8-89ad-b7c2c826ab8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:23.745003 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9c44a-5506-47a8-89ad-b7c2c826ab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:23.745394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9c44a-5506-47a8-89ad-b7c2c826ab8e admin admin] PATH_INFO: `/v3/projects/0b4b58cec7ad4574a6a9f470b4387475/users/bd0f717f10db4e65b0d9b7a70c0252b7/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:23.748360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c84bd3ded9514766bf200bf7277c0287', 'request_id': 'req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:23.749080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9c44a-5506-47a8-89ad-b7c2c826ab8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4b58cec7ad4574a6a9f470b4387475, user_id=bd0f717f10db4e65b0d9b7a70c0252b7, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:23.752580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb9c44a-5506-47a8-89ad-b7c2c826ab8e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:23.765710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c84bd3ded9514766bf200bf7277c0287', 'request_id': 'req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:23.782479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 883/1768] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:23 2022] PUT /identity/v3/projects/0b4b58cec7ad4574a6a9f470b4387475/users/bd0f717f10db4e65b0d9b7a70c0252b7/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:23.782479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16ca4-6c5f-4874-99d6-b0cc2914e70c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:23.782479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16ca4-6c5f-4874-99d6-b0cc2914e70c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:23.782479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16ca4-6c5f-4874-99d6-b0cc2914e70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:23.815279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c admin admin] The token cache is being invalidate because project c84bd3ded9514766bf200bf7277c0287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:23.815805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:23.817821 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-808c89cd-a3ee-44e3-8b57-2dbacccfd52c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:23.820208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 886/1769] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:23 2022] DELETE /identity/v3/projects/c84bd3ded9514766bf200bf7277c0287 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:23.823994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d19f1c-84a6-4e04-9b36-ad2eee2c718f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:23.826294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d19f1c-84a6-4e04-9b36-ad2eee2c718f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:23.826294 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d19f1c-84a6-4e04-9b36-ad2eee2c718f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:23.827599 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-9cf16ca4-6c5f-4874-99d6-b0cc2914e70c None None] MFA Rules not processed for user `f7d95bfecf5d4d82b51094e0bf9fbedf`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:23.831274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9cf16ca4-6c5f-4874-99d6-b0cc2914e70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:23.889817 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b6d19f1c-84a6-4e04-9b36-ad2eee2c718f None None] MFA Rules not processed for user `bd0f717f10db4e65b0d9b7a70c0252b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:23.891434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b6d19f1c-84a6-4e04-9b36-ad2eee2c718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:24.008220 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 884/1770] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:24.015066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14cc2e-4400-4430-aeb7-dc023fa7b9d4 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:24.020541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14cc2e-4400-4430-aeb7-dc023fa7b9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:24.020854 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14cc2e-4400-4430-aeb7-dc023fa7b9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:24.057801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 887/1771] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:23 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:24.070338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d19f1c-84a6-4e04-9b36-ad2eee2c718f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:24.071549 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b6d19f1c-84a6-4e04-9b36-ad2eee2c718f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:24.090055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-1c14cc2e-4400-4430-aeb7-dc023fa7b9d4 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:24.091456 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1c14cc2e-4400-4430-aeb7-dc023fa7b9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:24.227511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d19f1c-84a6-4e04-9b36-ad2eee2c718f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:24.235267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fadac2-f60f-43ac-8d44-d8250e29999e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:24.236702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadac2-f60f-43ac-8d44-d8250e29999e service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:24.236943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadac2-f60f-43ac-8d44-d8250e29999e service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:24.241006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadac2-f60f-43ac-8d44-d8250e29999e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:24.261221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fadac2-f60f-43ac-8d44-d8250e29999e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:24.269911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fadac2-f60f-43ac-8d44-d8250e29999e service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:24.285709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 888/1772] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:24.298152 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 885/1773] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:24.307694 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbc42a-b65b-48df-b69b-002768fb611f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:24.308222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbc42a-b65b-48df-b69b-002768fb611f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:24.309630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbc42a-b65b-48df-b69b-002768fb611f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:24.353451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a3bbc42a-b65b-48df-b69b-002768fb611f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:24.355686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a3bbc42a-b65b-48df-b69b-002768fb611f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:24.369252 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 889/1774] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:24.370452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14cc2e-4400-4430-aeb7-dc023fa7b9d4 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:24.398059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14cc2e-4400-4430-aeb7-dc023fa7b9d4 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:24.453949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074490af-4718-4d07-8fd0-774074479c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:24.461951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074490af-4718-4d07-8fd0-774074479c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:24.465530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074490af-4718-4d07-8fd0-774074479c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:24.468143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074490af-4718-4d07-8fd0-774074479c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:24.469296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074490af-4718-4d07-8fd0-774074479c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:24.470939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074490af-4718-4d07-8fd0-774074479c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:24.474529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074490af-4718-4d07-8fd0-774074479c7c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:24.538125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbc42a-b65b-48df-b69b-002768fb611f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:24.541779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 886/1775] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:12:24.544019 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074490af-4718-4d07-8fd0-774074479c7c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:24.574504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbc42a-b65b-48df-b69b-002768fb611f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:24.585247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074490af-4718-4d07-8fd0-774074479c7c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:24.602566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450b46e-095b-419c-a147-6991cc84a6ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:24.602566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450b46e-095b-419c-a147-6991cc84a6ad service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:24.602566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450b46e-095b-419c-a147-6991cc84a6ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:24.602817 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450b46e-095b-419c-a147-6991cc84a6ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:24.604988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065f178-2258-4184-a059-a64d14c20c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:24.606755 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065f178-2258-4184-a059-a64d14c20c61 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:24.607283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065f178-2258-4184-a059-a64d14c20c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:24.607888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065f178-2258-4184-a059-a64d14c20c61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:24.609558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065f178-2258-4184-a059-a64d14c20c61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:24.615035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065f178-2258-4184-a059-a64d14c20c61 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:24.618651 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3450b46e-095b-419c-a147-6991cc84a6ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:24.743800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 887/1776] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:24 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:24.748202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065f178-2258-4184-a059-a64d14c20c61 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:24.813466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450b46e-095b-419c-a147-6991cc84a6ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:24.815940 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450b46e-095b-419c-a147-6991cc84a6ad service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:24.837479 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 890/1777] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:24.879957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065f178-2258-4184-a059-a64d14c20c61 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:24.886055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d7a90-4a8a-474d-9aac-e162f8a2fd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:24.888207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d7a90-4a8a-474d-9aac-e162f8a2fd88 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:24.888207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d7a90-4a8a-474d-9aac-e162f8a2fd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:24.888207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d7a90-4a8a-474d-9aac-e162f8a2fd88 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:24.888478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d7a90-4a8a-474d-9aac-e162f8a2fd88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:24.890664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d7a90-4a8a-474d-9aac-e162f8a2fd88 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:24.999554 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 888/1778] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:24 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:25.000840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450b46e-095b-419c-a147-6991cc84a6ad service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:25.015252 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450b46e-095b-419c-a147-6991cc84a6ad service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:25.035566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec85ffa-9281-4a55-b170-aa1afad8939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:25.036467 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec85ffa-9281-4a55-b170-aa1afad8939e admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:25.036933 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec85ffa-9281-4a55-b170-aa1afad8939e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:25.037386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec85ffa-9281-4a55-b170-aa1afad8939e admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:25.038126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec85ffa-9281-4a55-b170-aa1afad8939e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:25.039748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec85ffa-9281-4a55-b170-aa1afad8939e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:25.067428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 891/1779] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:25.072383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d7a90-4a8a-474d-9aac-e162f8a2fd88 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:25.084859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:25.098938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d7a90-4a8a-474d-9aac-e162f8a2fd88 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:25.100744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec85ffa-9281-4a55-b170-aa1afad8939e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:25.108574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bec85ffa-9281-4a55-b170-aa1afad8939e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:25.123930 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3bbe9-d2cf-42eb-8a52-ff878ee447e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:25.124922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3bbe9-d2cf-42eb-8a52-ff878ee447e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:25.125345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3bbe9-d2cf-42eb-8a52-ff878ee447e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:25.125864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3bbe9-d2cf-42eb-8a52-ff878ee447e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:25.126888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3bbe9-d2cf-42eb-8a52-ff878ee447e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:25.128713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec85ffa-9281-4a55-b170-aa1afad8939e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:25.129032 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3bbe9-d2cf-42eb-8a52-ff878ee447e4 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:25.141915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:25.143047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:25.143337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:25.143625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] PATH_INFO: `/v3/projects/0713e9202b4c46ba949d091344c04899` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:25.147185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0713e9202b4c46ba949d091344c04899)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:25.149434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:25.154343 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 889/1780] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:25.159448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3bbe9-d2cf-42eb-8a52-ff878ee447e4 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:25.184956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3bbe9-d2cf-42eb-8a52-ff878ee447e4 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:25.190586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61d03e5-6e4f-4bd2-a38e-429253b7cf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:25.191817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d03e5-6e4f-4bd2-a38e-429253b7cf94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:25.192171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d03e5-6e4f-4bd2-a38e-429253b7cf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:25.192644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61d03e5-6e4f-4bd2-a38e-429253b7cf94 admin admin] PATH_INFO: `/v3/projects/aa0fcdd2b05b40308ad982f32bab9947/users/81987c4d5c7a47b286afc61b820c8db1/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:25.211549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d03e5-6e4f-4bd2-a38e-429253b7cf94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa0fcdd2b05b40308ad982f32bab9947, user_id=81987c4d5c7a47b286afc61b820c8db1, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:25.218051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:25.219166 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61d03e5-6e4f-4bd2-a38e-429253b7cf94 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:25.319571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 890/1781] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:25 2022] PUT /identity/v3/projects/aa0fcdd2b05b40308ad982f32bab9947/users/81987c4d5c7a47b286afc61b820c8db1/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:25.331284 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4146b-2df7-4e70-9e99-07c20605ec75 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:25.331637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4146b-2df7-4e70-9e99-07c20605ec75 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:25.331847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4146b-2df7-4e70-9e99-07c20605ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:25.380347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0713e9202b4c46ba949d091344c04899', 'request_id': 'req-c72183b3-291e-400e-b8ab-b0a74ea5839b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:25.451491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-44a4146b-2df7-4e70-9e99-07c20605ec75 None None] MFA Rules not processed for user `81987c4d5c7a47b286afc61b820c8db1`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:25.452636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-44a4146b-2df7-4e70-9e99-07c20605ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:25.504138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0713e9202b4c46ba949d091344c04899', 'request_id': 'req-c72183b3-291e-400e-b8ab-b0a74ea5839b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:25.513638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0713e9202b4c46ba949d091344c04899', 'request_id': 'req-c72183b3-291e-400e-b8ab-b0a74ea5839b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:25.531537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] The token cache is being invalidate because project 0713e9202b4c46ba949d091344c04899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:25.532212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:25.533309 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:25.535769 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 892/1782] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:25 2022] DELETE /identity/v3/projects/0713e9202b4c46ba949d091344c04899 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:25.539797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:25.546061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:25.709347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72183b3-291e-400e-b8ab-b0a74ea5839b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:25.719045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 891/1783] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:25.722825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:25.722825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:25.722825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:25.722825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] PATH_INFO: `/v3/users/b32e30f74872406e83a0c12062e9d9d1` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:25.723623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b32e30f74872406e83a0c12062e9d9d1)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:25.723707 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4146b-2df7-4e70-9e99-07c20605ec75 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:25.725118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-44a4146b-2df7-4e70-9e99-07c20605ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:25.726700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:25.743046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4146b-2df7-4e70-9e99-07c20605ec75 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:25.747934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2305666-2a70-4f7d-928b-724a64ff62da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:25.749162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2305666-2a70-4f7d-928b-724a64ff62da admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:25.749162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2305666-2a70-4f7d-928b-724a64ff62da admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:25.749162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2305666-2a70-4f7d-928b-724a64ff62da admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:25.749884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2305666-2a70-4f7d-928b-724a64ff62da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:25.751805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2305666-2a70-4f7d-928b-724a64ff62da admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:25.884157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 892/1784] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:25 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:25.893448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2305666-2a70-4f7d-928b-724a64ff62da admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:25.985376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b32e30f74872406e83a0c12062e9d9d1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:26.040537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b32e30f74872406e83a0c12062e9d9d1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:26.083642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2305666-2a70-4f7d-928b-724a64ff62da admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:26.094309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185fba5-150e-473a-bc76-7134d3a68bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:26.095235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185fba5-150e-473a-bc76-7134d3a68bae admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:26.095522 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185fba5-150e-473a-bc76-7134d3a68bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:26.095800 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185fba5-150e-473a-bc76-7134d3a68bae admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:26.097297 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185fba5-150e-473a-bc76-7134d3a68bae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:26.101255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185fba5-150e-473a-bc76-7134d3a68bae admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:26.176375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b32e30f74872406e83a0c12062e9d9d1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:26.177136 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b32e30f74872406e83a0c12062e9d9d1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:26.177991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b32e30f74872406e83a0c12062e9d9d1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:26.197298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 893/1785] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:25 2022] DELETE /identity/v3/users/b32e30f74872406e83a0c12062e9d9d1 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:26.222745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 893/1786] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:25 2022] POST /identity/v3/users => generated 296 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:26.223971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:26.225548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:26.386289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a7c50-3ebe-45ee-a725-f9eae7a0fb18 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:26.393637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4cd14-9bef-498d-a750-dff7b273792e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:26.394563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4cd14-9bef-498d-a750-dff7b273792e admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:26.394857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4cd14-9bef-498d-a750-dff7b273792e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:26.395573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4cd14-9bef-498d-a750-dff7b273792e admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:26.396337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4cd14-9bef-498d-a750-dff7b273792e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:26.397982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4cd14-9bef-498d-a750-dff7b273792e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:26.414265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 894/1787] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:26.419096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185fba5-150e-473a-bc76-7134d3a68bae admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:26.431998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185fba5-150e-473a-bc76-7134d3a68bae admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:26.438560 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d5860-74f7-4a25-86a5-b08b77731ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:26.440256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d5860-74f7-4a25-86a5-b08b77731ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:26.440717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d5860-74f7-4a25-86a5-b08b77731ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:26.441231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d5860-74f7-4a25-86a5-b08b77731ec3 admin admin] PATH_INFO: `/v3/projects/3e93da8efc424e48b5c7c2dd880f2767/users/39134acab5fe497d9fb95a5fa3c58881/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:26.463764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d5860-74f7-4a25-86a5-b08b77731ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e93da8efc424e48b5c7c2dd880f2767, user_id=39134acab5fe497d9fb95a5fa3c58881, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:26.469674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d5860-74f7-4a25-86a5-b08b77731ec3 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:26.575565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 894/1788] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:26 2022] PUT /identity/v3/projects/3e93da8efc424e48b5c7c2dd880f2767/users/39134acab5fe497d9fb95a5fa3c58881/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:26.580130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4cd14-9bef-498d-a750-dff7b273792e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:26.593625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4cd14-9bef-498d-a750-dff7b273792e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:26.659540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47e2ce-d210-4a71-ae57-4de2c3402e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:26.659540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47e2ce-d210-4a71-ae57-4de2c3402e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:26.659540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47e2ce-d210-4a71-ae57-4de2c3402e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:26.659540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47e2ce-d210-4a71-ae57-4de2c3402e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:26.659836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47e2ce-d210-4a71-ae57-4de2c3402e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:26.661406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47e2ce-d210-4a71-ae57-4de2c3402e64 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:26.676676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:26.689660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 895/1789] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:26.690797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d5860-74f7-4a25-86a5-b08b77731ec3 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:26.706471 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d5860-74f7-4a25-86a5-b08b77731ec3 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:26.715907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83cc19-fbe5-4e37-861b-79c240173b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:26.716629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83cc19-fbe5-4e37-861b-79c240173b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:26.717188 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83cc19-fbe5-4e37-861b-79c240173b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:26.718789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83cc19-fbe5-4e37-861b-79c240173b85 admin admin] PATH_INFO: `/v3/projects/3e93da8efc424e48b5c7c2dd880f2767/users/39134acab5fe497d9fb95a5fa3c58881/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:26.727781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83cc19-fbe5-4e37-861b-79c240173b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e93da8efc424e48b5c7c2dd880f2767, user_id=39134acab5fe497d9fb95a5fa3c58881, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:26.729577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83cc19-fbe5-4e37-861b-79c240173b85 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:26.747852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 895/1790] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:26 2022] PUT /identity/v3/projects/3e93da8efc424e48b5c7c2dd880f2767/users/39134acab5fe497d9fb95a5fa3c58881/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:26.758740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc093f1-644b-4175-92d5-f4c620d92e12 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:26.759148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc093f1-644b-4175-92d5-f4c620d92e12 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:26.759503 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc093f1-644b-4175-92d5-f4c620d92e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:26.798989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0bc093f1-644b-4175-92d5-f4c620d92e12 None None] MFA Rules not processed for user `39134acab5fe497d9fb95a5fa3c58881`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:26.800299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0bc093f1-644b-4175-92d5-f4c620d92e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:26.833365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83cc19-fbe5-4e37-861b-79c240173b85 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:26.835192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0f83cc19-fbe5-4e37-861b-79c240173b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:26.943807 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 896/1791] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:26.961554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:26.974830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc093f1-644b-4175-92d5-f4c620d92e12 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:26.976678 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0bc093f1-644b-4175-92d5-f4c620d92e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:27.002843 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83cc19-fbe5-4e37-861b-79c240173b85 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:27.018944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab0dd4-4303-4f99-9b13-f3618899aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:27.021066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab0dd4-4303-4f99-9b13-f3618899aa11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:27.021356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab0dd4-4303-4f99-9b13-f3618899aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:27.021636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab0dd4-4303-4f99-9b13-f3618899aa11 admin admin] PATH_INFO: `/v3/projects/c3dbb93fc77045a9acfa8263ad9d0123` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:27.026241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab0dd4-4303-4f99-9b13-f3618899aa11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3dbb93fc77045a9acfa8263ad9d0123)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:27.031484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab0dd4-4303-4f99-9b13-f3618899aa11 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:27.109732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc093f1-644b-4175-92d5-f4c620d92e12 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:27.114374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa1472-4bde-4c53-b344-d83053dc37ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:27.117625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1472-4bde-4c53-b344-d83053dc37ed service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:27.117625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1472-4bde-4c53-b344-d83053dc37ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:27.117625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa1472-4bde-4c53-b344-d83053dc37ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:27.118758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0ffa1472-4bde-4c53-b344-d83053dc37ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:27.202486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1472-4bde-4c53-b344-d83053dc37ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:27.204279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffa1472-4bde-4c53-b344-d83053dc37ed service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:27.227353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-6cab0dd4-4303-4f99-9b13-f3618899aa11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3dbb93fc77045a9acfa8263ad9d0123', 'request_id': 'req-6cab0dd4-4303-4f99-9b13-f3618899aa11'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:27.233765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 897/1792] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:27.338168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-6cab0dd4-4303-4f99-9b13-f3618899aa11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3dbb93fc77045a9acfa8263ad9d0123', 'request_id': 'req-6cab0dd4-4303-4f99-9b13-f3618899aa11'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:27.348386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-6cab0dd4-4303-4f99-9b13-f3618899aa11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3dbb93fc77045a9acfa8263ad9d0123', 'request_id': 'req-6cab0dd4-4303-4f99-9b13-f3618899aa11'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:27.367302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-6cab0dd4-4303-4f99-9b13-f3618899aa11 admin admin] The token cache is being invalidate because project c3dbb93fc77045a9acfa8263ad9d0123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:27.373833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-6cab0dd4-4303-4f99-9b13-f3618899aa11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:27.374869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-6cab0dd4-4303-4f99-9b13-f3618899aa11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:27.383691 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 896/1793] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:26 2022] DELETE /identity/v3/projects/c3dbb93fc77045a9acfa8263ad9d0123 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:27.388824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc7fac-61ab-4641-9e8f-10ff4ca275ed None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:27.389141 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc7fac-61ab-4641-9e8f-10ff4ca275ed None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:27.389431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc7fac-61ab-4641-9e8f-10ff4ca275ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:27.410677 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-24dc7fac-61ab-4641-9e8f-10ff4ca275ed None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:27.411907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-24dc7fac-61ab-4641-9e8f-10ff4ca275ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:27.478648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 898/1794] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:27.487675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489e00d-c7e6-4dd7-8e2b-55f559978791 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:27.487965 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489e00d-c7e6-4dd7-8e2b-55f559978791 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:27.488243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489e00d-c7e6-4dd7-8e2b-55f559978791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:27.506778 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-6489e00d-c7e6-4dd7-8e2b-55f559978791 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:27.510764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6489e00d-c7e6-4dd7-8e2b-55f559978791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:27.520550 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 897/1795] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:27.522139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc7fac-61ab-4641-9e8f-10ff4ca275ed None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:27.534260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc7fac-61ab-4641-9e8f-10ff4ca275ed None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:27.539262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e2b35-733d-499d-94a3-bd5873fd9287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:27.540129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e2b35-733d-499d-94a3-bd5873fd9287 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:27.540484 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e2b35-733d-499d-94a3-bd5873fd9287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:27.540894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818e2b35-733d-499d-94a3-bd5873fd9287 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:27.541803 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e2b35-733d-499d-94a3-bd5873fd9287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:27.542365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e2b35-733d-499d-94a3-bd5873fd9287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:27.545002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818e2b35-733d-499d-94a3-bd5873fd9287 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:27.559252 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 899/1796] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:27.563879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489e00d-c7e6-4dd7-8e2b-55f559978791 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:27.585109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489e00d-c7e6-4dd7-8e2b-55f559978791 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:27.600121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d5a6e-c1d7-432e-aae4-1eb6af4acc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:27.601052 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d5a6e-c1d7-432e-aae4-1eb6af4acc1a admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:27.601492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d5a6e-c1d7-432e-aae4-1eb6af4acc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:27.603360 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d5a6e-c1d7-432e-aae4-1eb6af4acc1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:27.606263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d5a6e-c1d7-432e-aae4-1eb6af4acc1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:27.609051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d5a6e-c1d7-432e-aae4-1eb6af4acc1a admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:27.759604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 898/1797] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:27 2022] POST /identity/v3/projects => generated 377 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:27.764144 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e2b35-733d-499d-94a3-bd5873fd9287 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:27.780953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818e2b35-733d-499d-94a3-bd5873fd9287 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:27.913129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752f2bd-3848-42a8-abd4-648ed0786986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:27.914343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752f2bd-3848-42a8-abd4-648ed0786986 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:27.916963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752f2bd-3848-42a8-abd4-648ed0786986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:27.917123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752f2bd-3848-42a8-abd4-648ed0786986 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:27.920207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752f2bd-3848-42a8-abd4-648ed0786986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:27.926539 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752f2bd-3848-42a8-abd4-648ed0786986 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:28.049498 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 900/1798] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:27 2022] POST /identity/v3/users => generated 289 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:28.055226 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d5a6e-c1d7-432e-aae4-1eb6af4acc1a admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:28.068045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d5a6e-c1d7-432e-aae4-1eb6af4acc1a admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:28.079512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d838d7b-721d-4766-acc1-492d8db6ea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:28.083865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d838d7b-721d-4766-acc1-492d8db6ea48 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:28.083865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d838d7b-721d-4766-acc1-492d8db6ea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:28.083865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d838d7b-721d-4766-acc1-492d8db6ea48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:28.083865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d838d7b-721d-4766-acc1-492d8db6ea48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:28.083865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d838d7b-721d-4766-acc1-492d8db6ea48 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:28.135898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 899/1799] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:28.144191 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752f2bd-3848-42a8-abd4-648ed0786986 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:28.159607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752f2bd-3848-42a8-abd4-648ed0786986 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:28.174862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff36f13-a926-4609-97d2-f48716ebe1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:28.175548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff36f13-a926-4609-97d2-f48716ebe1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:28.175840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff36f13-a926-4609-97d2-f48716ebe1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:28.176124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff36f13-a926-4609-97d2-f48716ebe1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:28.176888 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff36f13-a926-4609-97d2-f48716ebe1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:28.179326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff36f13-a926-4609-97d2-f48716ebe1e7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:28.218290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 901/1800] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:28.219492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d838d7b-721d-4766-acc1-492d8db6ea48 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:28.245871 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d838d7b-721d-4766-acc1-492d8db6ea48 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:28.264936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba84b4-2185-44db-8f5d-1a69f15ee605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:28.265899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba84b4-2185-44db-8f5d-1a69f15ee605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:28.266045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba84b4-2185-44db-8f5d-1a69f15ee605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:28.266483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba84b4-2185-44db-8f5d-1a69f15ee605 admin admin] PATH_INFO: `/v3/projects/2d9eb1d9834645a2a2ddcc62d3b4e0fe/users/2ad54b63f2fd458bbe5eaac7e0788fb8/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:28.304169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba84b4-2185-44db-8f5d-1a69f15ee605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d9eb1d9834645a2a2ddcc62d3b4e0fe, user_id=2ad54b63f2fd458bbe5eaac7e0788fb8, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:28.306823 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba84b4-2185-44db-8f5d-1a69f15ee605 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:28.436437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 900/1801] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:28 2022] PUT /identity/v3/projects/2d9eb1d9834645a2a2ddcc62d3b4e0fe/users/2ad54b63f2fd458bbe5eaac7e0788fb8/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:28.440455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463ecc1-21f4-4607-a6ad-6c60ad7ce44c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:28.440748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463ecc1-21f4-4607-a6ad-6c60ad7ce44c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:28.441139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463ecc1-21f4-4607-a6ad-6c60ad7ce44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:28.486971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a463ecc1-21f4-4607-a6ad-6c60ad7ce44c None None] MFA Rules not processed for user `2ad54b63f2fd458bbe5eaac7e0788fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:28.489567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a463ecc1-21f4-4607-a6ad-6c60ad7ce44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:28.637827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 902/1802] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:28.642615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba84b4-2185-44db-8f5d-1a69f15ee605 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:28.766695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba84b4-2185-44db-8f5d-1a69f15ee605 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:28.793594 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b1d25-ccb6-4a4e-9c93-0a2aaa75ceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:28.796139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b1d25-ccb6-4a4e-9c93-0a2aaa75ceed admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:28.796439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b1d25-ccb6-4a4e-9c93-0a2aaa75ceed admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:28.801694 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b1d25-ccb6-4a4e-9c93-0a2aaa75ceed admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:28.801694 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b1d25-ccb6-4a4e-9c93-0a2aaa75ceed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:28.806699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b1d25-ccb6-4a4e-9c93-0a2aaa75ceed admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:28.827984 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88edd-fc68-4246-a982-a09b63451ae3 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:28.828359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88edd-fc68-4246-a982-a09b63451ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:28.830496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a88edd-fc68-4246-a982-a09b63451ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:28.857637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:28.905855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d0a88edd-fc68-4246-a982-a09b63451ae3 None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:28.908206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d0a88edd-fc68-4246-a982-a09b63451ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:28.978466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:28.987727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 901/1803] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:28 2022] POST /identity/v3/projects => generated 377 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:29.000066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b1d25-ccb6-4a4e-9c93-0a2aaa75ceed admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:29.094429 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 903/1804] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:12:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:29.175918 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b1d25-ccb6-4a4e-9c93-0a2aaa75ceed admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:29.195530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4df0d-037b-43e4-8444-37f73d60d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:29.196913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4df0d-037b-43e4-8444-37f73d60d220 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:29.197431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4df0d-037b-43e4-8444-37f73d60d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:29.198317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee4df0d-037b-43e4-8444-37f73d60d220 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:29.200127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4df0d-037b-43e4-8444-37f73d60d220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:29.202983 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee4df0d-037b-43e4-8444-37f73d60d220 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:29.385821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 902/1805] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:28 2022] POST /identity/v3/users => generated 295 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:29.389052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88edd-fc68-4246-a982-a09b63451ae3 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:29.405221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a88edd-fc68-4246-a982-a09b63451ae3 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:29.412296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d901d-65bb-4598-9117-2ed1c48e1f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:29.413132 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d901d-65bb-4598-9117-2ed1c48e1f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:29.413496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d901d-65bb-4598-9117-2ed1c48e1f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:29.413851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d901d-65bb-4598-9117-2ed1c48e1f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:29.414675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d901d-65bb-4598-9117-2ed1c48e1f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:29.417094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d901d-65bb-4598-9117-2ed1c48e1f3f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:29.429606 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 904/1806] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:29.434458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4df0d-037b-43e4-8444-37f73d60d220 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:29.461501 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d901d-65bb-4598-9117-2ed1c48e1f3f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:29.464192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8c1d901d-65bb-4598-9117-2ed1c48e1f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:29.470025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee4df0d-037b-43e4-8444-37f73d60d220 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:29.502652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51765f-a2ad-4b5b-9ac7-66575e1f665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:29.503962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51765f-a2ad-4b5b-9ac7-66575e1f665c admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:29.504252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51765f-a2ad-4b5b-9ac7-66575e1f665c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:29.504529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51765f-a2ad-4b5b-9ac7-66575e1f665c admin admin] PATH_INFO: `/v3/projects/200d7ef48ae54e82b53db162411e3d05/users/7d59380634ee4599af80ece825b16553/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:29.546638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51765f-a2ad-4b5b-9ac7-66575e1f665c admin admin] RBAC: Authorizing `identity:create_grant(project_id=200d7ef48ae54e82b53db162411e3d05, user_id=7d59380634ee4599af80ece825b16553, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:29.549521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51765f-a2ad-4b5b-9ac7-66575e1f665c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:29.614944 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d901d-65bb-4598-9117-2ed1c48e1f3f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:29.626779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4986b1-573b-438a-abc3-99fb97f697a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:29.627476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4986b1-573b-438a-abc3-99fb97f697a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:29.627762 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4986b1-573b-438a-abc3-99fb97f697a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:29.628041 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4986b1-573b-438a-abc3-99fb97f697a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:29.633513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0c4986b1-573b-438a-abc3-99fb97f697a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:29.665784 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 903/1807] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:29 2022] PUT /identity/v3/projects/200d7ef48ae54e82b53db162411e3d05/users/7d59380634ee4599af80ece825b16553/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:29.667049 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51765f-a2ad-4b5b-9ac7-66575e1f665c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:29.672686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1a51765f-a2ad-4b5b-9ac7-66575e1f665c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:29.746992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4986b1-573b-438a-abc3-99fb97f697a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:29.748589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4986b1-573b-438a-abc3-99fb97f697a7 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:29.781225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 905/1808] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:29.783106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4986b1-573b-438a-abc3-99fb97f697a7 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:29.789499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0c4986b1-573b-438a-abc3-99fb97f697a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:29.832253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51765f-a2ad-4b5b-9ac7-66575e1f665c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:29.851616 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243c494-fb32-4c9a-83d0-efdd8cc9e6a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:29.852325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243c494-fb32-4c9a-83d0-efdd8cc9e6a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:29.852721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243c494-fb32-4c9a-83d0-efdd8cc9e6a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:29.853030 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243c494-fb32-4c9a-83d0-efdd8cc9e6a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:29.857397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f243c494-fb32-4c9a-83d0-efdd8cc9e6a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:30.002685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4986b1-573b-438a-abc3-99fb97f697a7 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:30.007472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243c494-fb32-4c9a-83d0-efdd8cc9e6a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:30.009222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243c494-fb32-4c9a-83d0-efdd8cc9e6a6 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:30.022622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 904/1809] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:30.033975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243c494-fb32-4c9a-83d0-efdd8cc9e6a6 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:30.193289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cb4ff-a060-4482-ac28-cff490ae64e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:30.194128 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cb4ff-a060-4482-ac28-cff490ae64e6 service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:30.194731 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cb4ff-a060-4482-ac28-cff490ae64e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:30.194991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8cb4ff-a060-4482-ac28-cff490ae64e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:30.277439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243c494-fb32-4c9a-83d0-efdd8cc9e6a6 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:30.303717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c26e9-f332-4fc6-9205-4df758d072cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:30.304420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c26e9-f332-4fc6-9205-4df758d072cd admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:30.305144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c26e9-f332-4fc6-9205-4df758d072cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:30.305144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c26e9-f332-4fc6-9205-4df758d072cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:30.305750 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c26e9-f332-4fc6-9205-4df758d072cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:30.312968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c26e9-f332-4fc6-9205-4df758d072cd admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:30.335483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cb4ff-a060-4482-ac28-cff490ae64e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:30.335483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8cb4ff-a060-4482-ac28-cff490ae64e6 service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:30.346565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 905/1810] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:30.357987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc727e9-6f0c-471d-ab24-6d229bd3d541 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:30.360522 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc727e9-6f0c-471d-ab24-6d229bd3d541 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:30.360636 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 906/1811] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:12:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:12:30.360727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc727e9-6f0c-471d-ab24-6d229bd3d541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:30.364451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cb4ff-a060-4482-ac28-cff490ae64e6 service swift] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:30.404890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8cb4ff-a060-4482-ac28-cff490ae64e6 service swift] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:30.432992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e261f-fcb8-447f-9d80-4638cb313d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:30.436942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e261f-fcb8-447f-9d80-4638cb313d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:30.438972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e261f-fcb8-447f-9d80-4638cb313d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:30.440028 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-cfc727e9-6f0c-471d-ab24-6d229bd3d541 None None] MFA Rules not processed for user `83858713769b41af800bab317602bf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:30.441369 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e261f-fcb8-447f-9d80-4638cb313d75 admin admin] PATH_INFO: `/v3/projects/200d7ef48ae54e82b53db162411e3d05/users/7d59380634ee4599af80ece825b16553/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:30.445231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cfc727e9-6f0c-471d-ab24-6d229bd3d541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:30.448791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e261f-fcb8-447f-9d80-4638cb313d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200d7ef48ae54e82b53db162411e3d05, user_id=7d59380634ee4599af80ece825b16553, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:30.460048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e261f-fcb8-447f-9d80-4638cb313d75 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:30.514050 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 907/1812] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:30 2022] PUT /identity/v3/projects/200d7ef48ae54e82b53db162411e3d05/users/7d59380634ee4599af80ece825b16553/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:30.530464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bb07c-a3c4-41f2-985e-93543eb9df5c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:30.531077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bb07c-a3c4-41f2-985e-93543eb9df5c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:30.531541 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bb07c-a3c4-41f2-985e-93543eb9df5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:30.611749 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-cd9bb07c-a3c4-41f2-985e-93543eb9df5c None None] MFA Rules not processed for user `7d59380634ee4599af80ece825b16553`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:30.614103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-cd9bb07c-a3c4-41f2-985e-93543eb9df5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:30.658872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:30.774433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:30.792434 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 906/1813] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Jun 23 13:12:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:30.831402 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 908/1814] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:30.845514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc727e9-6f0c-471d-ab24-6d229bd3d541 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:30.847765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cfc727e9-6f0c-471d-ab24-6d229bd3d541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:30.931224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc727e9-6f0c-471d-ab24-6d229bd3d541 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:31.020530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51fbd4-d41e-46b0-8cd4-736338766642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:31.020530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51fbd4-d41e-46b0-8cd4-736338766642 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:31.020530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51fbd4-d41e-46b0-8cd4-736338766642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:31.020530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51fbd4-d41e-46b0-8cd4-736338766642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:31.027898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51fbd4-d41e-46b0-8cd4-736338766642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:31.030657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51fbd4-d41e-46b0-8cd4-736338766642 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:31.050108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 907/1815] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:31.076203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bb07c-a3c4-41f2-985e-93543eb9df5c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:31.220161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bb07c-a3c4-41f2-985e-93543eb9df5c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:31.256033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf7d95-3221-4ccf-a81d-2a3e8acf19ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:31.259936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf7d95-3221-4ccf-a81d-2a3e8acf19ce service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:31.260298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf7d95-3221-4ccf-a81d-2a3e8acf19ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:31.260594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf7d95-3221-4ccf-a81d-2a3e8acf19ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:31.434004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf7d95-3221-4ccf-a81d-2a3e8acf19ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:31.436128 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf7d95-3221-4ccf-a81d-2a3e8acf19ce service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:31.452221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 909/1816] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:31.468127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:32.858908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:33.431573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:34.366258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23398617-73f9-44cb-9806-38ebb53c1a21 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:34.367393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23398617-73f9-44cb-9806-38ebb53c1a21 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:34.367880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23398617-73f9-44cb-9806-38ebb53c1a21 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:34.370705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 908/1817] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:12:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:12:34.469342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf7d95-3221-4ccf-a81d-2a3e8acf19ce service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:34.483239 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-dcaf7d95-3221-4ccf-a81d-2a3e8acf19ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:34.617363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c7c3e-413d-4093-a2bb-89bad6f678d3 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:34.617865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c7c3e-413d-4093-a2bb-89bad6f678d3 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:34.618291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c7c3e-413d-4093-a2bb-89bad6f678d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:34.641142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf7d95-3221-4ccf-a81d-2a3e8acf19ce service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:34.654454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d02c7c3e-413d-4093-a2bb-89bad6f678d3 None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:34.655906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d02c7c3e-413d-4093-a2bb-89bad6f678d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:34.664253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:34.667242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:34.668285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:34.668982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] PATH_INFO: `/v3/users/2d7700d5bbc748a896b23047513f66f3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:34.674277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7700d5bbc748a896b23047513f66f3)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:34.676843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:34.811528 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 909/1818] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:12:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:35.105826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7700d5bbc748a896b23047513f66f3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:35.145469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7700d5bbc748a896b23047513f66f3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:35.414583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7700d5bbc748a896b23047513f66f3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:35.414583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7700d5bbc748a896b23047513f66f3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:35.414583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7700d5bbc748a896b23047513f66f3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:35.430065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 910/1819] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:34 2022] DELETE /identity/v3/users/2d7700d5bbc748a896b23047513f66f3 => generated 0 bytes in 962 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:35.435106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36b2f2-8482-4abf-a998-cdc84fd877e0 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:35.435623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36b2f2-8482-4abf-a998-cdc84fd877e0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:35.435720 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36b2f2-8482-4abf-a998-cdc84fd877e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:35.459575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-5d36b2f2-8482-4abf-a998-cdc84fd877e0 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:35.461122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5d36b2f2-8482-4abf-a998-cdc84fd877e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:35.496614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:35.502628 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:35.606084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 910/1820] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:35.629052 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36b2f2-8482-4abf-a998-cdc84fd877e0 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:35.631539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5d36b2f2-8482-4abf-a998-cdc84fd877e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:35.684319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:35.722275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e00d8f-792b-4967-8934-9c072c0ef37b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:35.749993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d07f1d-61e6-4e99-876a-f3ff60644e78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:35.753435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d07f1d-61e6-4e99-876a-f3ff60644e78 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:35.754032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d07f1d-61e6-4e99-876a-f3ff60644e78 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:35.754630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d07f1d-61e6-4e99-876a-f3ff60644e78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:35.770590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-29d07f1d-61e6-4e99-876a-f3ff60644e78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:35.814580 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d07f1d-61e6-4e99-876a-f3ff60644e78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:35.821095 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d07f1d-61e6-4e99-876a-f3ff60644e78 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:35.833294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d36b2f2-8482-4abf-a998-cdc84fd877e0 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:35.847548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38667f7e-1b97-42a5-8b66-fa56dc2f953c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:35.850850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38667f7e-1b97-42a5-8b66-fa56dc2f953c service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:35.851532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38667f7e-1b97-42a5-8b66-fa56dc2f953c service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:35.853101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38667f7e-1b97-42a5-8b66-fa56dc2f953c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:35.878700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 911/1821] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:35.913806 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38667f7e-1b97-42a5-8b66-fa56dc2f953c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:35.919609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38667f7e-1b97-42a5-8b66-fa56dc2f953c service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:35.947963 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 911/1822] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:36.907423 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231faf8-86f1-4754-8cbd-e4691d58d9e4 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:36.908298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231faf8-86f1-4754-8cbd-e4691d58d9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:36.908732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231faf8-86f1-4754-8cbd-e4691d58d9e4 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:36.910978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 912/1823] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:12:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:12:37.041841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efc96e-0f93-427e-a27b-358681534f8b None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:37.043450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efc96e-0f93-427e-a27b-358681534f8b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:37.043890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efc96e-0f93-427e-a27b-358681534f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:37.111526 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-52efc96e-0f93-427e-a27b-358681534f8b None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:37.112798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-52efc96e-0f93-427e-a27b-358681534f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:37.162593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 912/1824] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:37.208183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231faf8-86f1-4754-8cbd-e4691d58d9e4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:37.209516 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efc96e-0f93-427e-a27b-358681534f8b None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:37.213675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-52efc96e-0f93-427e-a27b-358681534f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:37.217168 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5231faf8-86f1-4754-8cbd-e4691d58d9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:37.273667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efc96e-0f93-427e-a27b-358681534f8b None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:37.291182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231faf8-86f1-4754-8cbd-e4691d58d9e4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:37.298792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be2a57-ad46-45f6-9d29-5c42be35bc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:37.299723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be2a57-ad46-45f6-9d29-5c42be35bc4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:37.300012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be2a57-ad46-45f6-9d29-5c42be35bc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:37.300294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be2a57-ad46-45f6-9d29-5c42be35bc4c admin admin] PATH_INFO: `/v3/users/1dae095ac1ad479281866a76dcbc4f40` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:37.301544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01079496-06f7-4e92-8f7c-f3499f8a14d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:37.302516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01079496-06f7-4e92-8f7c-f3499f8a14d6 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:37.303008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01079496-06f7-4e92-8f7c-f3499f8a14d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:37.303562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01079496-06f7-4e92-8f7c-f3499f8a14d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:37.304123 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be2a57-ad46-45f6-9d29-5c42be35bc4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dae095ac1ad479281866a76dcbc4f40)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:37.308460 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be2a57-ad46-45f6-9d29-5c42be35bc4c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:37.318164 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01079496-06f7-4e92-8f7c-f3499f8a14d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:37.321412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01079496-06f7-4e92-8f7c-f3499f8a14d6 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:37.337865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 913/1825] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:37.340071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01079496-06f7-4e92-8f7c-f3499f8a14d6 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:37.341995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-01079496-06f7-4e92-8f7c-f3499f8a14d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:37.465819 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01079496-06f7-4e92-8f7c-f3499f8a14d6 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:37.479689 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a239c9-4987-4018-9151-390b7a29fc37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:37.480977 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a239c9-4987-4018-9151-390b7a29fc37 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:37.481290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a239c9-4987-4018-9151-390b7a29fc37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:37.481563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a239c9-4987-4018-9151-390b7a29fc37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:37.483565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e1a239c9-4987-4018-9151-390b7a29fc37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:37.649942 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-06be2a57-ad46-45f6-9d29-5c42be35bc4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dae095ac1ad479281866a76dcbc4f40'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:37.659505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:37.674556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a239c9-4987-4018-9151-390b7a29fc37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:37.680191 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a239c9-4987-4018-9151-390b7a29fc37 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:37.681193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-06be2a57-ad46-45f6-9d29-5c42be35bc4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dae095ac1ad479281866a76dcbc4f40'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:37.707271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 914/1826] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:37.763919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a239c9-4987-4018-9151-390b7a29fc37 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:37.765800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e1a239c9-4987-4018-9151-390b7a29fc37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:37.783210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-06be2a57-ad46-45f6-9d29-5c42be35bc4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dae095ac1ad479281866a76dcbc4f40'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:37.786170 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-06be2a57-ad46-45f6-9d29-5c42be35bc4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dae095ac1ad479281866a76dcbc4f40'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:37.786170 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-06be2a57-ad46-45f6-9d29-5c42be35bc4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dae095ac1ad479281866a76dcbc4f40'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:37.788304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a239c9-4987-4018-9151-390b7a29fc37 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:37.814493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 913/1827] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:37 2022] DELETE /identity/v3/users/1dae095ac1ad479281866a76dcbc4f40 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:37.814865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:37.815716 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:37.816004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:37.816320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] PATH_INFO: `/v3/projects/6d249a0d66e64b6f9ccf535221942be1` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:37.822421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d249a0d66e64b6f9ccf535221942be1)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:37.822421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:37.824518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305afae-d314-44b3-9879-a4a207de913c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:37.824833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305afae-d314-44b3-9879-a4a207de913c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:37.825122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305afae-d314-44b3-9879-a4a207de913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:37.863720 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-3305afae-d314-44b3-9879-a4a207de913c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:37.869036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-3305afae-d314-44b3-9879-a4a207de913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:38.038319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d249a0d66e64b6f9ccf535221942be1', 'request_id': 'req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:38.090193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 914/1828] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:38.091055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305afae-d314-44b3-9879-a4a207de913c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:38.093260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-3305afae-d314-44b3-9879-a4a207de913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:38.127533 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305afae-d314-44b3-9879-a4a207de913c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:38.171895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d249a0d66e64b6f9ccf535221942be1', 'request_id': 'req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:38.184382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d249a0d66e64b6f9ccf535221942be1', 'request_id': 'req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:38.238243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] The token cache is being invalidate because project 6d249a0d66e64b6f9ccf535221942be1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:38.239071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:38.242097 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:38.255375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 915/1829] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:37 2022] DELETE /identity/v3/projects/6d249a0d66e64b6f9ccf535221942be1 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:38.255375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:38.258090 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:38.286640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a8d3c-0b1a-4c17-ad35-019fe382b57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:38.288004 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a8d3c-0b1a-4c17-ad35-019fe382b57d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:38.296653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a8d3c-0b1a-4c17-ad35-019fe382b57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:38.296653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a8d3c-0b1a-4c17-ad35-019fe382b57d admin admin] PATH_INFO: `/v3/users/81987c4d5c7a47b286afc61b820c8db1` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:38.296653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a8d3c-0b1a-4c17-ad35-019fe382b57d admin admin] RBAC: Authorizing `identity:delete_user(user_id=81987c4d5c7a47b286afc61b820c8db1)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:38.298195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a8d3c-0b1a-4c17-ad35-019fe382b57d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:38.344122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:38.433511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0adad5-5cb9-4b4f-b423-bf0d0f45cf9c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:38.451246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2439f54-0493-4d57-aa66-f424389afa2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:38.454786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2439f54-0493-4d57-aa66-f424389afa2c service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:38.454786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2439f54-0493-4d57-aa66-f424389afa2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:38.454786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2439f54-0493-4d57-aa66-f424389afa2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:38.459644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b2439f54-0493-4d57-aa66-f424389afa2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:38.508682 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2439f54-0493-4d57-aa66-f424389afa2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:38.512274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2439f54-0493-4d57-aa66-f424389afa2c service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:38.546424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 916/1830] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:38.546424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2439f54-0493-4d57-aa66-f424389afa2c service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:38.546424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b2439f54-0493-4d57-aa66-f424389afa2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:38.566055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2439f54-0493-4d57-aa66-f424389afa2c service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:38.590672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:38.591591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:38.591879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:38.592162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] PATH_INFO: `/v3/users/bd0f717f10db4e65b0d9b7a70c0252b7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:38.595026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd0f717f10db4e65b0d9b7a70c0252b7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:38.597125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:38.685662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-eb5a8d3c-0b1a-4c17-ad35-019fe382b57d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81987c4d5c7a47b286afc61b820c8db1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:38.721292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-eb5a8d3c-0b1a-4c17-ad35-019fe382b57d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81987c4d5c7a47b286afc61b820c8db1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:38.816200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-eb5a8d3c-0b1a-4c17-ad35-019fe382b57d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81987c4d5c7a47b286afc61b820c8db1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:38.845146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-eb5a8d3c-0b1a-4c17-ad35-019fe382b57d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81987c4d5c7a47b286afc61b820c8db1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:38.845146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-eb5a8d3c-0b1a-4c17-ad35-019fe382b57d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81987c4d5c7a47b286afc61b820c8db1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:38.852438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 915/1831] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:38 2022] DELETE /identity/v3/users/81987c4d5c7a47b286afc61b820c8db1 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:38.880637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2e24-8888-4e76-ab10-beb3ffc13e6b None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:38.881025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2e24-8888-4e76-ab10-beb3ffc13e6b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:38.881361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e2e24-8888-4e76-ab10-beb3ffc13e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:38.973748 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d58e2e24-8888-4e76-ab10-beb3ffc13e6b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:38.975007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d58e2e24-8888-4e76-ab10-beb3ffc13e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:39.101702 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 916/1832] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:39.138700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd0f717f10db4e65b0d9b7a70c0252b7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:39.171257 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd0f717f10db4e65b0d9b7a70c0252b7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:39.180393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2e24-8888-4e76-ab10-beb3ffc13e6b None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:39.185347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d58e2e24-8888-4e76-ab10-beb3ffc13e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:39.278276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e2e24-8888-4e76-ab10-beb3ffc13e6b None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:39.287993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86d1d2-f208-42a4-ad00-354807e2e643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:39.287993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86d1d2-f208-42a4-ad00-354807e2e643 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:39.287993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86d1d2-f208-42a4-ad00-354807e2e643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:39.287993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86d1d2-f208-42a4-ad00-354807e2e643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:39.301180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86d1d2-f208-42a4-ad00-354807e2e643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:39.303860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86d1d2-f208-42a4-ad00-354807e2e643 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:39.318771 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd0f717f10db4e65b0d9b7a70c0252b7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:39.319411 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 917/1833] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:39.319891 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd0f717f10db4e65b0d9b7a70c0252b7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:39.320706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd0f717f10db4e65b0d9b7a70c0252b7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:39.354306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 917/1834] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:38 2022] DELETE /identity/v3/users/bd0f717f10db4e65b0d9b7a70c0252b7 => generated 0 bytes in 814 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:40.238234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86d1d2-f208-42a4-ad00-354807e2e643 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:40.240651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cb86d1d2-f208-42a4-ad00-354807e2e643 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:40.278768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86d1d2-f208-42a4-ad00-354807e2e643 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:40.446423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:40.446423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:40.446423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:40.446423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] PATH_INFO: `/v3/projects/fe0ef0214af240ba83a6dbeda4c8a3a4` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:40.447354 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0ef0214af240ba83a6dbeda4c8a3a4)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:40.447354 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:40.607036 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:40.609415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:40.637559 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a694a0-8220-4cee-bd4c-d5980b084653 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:40.645671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:40.646646 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:40.646992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:40.647519 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] PATH_INFO: `/v3/projects/aa0fcdd2b05b40308ad982f32bab9947` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:40.650063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa0fcdd2b05b40308ad982f32bab9947)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:40.655563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:40.799449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0ef0214af240ba83a6dbeda4c8a3a4', 'request_id': 'req-16d6629a-6a25-4c07-a65a-05b7751982a5'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:40.827670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa0fcdd2b05b40308ad982f32bab9947', 'request_id': 'req-4e5ff200-d269-4d35-8268-8acf9268d6e5'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:40.938283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0ef0214af240ba83a6dbeda4c8a3a4', 'request_id': 'req-16d6629a-6a25-4c07-a65a-05b7751982a5'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:40.946016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0ef0214af240ba83a6dbeda4c8a3a4', 'request_id': 'req-16d6629a-6a25-4c07-a65a-05b7751982a5'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:40.969167 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] The token cache is being invalidate because project fe0ef0214af240ba83a6dbeda4c8a3a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:40.969904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:40.970781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:40.973955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 918/1835] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:40 2022] DELETE /identity/v3/projects/fe0ef0214af240ba83a6dbeda4c8a3a4 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:40.975398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:40.977049 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:41.012832 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa0fcdd2b05b40308ad982f32bab9947', 'request_id': 'req-4e5ff200-d269-4d35-8268-8acf9268d6e5'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:41.022229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa0fcdd2b05b40308ad982f32bab9947', 'request_id': 'req-4e5ff200-d269-4d35-8268-8acf9268d6e5'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:41.032359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] The token cache is being invalidate because project aa0fcdd2b05b40308ad982f32bab9947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:41.032713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:41.038493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:41.041474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 918/1836] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:40 2022] DELETE /identity/v3/projects/aa0fcdd2b05b40308ad982f32bab9947 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:41.043085 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:41.047373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:41.101302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6629a-6a25-4c07-a65a-05b7751982a5 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:41.160626 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5ff200-d269-4d35-8268-8acf9268d6e5 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:41.165911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af97d0-afa3-4217-8b07-db40f4e587ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:41.166811 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af97d0-afa3-4217-8b07-db40f4e587ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:41.167222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af97d0-afa3-4217-8b07-db40f4e587ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:41.168420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af97d0-afa3-4217-8b07-db40f4e587ca admin admin] PATH_INFO: `/v3/users/8254c0e633c8450d9adb2e2e5792e7bd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:41.169731 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af97d0-afa3-4217-8b07-db40f4e587ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=8254c0e633c8450d9adb2e2e5792e7bd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:41.172019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af97d0-afa3-4217-8b07-db40f4e587ca admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:41.206003 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:41.218430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:41.219873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:41.220366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] PATH_INFO: `/v3/projects/0b4b58cec7ad4574a6a9f470b4387475` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:41.223436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4b58cec7ad4574a6a9f470b4387475)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:41.256031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:41.490560 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4b58cec7ad4574a6a9f470b4387475', 'request_id': 'req-d13aeea2-4b0d-428f-9945-142070591992'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:41.639957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4b58cec7ad4574a6a9f470b4387475', 'request_id': 'req-d13aeea2-4b0d-428f-9945-142070591992'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:41.652213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4b58cec7ad4574a6a9f470b4387475', 'request_id': 'req-d13aeea2-4b0d-428f-9945-142070591992'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:41.661451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c3af97d0-afa3-4217-8b07-db40f4e587ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8254c0e633c8450d9adb2e2e5792e7bd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:41.684019 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] The token cache is being invalidate because project 0b4b58cec7ad4574a6a9f470b4387475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:41.684375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:41.685176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:41.689226 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 919/1837] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:40 2022] DELETE /identity/v3/projects/0b4b58cec7ad4574a6a9f470b4387475 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:41.690225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:41.691399 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c3af97d0-afa3-4217-8b07-db40f4e587ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8254c0e633c8450d9adb2e2e5792e7bd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:41.692138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:41.804594 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13aeea2-4b0d-428f-9945-142070591992 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:41.810749 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:41.811893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:41.812069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:41.812351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] PATH_INFO: `/v3/users/39134acab5fe497d9fb95a5fa3c58881` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:41.814334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=39134acab5fe497d9fb95a5fa3c58881)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:41.817030 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:42.083844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c3af97d0-afa3-4217-8b07-db40f4e587ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8254c0e633c8450d9adb2e2e5792e7bd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:42.084572 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c3af97d0-afa3-4217-8b07-db40f4e587ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8254c0e633c8450d9adb2e2e5792e7bd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:42.085377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c3af97d0-afa3-4217-8b07-db40f4e587ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8254c0e633c8450d9adb2e2e5792e7bd'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:42.129179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 919/1838] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:41 2022] DELETE /identity/v3/users/8254c0e633c8450d9adb2e2e5792e7bd => generated 0 bytes in 1083 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:42.141605 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6d679-90d4-4a19-9ca6-c6d89f83279e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:42.145888 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6d679-90d4-4a19-9ca6-c6d89f83279e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:42.146257 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6d679-90d4-4a19-9ca6-c6d89f83279e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:42.168434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-74d6d679-90d4-4a19-9ca6-c6d89f83279e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:42.169757 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-74d6d679-90d4-4a19-9ca6-c6d89f83279e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:42.262192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 920/1839] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:42.269534 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee544fb6-0e75-4b3c-a790-d1b030c9937f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:42.270230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee544fb6-0e75-4b3c-a790-d1b030c9937f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:42.270746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee544fb6-0e75-4b3c-a790-d1b030c9937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:42.305015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ee544fb6-0e75-4b3c-a790-d1b030c9937f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:42.312863 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ee544fb6-0e75-4b3c-a790-d1b030c9937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:42.327686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 921/1840] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:42.341680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee544fb6-0e75-4b3c-a790-d1b030c9937f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:42.356168 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee544fb6-0e75-4b3c-a790-d1b030c9937f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:42.362945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f463e2e-6d38-4d2b-b713-0ff3f2626042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:42.363747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f463e2e-6d38-4d2b-b713-0ff3f2626042 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:42.364103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f463e2e-6d38-4d2b-b713-0ff3f2626042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:42.364454 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f463e2e-6d38-4d2b-b713-0ff3f2626042 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:42.365356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f463e2e-6d38-4d2b-b713-0ff3f2626042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:42.365737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f463e2e-6d38-4d2b-b713-0ff3f2626042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:42.368335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f463e2e-6d38-4d2b-b713-0ff3f2626042 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:42.398305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 922/1841] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:42.405646 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f463e2e-6d38-4d2b-b713-0ff3f2626042 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:42.421594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f463e2e-6d38-4d2b-b713-0ff3f2626042 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:42.426206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39134acab5fe497d9fb95a5fa3c58881'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:42.436223 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad715f2f-007b-4bed-bc3e-fef5ab95d20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:42.438196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad715f2f-007b-4bed-bc3e-fef5ab95d20c admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:42.438196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad715f2f-007b-4bed-bc3e-fef5ab95d20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:42.438647 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad715f2f-007b-4bed-bc3e-fef5ab95d20c admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:42.439558 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad715f2f-007b-4bed-bc3e-fef5ab95d20c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:42.443248 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39134acab5fe497d9fb95a5fa3c58881'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:42.444718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad715f2f-007b-4bed-bc3e-fef5ab95d20c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:42.521227 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39134acab5fe497d9fb95a5fa3c58881'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:42.521928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39134acab5fe497d9fb95a5fa3c58881'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:42.522648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39134acab5fe497d9fb95a5fa3c58881'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:42.559298 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 920/1842] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:41 2022] DELETE /identity/v3/users/39134acab5fe497d9fb95a5fa3c58881 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:42.600096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 923/1843] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:42 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:42.604358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:42.609103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:42.685977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e2c56-647a-4a68-960d-c626f21298dd admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:42.742648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717f3d7-17ef-4044-a1f7-60ff816abdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:42.743316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717f3d7-17ef-4044-a1f7-60ff816abdf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:42.743601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717f3d7-17ef-4044-a1f7-60ff816abdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:42.744059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717f3d7-17ef-4044-a1f7-60ff816abdf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:42.744747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717f3d7-17ef-4044-a1f7-60ff816abdf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:42.746870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3717f3d7-17ef-4044-a1f7-60ff816abdf8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:42.828497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad715f2f-007b-4bed-bc3e-fef5ab95d20c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:42.830744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ad715f2f-007b-4bed-bc3e-fef5ab95d20c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:42.853846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad715f2f-007b-4bed-bc3e-fef5ab95d20c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:42.861693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:42.866365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:42.866365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:42.866365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] PATH_INFO: `/v3/projects/d68621d354d74ae38f900294a317de84` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:42.866365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d68621d354d74ae38f900294a317de84)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:42.867943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:42.882777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 921/1844] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:42 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:42.888203 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717f3d7-17ef-4044-a1f7-60ff816abdf8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:42.900435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717f3d7-17ef-4044-a1f7-60ff816abdf8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:42.908099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69669610-850a-4945-9b40-d98168add838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:42.908775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69669610-850a-4945-9b40-d98168add838 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:42.909096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69669610-850a-4945-9b40-d98168add838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:42.909361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69669610-850a-4945-9b40-d98168add838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:42.910096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69669610-850a-4945-9b40-d98168add838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:42.911870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69669610-850a-4945-9b40-d98168add838 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:42.923329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 922/1845] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:42.927505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69669610-850a-4945-9b40-d98168add838 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:42.938350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69669610-850a-4945-9b40-d98168add838 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:42.943362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5595ac-313a-4233-9a6b-40707920fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:42.944025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5595ac-313a-4233-9a6b-40707920fe56 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:42.944311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5595ac-313a-4233-9a6b-40707920fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:42.944586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5595ac-313a-4233-9a6b-40707920fe56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:42.945357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5595ac-313a-4233-9a6b-40707920fe56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:42.947121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5595ac-313a-4233-9a6b-40707920fe56 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:42.962650 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 923/1846] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:42.963396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5595ac-313a-4233-9a6b-40707920fe56 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:42.974017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5595ac-313a-4233-9a6b-40707920fe56 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:42.978598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a5c8f-2ea9-4566-8686-de603e10360d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:42.979497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a5c8f-2ea9-4566-8686-de603e10360d admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:42.979830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a5c8f-2ea9-4566-8686-de603e10360d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:42.980106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a5c8f-2ea9-4566-8686-de603e10360d admin admin] PATH_INFO: `/v3/projects/0594805ed08741cb93909af02d5cd657/users/d4d8fa710bf64036aed7f5becd8c34c4/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:42.996524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a5c8f-2ea9-4566-8686-de603e10360d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0594805ed08741cb93909af02d5cd657, user_id=d4d8fa710bf64036aed7f5becd8c34c4, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:43.004891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a5c8f-2ea9-4566-8686-de603e10360d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:43.044181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68621d354d74ae38f900294a317de84', 'request_id': 'req-902ddfce-0973-40ff-ab64-43041b193c4e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.108117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 924/1847] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:42 2022] PUT /identity/v3/projects/0594805ed08741cb93909af02d5cd657/users/d4d8fa710bf64036aed7f5becd8c34c4/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:43.118992 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c26cf4-4e8e-449a-be7d-d796919feac9 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:43.119361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c26cf4-4e8e-449a-be7d-d796919feac9 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:43.119705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c26cf4-4e8e-449a-be7d-d796919feac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:43.136401 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68621d354d74ae38f900294a317de84', 'request_id': 'req-902ddfce-0973-40ff-ab64-43041b193c4e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.150133 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68621d354d74ae38f900294a317de84', 'request_id': 'req-902ddfce-0973-40ff-ab64-43041b193c4e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.165187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] The token cache is being invalidate because project d68621d354d74ae38f900294a317de84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:43.173123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.173123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.173123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 924/1848] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:42 2022] DELETE /identity/v3/projects/d68621d354d74ae38f900294a317de84 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:43.177766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:43.179509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:43.183454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-f7c26cf4-4e8e-449a-be7d-d796919feac9 None None] MFA Rules not processed for user `d4d8fa710bf64036aed7f5becd8c34c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:43.184741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f7c26cf4-4e8e-449a-be7d-d796919feac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:43.299612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ddfce-0973-40ff-ab64-43041b193c4e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:43.310244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 925/1849] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:43.310244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c26cf4-4e8e-449a-be7d-d796919feac9 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:43.312071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f7c26cf4-4e8e-449a-be7d-d796919feac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:43.367152 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78546900-273d-4fa6-bd85-0a851cac3eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:43.368069 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78546900-273d-4fa6-bd85-0a851cac3eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:43.368376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78546900-273d-4fa6-bd85-0a851cac3eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:43.368642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78546900-273d-4fa6-bd85-0a851cac3eeb admin admin] PATH_INFO: `/v3/users/a9d117e2a4844f03a2328049e69217cf` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:43.369914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78546900-273d-4fa6-bd85-0a851cac3eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9d117e2a4844f03a2328049e69217cf)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:43.372502 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78546900-273d-4fa6-bd85-0a851cac3eeb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:43.392548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c26cf4-4e8e-449a-be7d-d796919feac9 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:43.400045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:43.400962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:43.401247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:43.402619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] PATH_INFO: `/v3/projects/3e93da8efc424e48b5c7c2dd880f2767` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:43.403913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e93da8efc424e48b5c7c2dd880f2767)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:43.405991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:43.638783 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-78546900-273d-4fa6-bd85-0a851cac3eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9d117e2a4844f03a2328049e69217cf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.646907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e93da8efc424e48b5c7c2dd880f2767', 'request_id': 'req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.652147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-78546900-273d-4fa6-bd85-0a851cac3eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9d117e2a4844f03a2328049e69217cf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.729305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e93da8efc424e48b5c7c2dd880f2767', 'request_id': 'req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.737468 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e93da8efc424e48b5c7c2dd880f2767', 'request_id': 'req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.748552 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] The token cache is being invalidate because project 3e93da8efc424e48b5c7c2dd880f2767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:43.748878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.749529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.751081 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 926/1850] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:43 2022] DELETE /identity/v3/projects/3e93da8efc424e48b5c7c2dd880f2767 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:43.751848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:43.753425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:43.797858 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-78546900-273d-4fa6-bd85-0a851cac3eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9d117e2a4844f03a2328049e69217cf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.798607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-78546900-273d-4fa6-bd85-0a851cac3eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9d117e2a4844f03a2328049e69217cf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.799282 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-78546900-273d-4fa6-bd85-0a851cac3eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9d117e2a4844f03a2328049e69217cf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:43.810814 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2a2cf-1a73-4d4c-8224-780725fcf4d6 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:43.813052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 925/1851] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:43 2022] DELETE /identity/v3/users/a9d117e2a4844f03a2328049e69217cf => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:43.814353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fae05-4267-47dc-b475-89f916bb33f0 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:43.814635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fae05-4267-47dc-b475-89f916bb33f0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:43.814918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17fae05-4267-47dc-b475-89f916bb33f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:43.817706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd85b4-28d1-4dbd-ada3-ba7a429d46fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6832291d504cff9e787c0d791c70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:43.818386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd85b4-28d1-4dbd-ada3-ba7a429d46fa service glance] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:43.818674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd85b4-28d1-4dbd-ada3-ba7a429d46fa service glance] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:43.818953 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd85b4-28d1-4dbd-ada3-ba7a429d46fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:43.820864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0bcd85b4-28d1-4dbd-ada3-ba7a429d46fa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:43.834750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d17fae05-4267-47dc-b475-89f916bb33f0 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:43.836036 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d17fae05-4267-47dc-b475-89f916bb33f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:43.891128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd85b4-28d1-4dbd-ada3-ba7a429d46fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:43.892851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd85b4-28d1-4dbd-ada3-ba7a429d46fa service glance] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:43.903955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 927/1852] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:43.908169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 926/1853] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:43.917103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ba41d-36fa-4666-aac6-71cb784920db None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:43.917486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ba41d-36fa-4666-aac6-71cb784920db None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:43.917849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ba41d-36fa-4666-aac6-71cb784920db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:43.937722 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-787ba41d-36fa-4666-aac6-71cb784920db None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:43.938931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-787ba41d-36fa-4666-aac6-71cb784920db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:43.947093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 928/1854] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:43.951906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fae05-4267-47dc-b475-89f916bb33f0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:43.962695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17fae05-4267-47dc-b475-89f916bb33f0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:43.967183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33502d0-6b30-43fc-8ef4-69f535b8d81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:43.967876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33502d0-6b30-43fc-8ef4-69f535b8d81d admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:43.968142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33502d0-6b30-43fc-8ef4-69f535b8d81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:43.968424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33502d0-6b30-43fc-8ef4-69f535b8d81d admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:43.969200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33502d0-6b30-43fc-8ef4-69f535b8d81d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:43.969513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33502d0-6b30-43fc-8ef4-69f535b8d81d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:43.971121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33502d0-6b30-43fc-8ef4-69f535b8d81d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:43.989076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 927/1855] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:43.992204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ba41d-36fa-4666-aac6-71cb784920db None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:44.001040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ba41d-36fa-4666-aac6-71cb784920db None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:44.006265 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044acef-5365-4e92-82ab-8822e9b01930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:44.006950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044acef-5365-4e92-82ab-8822e9b01930 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:44.007235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044acef-5365-4e92-82ab-8822e9b01930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:44.007523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c044acef-5365-4e92-82ab-8822e9b01930 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:44.008199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044acef-5365-4e92-82ab-8822e9b01930 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:44.010337 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c044acef-5365-4e92-82ab-8822e9b01930 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:44.115132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 929/1856] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:43 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:44.116211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33502d0-6b30-43fc-8ef4-69f535b8d81d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:44.130402 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33502d0-6b30-43fc-8ef4-69f535b8d81d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:44.212757 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:44.243919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10452a-224d-48b7-9792-7bc360612437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:44.244503 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10452a-224d-48b7-9792-7bc360612437 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:44.245809 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10452a-224d-48b7-9792-7bc360612437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:44.245942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10452a-224d-48b7-9792-7bc360612437 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:44.246721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10452a-224d-48b7-9792-7bc360612437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:44.248839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10452a-224d-48b7-9792-7bc360612437 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:44.349119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 928/1857] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:44 2022] POST /identity/v3/users => generated 294 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:44.350562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044acef-5365-4e92-82ab-8822e9b01930 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:44.355554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10452a-224d-48b7-9792-7bc360612437 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:44.364860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2f10452a-224d-48b7-9792-7bc360612437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:44.370954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c044acef-5365-4e92-82ab-8822e9b01930 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:44.387794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8008ef8-e7d9-47ed-b55a-ad989cbafc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:44.392178 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10452a-224d-48b7-9792-7bc360612437 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:44.404009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:44.404009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:44.404009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:44.404009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97 admin admin] PATH_INFO: `/v3/projects/e938b3c8d71349debca6f74efd9232fc` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:44.404359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8008ef8-e7d9-47ed-b55a-ad989cbafc72 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:44.404586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8008ef8-e7d9-47ed-b55a-ad989cbafc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:44.404965 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8008ef8-e7d9-47ed-b55a-ad989cbafc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:44.406448 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e938b3c8d71349debca6f74efd9232fc)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:44.406806 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8008ef8-e7d9-47ed-b55a-ad989cbafc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:44.408504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:44.408626 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8008ef8-e7d9-47ed-b55a-ad989cbafc72 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:44.424860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 930/1858] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:44.428270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8008ef8-e7d9-47ed-b55a-ad989cbafc72 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:44.439910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8008ef8-e7d9-47ed-b55a-ad989cbafc72 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:44.444983 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf210db-e1d0-4b65-b862-92ab6e4b0784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:44.445652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf210db-e1d0-4b65-b862-92ab6e4b0784 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:44.445937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf210db-e1d0-4b65-b862-92ab6e4b0784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:44.446214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf210db-e1d0-4b65-b862-92ab6e4b0784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:44.447131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf210db-e1d0-4b65-b862-92ab6e4b0784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:44.448883 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf210db-e1d0-4b65-b862-92ab6e4b0784 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:44.459912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 931/1859] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:12:44.464157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf210db-e1d0-4b65-b862-92ab6e4b0784 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:44.474320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf210db-e1d0-4b65-b862-92ab6e4b0784 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:44.479155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811a238-cedd-4fb3-a9d1-0c9de0da8480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:44.480582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811a238-cedd-4fb3-a9d1-0c9de0da8480 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:44.480962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811a238-cedd-4fb3-a9d1-0c9de0da8480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:44.481426 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811a238-cedd-4fb3-a9d1-0c9de0da8480 admin admin] PATH_INFO: `/v3/projects/c2597a0d94b942f6b191fa45615274bf/users/faa3f0b8dd8c4a5c91960399150dfdeb/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:44.496524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811a238-cedd-4fb3-a9d1-0c9de0da8480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2597a0d94b942f6b191fa45615274bf, user_id=faa3f0b8dd8c4a5c91960399150dfdeb, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:44.499257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811a238-cedd-4fb3-a9d1-0c9de0da8480 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:44.572332 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 932/1860] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:44 2022] PUT /identity/v3/projects/c2597a0d94b942f6b191fa45615274bf/users/faa3f0b8dd8c4a5c91960399150dfdeb/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:44.582876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e938b3c8d71349debca6f74efd9232fc', 'request_id': 'req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:44.592918 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb134339-55d2-4124-abe3-9963fc539fd7 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:44.593221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb134339-55d2-4124-abe3-9963fc539fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:44.593502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb134339-55d2-4124-abe3-9963fc539fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:44.638498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-fb134339-55d2-4124-abe3-9963fc539fd7 None None] MFA Rules not processed for user `faa3f0b8dd8c4a5c91960399150dfdeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:44.640186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fb134339-55d2-4124-abe3-9963fc539fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:44.657531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:44.664058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e938b3c8d71349debca6f74efd9232fc', 'request_id': 'req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:44.677865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e938b3c8d71349debca6f74efd9232fc', 'request_id': 'req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:44.701507 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97 admin admin] The token cache is being invalidate because project e938b3c8d71349debca6f74efd9232fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:44.708072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:44.708072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3fa12cb2-b80f-4ae8-bdcc-6578461e4c97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:44.708072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 929/1861] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:44 2022] DELETE /identity/v3/projects/e938b3c8d71349debca6f74efd9232fc => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:44.712056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67eebb-6221-43df-8a7b-844706a60701 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:44.712466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67eebb-6221-43df-8a7b-844706a60701 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:44.712745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67eebb-6221-43df-8a7b-844706a60701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:44.750501 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6c67eebb-6221-43df-8a7b-844706a60701 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:44.750501 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6c67eebb-6221-43df-8a7b-844706a60701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:44.771068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 933/1862] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:44.777614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb134339-55d2-4124-abe3-9963fc539fd7 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:44.782518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fb134339-55d2-4124-abe3-9963fc539fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:44.829066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 930/1863] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:44.839316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549f87-3256-490a-8c46-8203417dd69c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:44.839995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549f87-3256-490a-8c46-8203417dd69c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:44.842891 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3549f87-3256-490a-8c46-8203417dd69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:44.864338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb134339-55d2-4124-abe3-9963fc539fd7 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:44.866194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f3549f87-3256-490a-8c46-8203417dd69c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:44.866941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f3549f87-3256-490a-8c46-8203417dd69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:44.870739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6202b8-d946-42d7-989c-0eed314b18e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:44.871507 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6202b8-d946-42d7-989c-0eed314b18e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:44.871822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6202b8-d946-42d7-989c-0eed314b18e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:44.872098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6202b8-d946-42d7-989c-0eed314b18e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:44.873465 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6202b8-d946-42d7-989c-0eed314b18e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:44.875786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6202b8-d946-42d7-989c-0eed314b18e5 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:44.882285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 931/1864] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:44.883700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3549f87-3256-490a-8c46-8203417dd69c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:44.893414 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3549f87-3256-490a-8c46-8203417dd69c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:44.898978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e249ee-0c86-457f-ac81-6acf6d36fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:44.900406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e249ee-0c86-457f-ac81-6acf6d36fddc admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:44.900406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e249ee-0c86-457f-ac81-6acf6d36fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:44.900406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e249ee-0c86-457f-ac81-6acf6d36fddc admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:44.901160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e249ee-0c86-457f-ac81-6acf6d36fddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:44.902004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e249ee-0c86-457f-ac81-6acf6d36fddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:44.903726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e249ee-0c86-457f-ac81-6acf6d36fddc admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:44.916030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 932/1865] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:12:44.922527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e249ee-0c86-457f-ac81-6acf6d36fddc admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:44.932876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e249ee-0c86-457f-ac81-6acf6d36fddc admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:44.937985 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5f639-021e-4196-b655-cb905e22e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:44.938656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5f639-021e-4196-b655-cb905e22e549 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:44.938946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5f639-021e-4196-b655-cb905e22e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:44.939254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5f639-021e-4196-b655-cb905e22e549 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:44.939957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5f639-021e-4196-b655-cb905e22e549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:44.941926 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5f639-021e-4196-b655-cb905e22e549 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:45.001770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 934/1866] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:44 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:45.005691 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6202b8-d946-42d7-989c-0eed314b18e5 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:45.071170 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6202b8-d946-42d7-989c-0eed314b18e5 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:45.076450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d2906-aa32-42cb-b926-cab694256f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:45.078861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d2906-aa32-42cb-b926-cab694256f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.078861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d2906-aa32-42cb-b926-cab694256f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.078861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d2906-aa32-42cb-b926-cab694256f66 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.078861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d2906-aa32-42cb-b926-cab694256f66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:45.081237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d2906-aa32-42cb-b926-cab694256f66 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:45.105365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 933/1867] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:44 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:45.116288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5f639-021e-4196-b655-cb905e22e549 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:45.179077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5f639-021e-4196-b655-cb905e22e549 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:45.184242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172fc59-ec50-4559-a2a5-ede1ec1ea380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:45.185047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172fc59-ec50-4559-a2a5-ede1ec1ea380 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.185417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172fc59-ec50-4559-a2a5-ede1ec1ea380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.185800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172fc59-ec50-4559-a2a5-ede1ec1ea380 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.186569 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172fc59-ec50-4559-a2a5-ede1ec1ea380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:45.188548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6172fc59-ec50-4559-a2a5-ede1ec1ea380 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:45.193314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 935/1868] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:45 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:45.197657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d2906-aa32-42cb-b926-cab694256f66 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:45.208396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d2906-aa32-42cb-b926-cab694256f66 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:45.213382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff13e7-6e9c-4349-abe4-6735c33e06b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:45.214666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff13e7-6e9c-4349-abe4-6735c33e06b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.214955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff13e7-6e9c-4349-abe4-6735c33e06b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.215233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff13e7-6e9c-4349-abe4-6735c33e06b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.215984 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff13e7-6e9c-4349-abe4-6735c33e06b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:45.217775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff13e7-6e9c-4349-abe4-6735c33e06b0 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:45.227920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 936/1869] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:12:45.231884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff13e7-6e9c-4349-abe4-6735c33e06b0 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:45.241579 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff13e7-6e9c-4349-abe4-6735c33e06b0 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:45.246489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a390c-8b32-43e7-b43f-9bf6dcd0daa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:45.247331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a390c-8b32-43e7-b43f-9bf6dcd0daa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.247617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a390c-8b32-43e7-b43f-9bf6dcd0daa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.247898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a390c-8b32-43e7-b43f-9bf6dcd0daa4 admin admin] PATH_INFO: `/v3/projects/a48f99c2d0404910b98868466a77065a/users/0bb2a3f68bdb406880853f03129699ca/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.263395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a390c-8b32-43e7-b43f-9bf6dcd0daa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48f99c2d0404910b98868466a77065a, user_id=0bb2a3f68bdb406880853f03129699ca, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:45.266117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a390c-8b32-43e7-b43f-9bf6dcd0daa4 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:45.275201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 934/1870] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:45 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:45.279453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172fc59-ec50-4559-a2a5-ede1ec1ea380 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:45.289177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172fc59-ec50-4559-a2a5-ede1ec1ea380 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:45.294447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b16d9-fe32-4b00-ad69-8562b4b4e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:45.295100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b16d9-fe32-4b00-ad69-8562b4b4e05f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.295392 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b16d9-fe32-4b00-ad69-8562b4b4e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.295672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b16d9-fe32-4b00-ad69-8562b4b4e05f admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.296401 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b16d9-fe32-4b00-ad69-8562b4b4e05f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:45.298028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52b16d9-fe32-4b00-ad69-8562b4b4e05f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:45.308588 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 935/1871] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:12:45.312573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b16d9-fe32-4b00-ad69-8562b4b4e05f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:45.322056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52b16d9-fe32-4b00-ad69-8562b4b4e05f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:45.326728 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6071e91-5863-4ca1-9dc5-c14e2a5dc88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:45.327365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6071e91-5863-4ca1-9dc5-c14e2a5dc88b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.331278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6071e91-5863-4ca1-9dc5-c14e2a5dc88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.331278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6071e91-5863-4ca1-9dc5-c14e2a5dc88b admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.331278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6071e91-5863-4ca1-9dc5-c14e2a5dc88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:45.331278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6071e91-5863-4ca1-9dc5-c14e2a5dc88b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:45.340210 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 936/1872] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:12:45.344070 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6071e91-5863-4ca1-9dc5-c14e2a5dc88b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:45.350405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:45.356768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6071e91-5863-4ca1-9dc5-c14e2a5dc88b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:45.361111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599be165-835d-463d-a604-e8079ed446f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:45.361981 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599be165-835d-463d-a604-e8079ed446f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.362318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599be165-835d-463d-a604-e8079ed446f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.362548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599be165-835d-463d-a604-e8079ed446f1 admin admin] PATH_INFO: `/v3/projects/a928fca22b724ea9927900462a91643c/users/977dd71fdcb248cd8050099425eb0a38/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.378791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599be165-835d-463d-a604-e8079ed446f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a928fca22b724ea9927900462a91643c, user_id=977dd71fdcb248cd8050099425eb0a38, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:45.381016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599be165-835d-463d-a604-e8079ed446f1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:45.384909 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 937/1873] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:45 2022] PUT /identity/v3/projects/a48f99c2d0404910b98868466a77065a/users/0bb2a3f68bdb406880853f03129699ca/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:45.387540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a390c-8b32-43e7-b43f-9bf6dcd0daa4 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:45.453865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a390c-8b32-43e7-b43f-9bf6dcd0daa4 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:45.458605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87acd9-7b96-43b6-b8b5-e7dc0cb0be3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:45.459278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87acd9-7b96-43b6-b8b5-e7dc0cb0be3d admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.459568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87acd9-7b96-43b6-b8b5-e7dc0cb0be3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.459847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87acd9-7b96-43b6-b8b5-e7dc0cb0be3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.460586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87acd9-7b96-43b6-b8b5-e7dc0cb0be3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:45.462231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87acd9-7b96-43b6-b8b5-e7dc0cb0be3d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:45.476737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 938/1874] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:45.481161 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87acd9-7b96-43b6-b8b5-e7dc0cb0be3d admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:45.486393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 937/1875] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:45 2022] PUT /identity/v3/projects/a928fca22b724ea9927900462a91643c/users/977dd71fdcb248cd8050099425eb0a38/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:45.492098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87acd9-7b96-43b6-b8b5-e7dc0cb0be3d admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:45.503358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c180c-a502-480e-8ba3-56e872490a01 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.503910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c180c-a502-480e-8ba3-56e872490a01 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.504487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c180c-a502-480e-8ba3-56e872490a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.559072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f23c180c-a502-480e-8ba3-56e872490a01 None None] MFA Rules not processed for user `977dd71fdcb248cd8050099425eb0a38`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:45.561082 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f23c180c-a502-480e-8ba3-56e872490a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:45.573649 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f66486-af3c-4ac9-b906-ae5397cf113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:45.575313 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f66486-af3c-4ac9-b906-ae5397cf113a admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.575676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f66486-af3c-4ac9-b906-ae5397cf113a admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.576252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f66486-af3c-4ac9-b906-ae5397cf113a admin admin] PATH_INFO: `/v3/projects/a48f99c2d0404910b98868466a77065a/users/0bb2a3f68bdb406880853f03129699ca/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.578596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f66486-af3c-4ac9-b906-ae5397cf113a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48f99c2d0404910b98868466a77065a, user_id=0bb2a3f68bdb406880853f03129699ca, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:45.582603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f66486-af3c-4ac9-b906-ae5397cf113a admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:45.597094 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 939/1876] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:45 2022] PUT /identity/v3/projects/a48f99c2d0404910b98868466a77065a/users/0bb2a3f68bdb406880853f03129699ca/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:45.609077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea75c-c587-41d2-aaeb-b5e5523fca78 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.609607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea75c-c587-41d2-aaeb-b5e5523fca78 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.610036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdea75c-c587-41d2-aaeb-b5e5523fca78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.639591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-9cdea75c-c587-41d2-aaeb-b5e5523fca78 None None] MFA Rules not processed for user `0bb2a3f68bdb406880853f03129699ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:45.640835 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9cdea75c-c587-41d2-aaeb-b5e5523fca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:45.645541 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 938/1877] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:45.647072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c180c-a502-480e-8ba3-56e872490a01 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:45.659906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c180c-a502-480e-8ba3-56e872490a01 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:45.714358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 940/1878] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:45.722209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768e37d-9e09-4b1b-8e8f-aa5b15e259c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:45.722926 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768e37d-9e09-4b1b-8e8f-aa5b15e259c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.723553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768e37d-9e09-4b1b-8e8f-aa5b15e259c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.723841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768e37d-9e09-4b1b-8e8f-aa5b15e259c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.724609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768e37d-9e09-4b1b-8e8f-aa5b15e259c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:45.725612 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdea75c-c587-41d2-aaeb-b5e5523fca78 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:45.726540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0768e37d-9e09-4b1b-8e8f-aa5b15e259c6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:45.727063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9cdea75c-c587-41d2-aaeb-b5e5523fca78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:45.793394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdea75c-c587-41d2-aaeb-b5e5523fca78 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:45.797219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a02fd-f38e-4173-99d1-9171c4e2b997 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:45.797968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a02fd-f38e-4173-99d1-9171c4e2b997 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:45.798216 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a02fd-f38e-4173-99d1-9171c4e2b997 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:45.798682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a02fd-f38e-4173-99d1-9171c4e2b997 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:45.809204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a02fd-f38e-4173-99d1-9171c4e2b997 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:45.810662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a02fd-f38e-4173-99d1-9171c4e2b997 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:45.823572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 941/1879] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:45.915762 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 939/1880] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:45 2022] POST /identity/v3/projects => generated 381 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:45.920418 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a02fd-f38e-4173-99d1-9171c4e2b997 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:45.937959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a02fd-f38e-4173-99d1-9171c4e2b997 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:46.143721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40549676-b5ad-4a5b-9861-61e0432e2cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:46.145654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40549676-b5ad-4a5b-9861-61e0432e2cff admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:46.145826 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40549676-b5ad-4a5b-9861-61e0432e2cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:46.146186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40549676-b5ad-4a5b-9861-61e0432e2cff admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:46.147057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40549676-b5ad-4a5b-9861-61e0432e2cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:46.149981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40549676-b5ad-4a5b-9861-61e0432e2cff admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:46.634017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 942/1881] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:45 2022] POST /identity/v3/users => generated 297 bytes in 714 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:46.639111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768e37d-9e09-4b1b-8e8f-aa5b15e259c6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:46.661915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0768e37d-9e09-4b1b-8e8f-aa5b15e259c6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:46.672927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab018c-b93b-49a3-b1fb-2b707769650a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:46.673723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab018c-b93b-49a3-b1fb-2b707769650a admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:46.674070 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab018c-b93b-49a3-b1fb-2b707769650a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:46.674407 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab018c-b93b-49a3-b1fb-2b707769650a admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:46.675253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab018c-b93b-49a3-b1fb-2b707769650a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:46.681061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab018c-b93b-49a3-b1fb-2b707769650a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:46.695742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 940/1882] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:46.700345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40549676-b5ad-4a5b-9861-61e0432e2cff admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:46.718796 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40549676-b5ad-4a5b-9861-61e0432e2cff admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:46.724290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d42c05-b055-471b-876e-9d1b40de4464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:46.725417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d42c05-b055-471b-876e-9d1b40de4464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:46.725769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d42c05-b055-471b-876e-9d1b40de4464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:46.726192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d42c05-b055-471b-876e-9d1b40de4464 admin admin] PATH_INFO: `/v3/projects/2d48127225b7444cb4fd5fd00d1151ad/users/08c45704a42c42df9985a7aeca5c096d/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:46.779017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d42c05-b055-471b-876e-9d1b40de4464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d48127225b7444cb4fd5fd00d1151ad, user_id=08c45704a42c42df9985a7aeca5c096d, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:46.782383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d42c05-b055-471b-876e-9d1b40de4464 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:46.933902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 943/1883] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:46 2022] PUT /identity/v3/projects/2d48127225b7444cb4fd5fd00d1151ad/users/08c45704a42c42df9985a7aeca5c096d/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:46.935214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab018c-b93b-49a3-b1fb-2b707769650a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:46.947842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab018c-b93b-49a3-b1fb-2b707769650a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:47.028432 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfdf10-683e-4d18-aa02-5f82d7bb5445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:47.029657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfdf10-683e-4d18-aa02-5f82d7bb5445 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.029657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfdf10-683e-4d18-aa02-5f82d7bb5445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.029849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfdf10-683e-4d18-aa02-5f82d7bb5445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.030545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfdf10-683e-4d18-aa02-5f82d7bb5445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:47.032219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfdf10-683e-4d18-aa02-5f82d7bb5445 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:47.043408 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 941/1884] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:47.047610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d42c05-b055-471b-876e-9d1b40de4464 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:47.060283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d42c05-b055-471b-876e-9d1b40de4464 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:47.068197 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a626f0-f518-41ff-9354-680a0194f664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:47.069163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a626f0-f518-41ff-9354-680a0194f664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.069429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a626f0-f518-41ff-9354-680a0194f664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.069704 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a626f0-f518-41ff-9354-680a0194f664 admin admin] PATH_INFO: `/v3/projects/2d48127225b7444cb4fd5fd00d1151ad/users/08c45704a42c42df9985a7aeca5c096d/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.071817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a626f0-f518-41ff-9354-680a0194f664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d48127225b7444cb4fd5fd00d1151ad, user_id=08c45704a42c42df9985a7aeca5c096d, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:47.074869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a626f0-f518-41ff-9354-680a0194f664 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:47.097001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 944/1885] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:47 2022] PUT /identity/v3/projects/2d48127225b7444cb4fd5fd00d1151ad/users/08c45704a42c42df9985a7aeca5c096d/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:47.098529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df619df4-b34c-4c68-8ad3-eb6e5c126eb5 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.098824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df619df4-b34c-4c68-8ad3-eb6e5c126eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.099104 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df619df4-b34c-4c68-8ad3-eb6e5c126eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.132771 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-df619df4-b34c-4c68-8ad3-eb6e5c126eb5 None None] MFA Rules not processed for user `08c45704a42c42df9985a7aeca5c096d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:47.134289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-df619df4-b34c-4c68-8ad3-eb6e5c126eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:47.313310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 942/1886] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:47.320860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:47.328755 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a626f0-f518-41ff-9354-680a0194f664 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:47.330807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-26a626f0-f518-41ff-9354-680a0194f664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:47.423565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a626f0-f518-41ff-9354-680a0194f664 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:47.431815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09dc32-4254-4200-aa1d-dcec52f855e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:47.432773 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09dc32-4254-4200-aa1d-dcec52f855e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.433093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09dc32-4254-4200-aa1d-dcec52f855e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.433381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09dc32-4254-4200-aa1d-dcec52f855e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.453265 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09dc32-4254-4200-aa1d-dcec52f855e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:47.455695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09dc32-4254-4200-aa1d-dcec52f855e0 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:47.474839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 945/1887] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:47.602465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df619df4-b34c-4c68-8ad3-eb6e5c126eb5 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:47.612589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df619df4-b34c-4c68-8ad3-eb6e5c126eb5 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:47.616439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acae1e-58fc-43c8-b446-4525d9d3450a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:47.617124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acae1e-58fc-43c8-b446-4525d9d3450a service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.617418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acae1e-58fc-43c8-b446-4525d9d3450a service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.617702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acae1e-58fc-43c8-b446-4525d9d3450a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.681900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acae1e-58fc-43c8-b446-4525d9d3450a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:47.684177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acae1e-58fc-43c8-b446-4525d9d3450a service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:47.695412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 943/1888] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:47.849165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09dc32-4254-4200-aa1d-dcec52f855e0 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:47.956072 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09dc32-4254-4200-aa1d-dcec52f855e0 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:47.962244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:47.963142 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:47.963426 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:47.963764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] PATH_INFO: `/v3/users/faa3f0b8dd8c4a5c91960399150dfdeb` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:47.965472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa3f0b8dd8c4a5c91960399150dfdeb)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:47.976031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.212912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:48.323737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa3f0b8dd8c4a5c91960399150dfdeb'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:48.360201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa3f0b8dd8c4a5c91960399150dfdeb'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:48.469554 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa3f0b8dd8c4a5c91960399150dfdeb'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:48.470983 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa3f0b8dd8c4a5c91960399150dfdeb'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:48.471997 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa3f0b8dd8c4a5c91960399150dfdeb'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:48.514230 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 946/1889] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:47 2022] DELETE /identity/v3/users/faa3f0b8dd8c4a5c91960399150dfdeb => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:48.518819 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa54a2-f765-4c49-916f-fb619cd61799 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.519245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa54a2-f765-4c49-916f-fb619cd61799 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.519245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa54a2-f765-4c49-916f-fb619cd61799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.543471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a1aa54a2-f765-4c49-916f-fb619cd61799 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:48.544745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a1aa54a2-f765-4c49-916f-fb619cd61799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.626220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:48.691708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 944/1890] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:48.703636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:48.705710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:48.796943 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a556398-6199-4612-b34e-4a6760c4dbb3 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:48.801908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ebfa82-7981-4085-89ba-e3dd57f9a766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:48.802846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebfa82-7981-4085-89ba-e3dd57f9a766 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:48.803201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebfa82-7981-4085-89ba-e3dd57f9a766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:48.803777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ebfa82-7981-4085-89ba-e3dd57f9a766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:48.837858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebfa82-7981-4085-89ba-e3dd57f9a766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:48.840710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ebfa82-7981-4085-89ba-e3dd57f9a766 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:48.853077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 947/1891] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:49.424953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa54a2-f765-4c49-916f-fb619cd61799 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.424953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a1aa54a2-f765-4c49-916f-fb619cd61799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:49.443779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa54a2-f765-4c49-916f-fb619cd61799 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.451628 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.452795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.453816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.454278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] PATH_INFO: `/v3/projects/c2597a0d94b942f6b191fa45615274bf` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.455731 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2597a0d94b942f6b191fa45615274bf)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.458756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.622245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2597a0d94b942f6b191fa45615274bf', 'request_id': 'req-d497431b-2e59-47f1-a972-2d0c46004737'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:49.634431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:49.642670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a5f94-8816-4b71-8a56-211fa8414eb3 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.643106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a5f94-8816-4b71-8a56-211fa8414eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.643444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a5f94-8816-4b71-8a56-211fa8414eb3 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.645651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 948/1892] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:12:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 13:12:49.660672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63881494-0425-4b54-9c5f-02e28b0d390c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.661264 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63881494-0425-4b54-9c5f-02e28b0d390c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.661695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63881494-0425-4b54-9c5f-02e28b0d390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.689401 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2597a0d94b942f6b191fa45615274bf', 'request_id': 'req-d497431b-2e59-47f1-a972-2d0c46004737'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:49.706672 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-63881494-0425-4b54-9c5f-02e28b0d390c None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:49.707029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2597a0d94b942f6b191fa45615274bf', 'request_id': 'req-d497431b-2e59-47f1-a972-2d0c46004737'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:49.712142 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-63881494-0425-4b54-9c5f-02e28b0d390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:49.722608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] The token cache is being invalidate because project c2597a0d94b942f6b191fa45615274bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:49.722899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:49.723702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:49.735699 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 945/1893] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:49 2022] DELETE /identity/v3/projects/c2597a0d94b942f6b191fa45615274bf => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:49.737102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.738793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:49.844501 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 949/1894] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:12:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:49.847825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497431b-2e59-47f1-a972-2d0c46004737 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.852548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.853522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.853835 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.854159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] PATH_INFO: `/v3/users/0bb2a3f68bdb406880853f03129699ca` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.855443 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb2a3f68bdb406880853f03129699ca)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.857446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.881611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63881494-0425-4b54-9c5f-02e28b0d390c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:49.883949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-63881494-0425-4b54-9c5f-02e28b0d390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:49.901900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63881494-0425-4b54-9c5f-02e28b0d390c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:49.911886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2aa448-e596-48ec-a525-6b4ed8e665ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:49.915193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2aa448-e596-48ec-a525-6b4ed8e665ae service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:49.915494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2aa448-e596-48ec-a525-6b4ed8e665ae service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:49.915831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2aa448-e596-48ec-a525-6b4ed8e665ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:49.943916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2aa448-e596-48ec-a525-6b4ed8e665ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:49.945807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2aa448-e596-48ec-a525-6b4ed8e665ae service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:49.972737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 950/1895] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:50.191093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb2a3f68bdb406880853f03129699ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:50.224111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb2a3f68bdb406880853f03129699ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:50.313683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb2a3f68bdb406880853f03129699ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:50.314387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb2a3f68bdb406880853f03129699ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:50.315058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb2a3f68bdb406880853f03129699ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:50.329574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 946/1896] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:49 2022] DELETE /identity/v3/users/0bb2a3f68bdb406880853f03129699ca => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:50.902785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2aa448-e596-48ec-a525-6b4ed8e665ae service nova] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:50.919718 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2aa448-e596-48ec-a525-6b4ed8e665ae service nova] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:50.985468 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:50.986344 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:50.986627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:50.986908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde admin admin] PATH_INFO: `/v3/projects/a48f99c2d0404910b98868466a77065a` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:50.988100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde admin admin] RBAC: Authorizing `identity:delete_project(project_id=a48f99c2d0404910b98868466a77065a)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:50.990074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.102153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a48f99c2d0404910b98868466a77065a', 'request_id': 'req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:51.163845 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.165772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.179994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bd470-4ab7-4dd6-852b-bac2b797ab1f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.191662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a48f99c2d0404910b98868466a77065a', 'request_id': 'req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:51.198988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a48f99c2d0404910b98868466a77065a', 'request_id': 'req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:51.210255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde admin admin] The token cache is being invalidate because project a48f99c2d0404910b98868466a77065a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:51.210549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:51.211259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c5889e3a-9ce3-4fb0-bda0-e80bc220fdde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:51.212977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 951/1897] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:50 2022] DELETE /identity/v3/projects/a48f99c2d0404910b98868466a77065a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:51.218148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c4fba-0a29-4270-afe1-1e506db258fb None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.218434 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c4fba-0a29-4270-afe1-1e506db258fb None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.218845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c4fba-0a29-4270-afe1-1e506db258fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.243240 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d17c4-bfbb-415b-8d42-dfcd3f095d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.244139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d17c4-bfbb-415b-8d42-dfcd3f095d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.244426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d17c4-bfbb-415b-8d42-dfcd3f095d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.244780 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d17c4-bfbb-415b-8d42-dfcd3f095d5d admin admin] PATH_INFO: `/v3/users/977dd71fdcb248cd8050099425eb0a38` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.246708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d17c4-bfbb-415b-8d42-dfcd3f095d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=977dd71fdcb248cd8050099425eb0a38)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.247613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-7d6c4fba-0a29-4270-afe1-1e506db258fb None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:51.248688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d17c4-bfbb-415b-8d42-dfcd3f095d5d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.248944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7d6c4fba-0a29-4270-afe1-1e506db258fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.261590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 952/1898] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:51.270581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d108da-7a79-4e79-826f-7858880fca2b None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.271009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d108da-7a79-4e79-826f-7858880fca2b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.271198 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d108da-7a79-4e79-826f-7858880fca2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.291337 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-23d108da-7a79-4e79-826f-7858880fca2b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:51.293296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-23d108da-7a79-4e79-826f-7858880fca2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.304994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 953/1899] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:51.313609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d108da-7a79-4e79-826f-7858880fca2b None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.324329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d108da-7a79-4e79-826f-7858880fca2b None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.329532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca1a87-e167-44a9-a9ee-d7fde92c6a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.330215 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca1a87-e167-44a9-a9ee-d7fde92c6a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.330500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca1a87-e167-44a9-a9ee-d7fde92c6a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.330778 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca1a87-e167-44a9-a9ee-d7fde92c6a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.331524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca1a87-e167-44a9-a9ee-d7fde92c6a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:51.331833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca1a87-e167-44a9-a9ee-d7fde92c6a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.333659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca1a87-e167-44a9-a9ee-d7fde92c6a3e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.346814 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 954/1900] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:51.350988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca1a87-e167-44a9-a9ee-d7fde92c6a3e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.365417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca1a87-e167-44a9-a9ee-d7fde92c6a3e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.369168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:51.373977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c23aa-812c-42c2-9f4d-a09d77762f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.374880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c23aa-812c-42c2-9f4d-a09d77762f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.384701 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c23aa-812c-42c2-9f4d-a09d77762f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.384701 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c23aa-812c-42c2-9f4d-a09d77762f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.384701 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c23aa-812c-42c2-9f4d-a09d77762f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.384701 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c23aa-812c-42c2-9f4d-a09d77762f00 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.466049 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 955/1901] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:12:51.474223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c23aa-812c-42c2-9f4d-a09d77762f00 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.483793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-104d17c4-bfbb-415b-8d42-dfcd3f095d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977dd71fdcb248cd8050099425eb0a38'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:51.500574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-104d17c4-bfbb-415b-8d42-dfcd3f095d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977dd71fdcb248cd8050099425eb0a38'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:51.558140 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c23aa-812c-42c2-9f4d-a09d77762f00 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.563915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-104d17c4-bfbb-415b-8d42-dfcd3f095d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977dd71fdcb248cd8050099425eb0a38'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:51.564270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54a0b2-b9a9-4c10-9af3-7ec0d12e09cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.565738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54a0b2-b9a9-4c10-9af3-7ec0d12e09cb admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.566103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54a0b2-b9a9-4c10-9af3-7ec0d12e09cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.566496 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54a0b2-b9a9-4c10-9af3-7ec0d12e09cb admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.567633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54a0b2-b9a9-4c10-9af3-7ec0d12e09cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.569344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-104d17c4-bfbb-415b-8d42-dfcd3f095d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977dd71fdcb248cd8050099425eb0a38'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:51.569619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f54a0b2-b9a9-4c10-9af3-7ec0d12e09cb admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.570395 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-104d17c4-bfbb-415b-8d42-dfcd3f095d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977dd71fdcb248cd8050099425eb0a38'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:51.591818 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 947/1902] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:51 2022] DELETE /identity/v3/users/977dd71fdcb248cd8050099425eb0a38 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:51.598118 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9d61a-89f6-4ae2-a747-b2b8ab47563d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.602083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9d61a-89f6-4ae2-a747-b2b8ab47563d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.602083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9d61a-89f6-4ae2-a747-b2b8ab47563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.624362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-15c9d61a-89f6-4ae2-a747-b2b8ab47563d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:51.628570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-15c9d61a-89f6-4ae2-a747-b2b8ab47563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.651447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 956/1903] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:51.665718 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54a0b2-b9a9-4c10-9af3-7ec0d12e09cb admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.668703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1f54a0b2-b9a9-4c10-9af3-7ec0d12e09cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.683881 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54a0b2-b9a9-4c10-9af3-7ec0d12e09cb admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.693964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 948/1904] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:12:51.704878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9d61a-89f6-4ae2-a747-b2b8ab47563d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.711142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-15c9d61a-89f6-4ae2-a747-b2b8ab47563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:51.775945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d296f-b0c4-44ce-a11a-a476f76dd1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.776768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d296f-b0c4-44ce-a11a-a476f76dd1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.777257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d296f-b0c4-44ce-a11a-a476f76dd1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.778582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d296f-b0c4-44ce-a11a-a476f76dd1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.779349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d296f-b0c4-44ce-a11a-a476f76dd1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.782973 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d296f-b0c4-44ce-a11a-a476f76dd1c3 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.785608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9d61a-89f6-4ae2-a747-b2b8ab47563d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.792468 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f145f-21c9-4f98-887f-912d46c40413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.793229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f145f-21c9-4f98-887f-912d46c40413 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.794647 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f145f-21c9-4f98-887f-912d46c40413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.794647 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f145f-21c9-4f98-887f-912d46c40413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.804891 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f145f-21c9-4f98-887f-912d46c40413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.805800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f145f-21c9-4f98-887f-912d46c40413 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.809666 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 957/1905] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:51.811482 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d296f-b0c4-44ce-a11a-a476f76dd1c3 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.819527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 949/1906] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:51.865284 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d296f-b0c4-44ce-a11a-a476f76dd1c3 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.865376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:51.865458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de153975-6b4e-4837-b697-407d883db633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.865458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153975-6b4e-4837-b697-407d883db633 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.865458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153975-6b4e-4837-b697-407d883db633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.865458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de153975-6b4e-4837-b697-407d883db633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.865710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de153975-6b4e-4837-b697-407d883db633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.865710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de153975-6b4e-4837-b697-407d883db633 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:51.888192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 958/1907] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:12:51.893397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f145f-21c9-4f98-887f-912d46c40413 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:51.911710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f145f-21c9-4f98-887f-912d46c40413 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:51.927732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e66f6d-f0fb-4fbf-afe8-2e77801421d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:51.929847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e66f6d-f0fb-4fbf-afe8-2e77801421d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:51.930126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e66f6d-f0fb-4fbf-afe8-2e77801421d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:51.934638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e66f6d-f0fb-4fbf-afe8-2e77801421d8 admin admin] PATH_INFO: `/v3/projects/acba0213ae8544bf926c7cef3a697e13/users/3c53626e98264af8badbb2ed3fc931df/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:51.970393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e66f6d-f0fb-4fbf-afe8-2e77801421d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acba0213ae8544bf926c7cef3a697e13, user_id=3c53626e98264af8badbb2ed3fc931df, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:51.973073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e66f6d-f0fb-4fbf-afe8-2e77801421d8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:52.137912 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 950/1908] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:51 2022] PUT /identity/v3/projects/acba0213ae8544bf926c7cef3a697e13/users/3c53626e98264af8badbb2ed3fc931df/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:52.144101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650814b-41c5-4386-8903-6048c4bc4b83 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.145082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650814b-41c5-4386-8903-6048c4bc4b83 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.145082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650814b-41c5-4386-8903-6048c4bc4b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.187582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-b650814b-41c5-4386-8903-6048c4bc4b83 None None] MFA Rules not processed for user `3c53626e98264af8badbb2ed3fc931df`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:52.189114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b650814b-41c5-4386-8903-6048c4bc4b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:52.272104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 959/1909] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:52.278098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e66f6d-f0fb-4fbf-afe8-2e77801421d8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:52.343593 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e66f6d-f0fb-4fbf-afe8-2e77801421d8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:52.348439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade2210-3c3a-47e6-b2fa-0dc0538ef44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:52.349160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2210-3c3a-47e6-b2fa-0dc0538ef44f admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.349617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2210-3c3a-47e6-b2fa-0dc0538ef44f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.350059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade2210-3c3a-47e6-b2fa-0dc0538ef44f admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.350782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade2210-3c3a-47e6-b2fa-0dc0538ef44f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:52.352822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade2210-3c3a-47e6-b2fa-0dc0538ef44f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:52.486381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 951/1910] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:52 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:52.487355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650814b-41c5-4386-8903-6048c4bc4b83 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:52.499490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650814b-41c5-4386-8903-6048c4bc4b83 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:52.587858 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade2210-3c3a-47e6-b2fa-0dc0538ef44f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:52.588201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c6a11-713e-44db-bc0d-d5ed8a12756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:52.591042 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c6a11-713e-44db-bc0d-d5ed8a12756f admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.591342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c6a11-713e-44db-bc0d-d5ed8a12756f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.591673 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c6a11-713e-44db-bc0d-d5ed8a12756f admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.592194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bade2210-3c3a-47e6-b2fa-0dc0538ef44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:52.592761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c6a11-713e-44db-bc0d-d5ed8a12756f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:52.597620 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c6a11-713e-44db-bc0d-d5ed8a12756f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:52.611750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade2210-3c3a-47e6-b2fa-0dc0538ef44f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:52.622700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:52.623311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.623598 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.623882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] PATH_INFO: `/v3/projects/a928fca22b724ea9927900462a91643c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.632433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a928fca22b724ea9927900462a91643c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:52.634627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:52.756869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 960/1911] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:52 2022] POST /identity/v3/users => generated 299 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:52.767596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c6a11-713e-44db-bc0d-d5ed8a12756f admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:52.779072 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c6a11-713e-44db-bc0d-d5ed8a12756f admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:52.785135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ddcd9-79cd-4521-9a58-d7a8f970444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:52.785728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ddcd9-79cd-4521-9a58-d7a8f970444d admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.785974 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ddcd9-79cd-4521-9a58-d7a8f970444d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.786267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ddcd9-79cd-4521-9a58-d7a8f970444d admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.787384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ddcd9-79cd-4521-9a58-d7a8f970444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:52.794256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ddcd9-79cd-4521-9a58-d7a8f970444d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:52.804667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 961/1912] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:12:52.811223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ddcd9-79cd-4521-9a58-d7a8f970444d admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:52.811760 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a928fca22b724ea9927900462a91643c', 'request_id': 'req-6b81f851-2191-45ca-a42f-9fc31a44646a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:52.821966 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ddcd9-79cd-4521-9a58-d7a8f970444d admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:52.884872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435a7f2-8a5a-4c88-ac92-a042cb1c3031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:52.886868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435a7f2-8a5a-4c88-ac92-a042cb1c3031 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.887147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435a7f2-8a5a-4c88-ac92-a042cb1c3031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.887420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435a7f2-8a5a-4c88-ac92-a042cb1c3031 admin admin] PATH_INFO: `/v3/projects/b6cd1ef58d7e41ff8eedd72b21ad62ab/users/fc933936c5ce4f1aa8621d2324c55b89/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.902360 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435a7f2-8a5a-4c88-ac92-a042cb1c3031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cd1ef58d7e41ff8eedd72b21ad62ab, user_id=fc933936c5ce4f1aa8621d2324c55b89, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:52.904940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435a7f2-8a5a-4c88-ac92-a042cb1c3031 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:52.914419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a928fca22b724ea9927900462a91643c', 'request_id': 'req-6b81f851-2191-45ca-a42f-9fc31a44646a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:52.925559 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a928fca22b724ea9927900462a91643c', 'request_id': 'req-6b81f851-2191-45ca-a42f-9fc31a44646a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:52.946991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] The token cache is being invalidate because project a928fca22b724ea9927900462a91643c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:52.947296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:52.949186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:52.952885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 952/1913] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:52 2022] DELETE /identity/v3/projects/a928fca22b724ea9927900462a91643c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:52.954710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:52.956892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:52.975451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81f851-2191-45ca-a42f-9fc31a44646a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:52.981226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:52.982115 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:52.982404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:52.982679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] PATH_INFO: `/v3/users/08c45704a42c42df9985a7aeca5c096d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:52.983917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c45704a42c42df9985a7aeca5c096d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:52.985909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:53.021615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 962/1914] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:52 2022] PUT /identity/v3/projects/b6cd1ef58d7e41ff8eedd72b21ad62ab/users/fc933936c5ce4f1aa8621d2324c55b89/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:53.022857 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435a7f2-8a5a-4c88-ac92-a042cb1c3031 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:53.025029 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0435a7f2-8a5a-4c88-ac92-a042cb1c3031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:53.104329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435a7f2-8a5a-4c88-ac92-a042cb1c3031 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:53.110350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75499c3-6a29-42f3-b0c1-258d4c5d45dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:53.114600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75499c3-6a29-42f3-b0c1-258d4c5d45dc admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:53.114600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75499c3-6a29-42f3-b0c1-258d4c5d45dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:53.114600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75499c3-6a29-42f3-b0c1-258d4c5d45dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:53.114600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75499c3-6a29-42f3-b0c1-258d4c5d45dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:53.115659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75499c3-6a29-42f3-b0c1-258d4c5d45dc admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:53.128090 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 963/1915] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:53.132112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75499c3-6a29-42f3-b0c1-258d4c5d45dc admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:53.142494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75499c3-6a29-42f3-b0c1-258d4c5d45dc admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:53.151364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b654b6-86de-4d7f-81b8-7b04280ff680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:53.153851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b654b6-86de-4d7f-81b8-7b04280ff680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:53.153851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b654b6-86de-4d7f-81b8-7b04280ff680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:53.153851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b654b6-86de-4d7f-81b8-7b04280ff680 admin admin] PATH_INFO: `/v3/projects/b6cd1ef58d7e41ff8eedd72b21ad62ab/users/fc933936c5ce4f1aa8621d2324c55b89/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:53.155238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b654b6-86de-4d7f-81b8-7b04280ff680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cd1ef58d7e41ff8eedd72b21ad62ab, user_id=fc933936c5ce4f1aa8621d2324c55b89, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:53.157956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b654b6-86de-4d7f-81b8-7b04280ff680 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:53.169985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 964/1916] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:53 2022] PUT /identity/v3/projects/b6cd1ef58d7e41ff8eedd72b21ad62ab/users/fc933936c5ce4f1aa8621d2324c55b89/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:53.184491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8298-89e0-4260-9f8a-9288c464cc29 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:53.184796 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8298-89e0-4260-9f8a-9288c464cc29 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:53.185105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c8298-89e0-4260-9f8a-9288c464cc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:53.216366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ec8c8298-89e0-4260-9f8a-9288c464cc29 None None] MFA Rules not processed for user `fc933936c5ce4f1aa8621d2324c55b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:53.217617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ec8c8298-89e0-4260-9f8a-9288c464cc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:53.237550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c45704a42c42df9985a7aeca5c096d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:53.251790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c45704a42c42df9985a7aeca5c096d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:53.301134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 965/1917] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:53.311786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c8298-89e0-4260-9f8a-9288c464cc29 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:53.313199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ec8c8298-89e0-4260-9f8a-9288c464cc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:53.369965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:53.371690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c45704a42c42df9985a7aeca5c096d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:53.372373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c45704a42c42df9985a7aeca5c096d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:53.373051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c45704a42c42df9985a7aeca5c096d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:53.373372 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c8298-89e0-4260-9f8a-9288c464cc29 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:53.377067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6db0dc-0ca3-4172-87e4-5612773739cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:53.377730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6db0dc-0ca3-4172-87e4-5612773739cd service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:53.378011 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6db0dc-0ca3-4172-87e4-5612773739cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:53.378282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6db0dc-0ca3-4172-87e4-5612773739cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:53.380377 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0c6db0dc-0ca3-4172-87e4-5612773739cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:53.397225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 953/1918] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:52 2022] DELETE /identity/v3/users/08c45704a42c42df9985a7aeca5c096d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:53.468832 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6db0dc-0ca3-4172-87e4-5612773739cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:53.470417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6db0dc-0ca3-4172-87e4-5612773739cd service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:53.483033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 966/1919] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:54.027409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:54.029890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:54.111917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e4d58-1b39-4471-b3af-50edbaf27995 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:54.116724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac21a108-483f-49c8-b0e5-c13991c9b6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:54.117765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21a108-483f-49c8-b0e5-c13991c9b6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:54.118049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21a108-483f-49c8-b0e5-c13991c9b6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:54.118986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac21a108-483f-49c8-b0e5-c13991c9b6e8 admin admin] PATH_INFO: `/v3/projects/2d48127225b7444cb4fd5fd00d1151ad` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:54.120512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21a108-483f-49c8-b0e5-c13991c9b6e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d48127225b7444cb4fd5fd00d1151ad)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:54.122758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac21a108-483f-49c8-b0e5-c13991c9b6e8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:54.287722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ac21a108-483f-49c8-b0e5-c13991c9b6e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d48127225b7444cb4fd5fd00d1151ad', 'request_id': 'req-ac21a108-483f-49c8-b0e5-c13991c9b6e8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:54.429515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ac21a108-483f-49c8-b0e5-c13991c9b6e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d48127225b7444cb4fd5fd00d1151ad', 'request_id': 'req-ac21a108-483f-49c8-b0e5-c13991c9b6e8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:54.440885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ac21a108-483f-49c8-b0e5-c13991c9b6e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d48127225b7444cb4fd5fd00d1151ad', 'request_id': 'req-ac21a108-483f-49c8-b0e5-c13991c9b6e8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:54.454603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ac21a108-483f-49c8-b0e5-c13991c9b6e8 admin admin] The token cache is being invalidate because project 2d48127225b7444cb4fd5fd00d1151ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:54.455374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ac21a108-483f-49c8-b0e5-c13991c9b6e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:54.456898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ac21a108-483f-49c8-b0e5-c13991c9b6e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:54.459305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 954/1920] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:54 2022] DELETE /identity/v3/projects/2d48127225b7444cb4fd5fd00d1151ad => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:12:54.464515 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdfb4a-ad6d-4bfe-977f-b6aa3152531a None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:54.465153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdfb4a-ad6d-4bfe-977f-b6aa3152531a None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:54.465153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdfb4a-ad6d-4bfe-977f-b6aa3152531a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:54.495417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-1dfdfb4a-ad6d-4bfe-977f-b6aa3152531a None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:54.495417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1dfdfb4a-ad6d-4bfe-977f-b6aa3152531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:54.558631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 967/1921] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:54.567674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3830d-3b64-48e0-99f2-cac9bda94dcc None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:54.567963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3830d-3b64-48e0-99f2-cac9bda94dcc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:54.568248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3830d-3b64-48e0-99f2-cac9bda94dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:54.587693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2bc3830d-3b64-48e0-99f2-cac9bda94dcc None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:54.589058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2bc3830d-3b64-48e0-99f2-cac9bda94dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:54.597347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 955/1922] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:54.602621 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdfb4a-ad6d-4bfe-977f-b6aa3152531a None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:54.613969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdfb4a-ad6d-4bfe-977f-b6aa3152531a None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:54.619929 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c80f98-954d-4af4-baac-2f5bf2542c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:54.620690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c80f98-954d-4af4-baac-2f5bf2542c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:54.621074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c80f98-954d-4af4-baac-2f5bf2542c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:54.621353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c80f98-954d-4af4-baac-2f5bf2542c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:54.622088 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c80f98-954d-4af4-baac-2f5bf2542c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:12:54.622392 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c80f98-954d-4af4-baac-2f5bf2542c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:54.624253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c80f98-954d-4af4-baac-2f5bf2542c61 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:54.638867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 968/1923] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:12:54.643230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3830d-3b64-48e0-99f2-cac9bda94dcc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:54.653441 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3830d-3b64-48e0-99f2-cac9bda94dcc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:54.658544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba856-64f6-4c8b-a2a6-3356ed29c7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:54.659210 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba856-64f6-4c8b-a2a6-3356ed29c7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:54.659495 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba856-64f6-4c8b-a2a6-3356ed29c7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:54.659779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ba856-64f6-4c8b-a2a6-3356ed29c7a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:54.660500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ba856-64f6-4c8b-a2a6-3356ed29c7a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:54.662438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ba856-64f6-4c8b-a2a6-3356ed29c7a3 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:54.827524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 956/1924] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:54 2022] POST /identity/v3/projects => generated 367 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:54.830051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c80f98-954d-4af4-baac-2f5bf2542c61 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:54.842125 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c80f98-954d-4af4-baac-2f5bf2542c61 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:54.913623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d565-6489-47ce-94b6-2b8866d8c084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:54.914293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d565-6489-47ce-94b6-2b8866d8c084 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:54.914574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d565-6489-47ce-94b6-2b8866d8c084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:54.914850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d565-6489-47ce-94b6-2b8866d8c084 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:54.915864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876d565-6489-47ce-94b6-2b8866d8c084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:54.919338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876d565-6489-47ce-94b6-2b8866d8c084 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:55.079496 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 969/1925] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:54 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:55.080961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba856-64f6-4c8b-a2a6-3356ed29c7a3 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:55.092288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ba856-64f6-4c8b-a2a6-3356ed29c7a3 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:55.100244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:55.103946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e9129-5768-41ef-a0c5-0ea4b1ff3bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:55.109212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e9129-5768-41ef-a0c5-0ea4b1ff3bfa admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:55.109212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e9129-5768-41ef-a0c5-0ea4b1ff3bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:55.109212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e9129-5768-41ef-a0c5-0ea4b1ff3bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:55.109212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e9129-5768-41ef-a0c5-0ea4b1ff3bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:55.109212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e9129-5768-41ef-a0c5-0ea4b1ff3bfa admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:55.120978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 957/1926] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:55.125294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d565-6489-47ce-94b6-2b8866d8c084 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:55.136360 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d565-6489-47ce-94b6-2b8866d8c084 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:55.141608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e412d-768a-46ba-b538-3a9bfe17f1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:55.142360 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e412d-768a-46ba-b538-3a9bfe17f1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:55.142825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e412d-768a-46ba-b538-3a9bfe17f1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:55.143112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e412d-768a-46ba-b538-3a9bfe17f1b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:55.143866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e412d-768a-46ba-b538-3a9bfe17f1b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:55.145829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e412d-768a-46ba-b538-3a9bfe17f1b8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:55.157034 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 970/1927] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:55.161267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e9129-5768-41ef-a0c5-0ea4b1ff3bfa admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:55.172615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e9129-5768-41ef-a0c5-0ea4b1ff3bfa admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:55.177999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c06602-2954-4cd9-8ded-51f20e93af67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:55.179054 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c06602-2954-4cd9-8ded-51f20e93af67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:55.179486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c06602-2954-4cd9-8ded-51f20e93af67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:55.179771 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c06602-2954-4cd9-8ded-51f20e93af67 admin admin] PATH_INFO: `/v3/projects/966e96ff57b54ce1882298f2d9370447/users/5e3bb4dfbd694a9182826fa251170e58/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:55.196572 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c06602-2954-4cd9-8ded-51f20e93af67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=966e96ff57b54ce1882298f2d9370447, user_id=5e3bb4dfbd694a9182826fa251170e58, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:55.201296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c06602-2954-4cd9-8ded-51f20e93af67 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:55.264545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 958/1928] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:55 2022] PUT /identity/v3/projects/966e96ff57b54ce1882298f2d9370447/users/5e3bb4dfbd694a9182826fa251170e58/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:55.276219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a064e-de85-4fa2-bc3a-21a0173a515e None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:55.276510 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a064e-de85-4fa2-bc3a-21a0173a515e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:55.276792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a064e-de85-4fa2-bc3a-21a0173a515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:55.304080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-c29a064e-de85-4fa2-bc3a-21a0173a515e None None] MFA Rules not processed for user `5e3bb4dfbd694a9182826fa251170e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:55.305676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c29a064e-de85-4fa2-bc3a-21a0173a515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:55.371649 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 971/1929] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:55.376150 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c06602-2954-4cd9-8ded-51f20e93af67 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:55.443766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c06602-2954-4cd9-8ded-51f20e93af67 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:55.449767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008a51e-215e-45c3-89c4-95d2eba27bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:55.450525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008a51e-215e-45c3-89c4-95d2eba27bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:55.450841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008a51e-215e-45c3-89c4-95d2eba27bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:55.451126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008a51e-215e-45c3-89c4-95d2eba27bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:55.451828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008a51e-215e-45c3-89c4-95d2eba27bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:55.457947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7008a51e-215e-45c3-89c4-95d2eba27bbd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:55.597776 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 959/1930] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:12:55 2022] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:55.602300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a064e-de85-4fa2-bc3a-21a0173a515e None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:55.615175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a064e-de85-4fa2-bc3a-21a0173a515e None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:55.626967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:55.688368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d35dd9-d963-409a-aac4-412d1085d036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:55.689100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d35dd9-d963-409a-aac4-412d1085d036 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:55.689435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d35dd9-d963-409a-aac4-412d1085d036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:55.695815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d35dd9-d963-409a-aac4-412d1085d036 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:55.695815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d35dd9-d963-409a-aac4-412d1085d036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:55.695815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d35dd9-d963-409a-aac4-412d1085d036 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:55.817627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 972/1931] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:12:55 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:12:55.821156 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008a51e-215e-45c3-89c4-95d2eba27bbd admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:55.832220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008a51e-215e-45c3-89c4-95d2eba27bbd admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:55.836734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef7288-6f4d-4658-9d5e-05fbbb935bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:55.837816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef7288-6f4d-4658-9d5e-05fbbb935bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:55.838817 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef7288-6f4d-4658-9d5e-05fbbb935bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:55.839446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef7288-6f4d-4658-9d5e-05fbbb935bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:55.840509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef7288-6f4d-4658-9d5e-05fbbb935bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:55.842572 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef7288-6f4d-4658-9d5e-05fbbb935bbe admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:55.854711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 960/1932] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:55.865007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d35dd9-d963-409a-aac4-412d1085d036 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:55.871959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d35dd9-d963-409a-aac4-412d1085d036 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:55.877895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1762429-1516-45a5-9b05-831564b2e95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:55.878807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762429-1516-45a5-9b05-831564b2e95f admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:55.879232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762429-1516-45a5-9b05-831564b2e95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:55.879484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1762429-1516-45a5-9b05-831564b2e95f admin admin] PATH_INFO: `/v3/projects/fd42feefb2fc48f2a587d1721c7aaed5/users/a339049d7ff146b3afc2b3afca88f9af/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:55.898294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762429-1516-45a5-9b05-831564b2e95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd42feefb2fc48f2a587d1721c7aaed5, user_id=a339049d7ff146b3afc2b3afca88f9af, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:55.902738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1762429-1516-45a5-9b05-831564b2e95f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:56.039430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 973/1933] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:55 2022] PUT /identity/v3/projects/fd42feefb2fc48f2a587d1721c7aaed5/users/a339049d7ff146b3afc2b3afca88f9af/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:56.043645 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef7288-6f4d-4658-9d5e-05fbbb935bbe admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:56.054092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef7288-6f4d-4658-9d5e-05fbbb935bbe admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:56.125457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6574f4-6207-4771-ad54-ed7595993584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:56.126213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6574f4-6207-4771-ad54-ed7595993584 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:56.126551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6574f4-6207-4771-ad54-ed7595993584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:56.126910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6574f4-6207-4771-ad54-ed7595993584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:56.128205 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6574f4-6207-4771-ad54-ed7595993584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:56.130963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6574f4-6207-4771-ad54-ed7595993584 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:56.161145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 961/1934] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:12:56.162847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1762429-1516-45a5-9b05-831564b2e95f admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:56.177038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1762429-1516-45a5-9b05-831564b2e95f admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:56.183201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eaa35-d65c-440a-9cb4-db8ad72d5bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:56.184253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eaa35-d65c-440a-9cb4-db8ad72d5bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:56.184834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eaa35-d65c-440a-9cb4-db8ad72d5bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:56.185181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3eaa35-d65c-440a-9cb4-db8ad72d5bc8 admin admin] PATH_INFO: `/v3/projects/fd42feefb2fc48f2a587d1721c7aaed5/users/a339049d7ff146b3afc2b3afca88f9af/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:56.187581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3eaa35-d65c-440a-9cb4-db8ad72d5bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd42feefb2fc48f2a587d1721c7aaed5, user_id=a339049d7ff146b3afc2b3afca88f9af, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:56.190676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3eaa35-d65c-440a-9cb4-db8ad72d5bc8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:56.224914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 974/1935] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:12:56 2022] PUT /identity/v3/projects/fd42feefb2fc48f2a587d1721c7aaed5/users/a339049d7ff146b3afc2b3afca88f9af/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:56.234590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5167cb-5d07-43e4-821e-51e4f9cd1058 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:56.235078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5167cb-5d07-43e4-821e-51e4f9cd1058 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:56.236426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5167cb-5d07-43e4-821e-51e4f9cd1058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:56.295728 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1e5167cb-5d07-43e4-821e-51e4f9cd1058 None None] MFA Rules not processed for user `a339049d7ff146b3afc2b3afca88f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:56.298061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1e5167cb-5d07-43e4-821e-51e4f9cd1058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:56.396948 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 962/1936] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:56 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:56.407863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eaa35-d65c-440a-9cb4-db8ad72d5bc8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:56.409515 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2d3eaa35-d65c-440a-9cb4-db8ad72d5bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:56.473809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3eaa35-d65c-440a-9cb4-db8ad72d5bc8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:56.477687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903f067-af5f-4401-8ab7-fba13372732e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:56.478384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903f067-af5f-4401-8ab7-fba13372732e service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:56.478716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903f067-af5f-4401-8ab7-fba13372732e service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:56.479032 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903f067-af5f-4401-8ab7-fba13372732e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:56.488813 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903f067-af5f-4401-8ab7-fba13372732e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:56.490279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903f067-af5f-4401-8ab7-fba13372732e service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:56.500377 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 975/1937] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:56 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:56.695395 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:56.826145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5167cb-5d07-43e4-821e-51e4f9cd1058 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:56.835603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5167cb-5d07-43e4-821e-51e4f9cd1058 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:56.839402 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdf244-81bb-43fd-9b1b-1a7e57cf868f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:56.840030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdf244-81bb-43fd-9b1b-1a7e57cf868f service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:56.840317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdf244-81bb-43fd-9b1b-1a7e57cf868f service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:56.840598 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdf244-81bb-43fd-9b1b-1a7e57cf868f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:56.899745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdf244-81bb-43fd-9b1b-1a7e57cf868f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:56.901299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdf244-81bb-43fd-9b1b-1a7e57cf868f service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:56.912779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 963/1938] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:12:57.178592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903f067-af5f-4401-8ab7-fba13372732e service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:57.179993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5903f067-af5f-4401-8ab7-fba13372732e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:57.250365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903f067-af5f-4401-8ab7-fba13372732e service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:57.275302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:57.276503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:57.276852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:57.277116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] PATH_INFO: `/v3/users/2ad54b63f2fd458bbe5eaac7e0788fb8` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:57.278498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad54b63f2fd458bbe5eaac7e0788fb8)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:57.280516 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:57.512508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad54b63f2fd458bbe5eaac7e0788fb8'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:57.526385 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad54b63f2fd458bbe5eaac7e0788fb8'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:57.654576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad54b63f2fd458bbe5eaac7e0788fb8'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:57.655197 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad54b63f2fd458bbe5eaac7e0788fb8'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:57.655805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad54b63f2fd458bbe5eaac7e0788fb8'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:57.668537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 976/1939] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:57 2022] DELETE /identity/v3/users/2ad54b63f2fd458bbe5eaac7e0788fb8 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:57.673183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb2a01-5ffc-4f16-afb3-309151e764f8 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:57.673473 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb2a01-5ffc-4f16-afb3-309151e764f8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:57.673750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb2a01-5ffc-4f16-afb3-309151e764f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:57.691335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c3bb2a01-5ffc-4f16-afb3-309151e764f8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:12:57.692520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c3bb2a01-5ffc-4f16-afb3-309151e764f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:57.761184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 964/1940] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:12:57.767889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:57.769337 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:57.827016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19b362-93ef-4815-ba81-d5fbc0cd273e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:57.830642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f1c44-5287-4d6e-a401-d971dad4912d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:57.831283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f1c44-5287-4d6e-a401-d971dad4912d service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:57.831567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f1c44-5287-4d6e-a401-d971dad4912d service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:57.831847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f1c44-5287-4d6e-a401-d971dad4912d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:57.841555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f1c44-5287-4d6e-a401-d971dad4912d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:57.843514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f1c44-5287-4d6e-a401-d971dad4912d service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:57.853278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 977/1941] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:12:58.431434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb2a01-5ffc-4f16-afb3-309151e764f8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:58.434024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c3bb2a01-5ffc-4f16-afb3-309151e764f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:58.452834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb2a01-5ffc-4f16-afb3-309151e764f8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:58.470158 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:58.470158 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:58.470158 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:58.470158 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] PATH_INFO: `/v3/projects/2d9eb1d9834645a2a2ddcc62d3b4e0fe` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:58.470494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d9eb1d9834645a2a2ddcc62d3b4e0fe)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:58.470930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:58.647392 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d9eb1d9834645a2a2ddcc62d3b4e0fe', 'request_id': 'req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:58.759473 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d9eb1d9834645a2a2ddcc62d3b4e0fe', 'request_id': 'req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:58.767142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d9eb1d9834645a2a2ddcc62d3b4e0fe', 'request_id': 'req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:58.779956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] The token cache is being invalidate because project 2d9eb1d9834645a2a2ddcc62d3b4e0fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:12:58.780246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:58.790221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:58.799740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 965/1942] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:12:58 2022] DELETE /identity/v3/projects/2d9eb1d9834645a2a2ddcc62d3b4e0fe => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:58.803745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f1c44-5287-4d6e-a401-d971dad4912d service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:58.815609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f1c44-5287-4d6e-a401-d971dad4912d service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:58.905325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:58.906445 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:58.906882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:58.907343 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] PATH_INFO: `/v3/users/7d59380634ee4599af80ece825b16553` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:58.908975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d59380634ee4599af80ece825b16553)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:58.911147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:59.095517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:12:59.183765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d59380634ee4599af80ece825b16553'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:59.198977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d59380634ee4599af80ece825b16553'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:59.330977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d59380634ee4599af80ece825b16553'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:59.331625 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d59380634ee4599af80ece825b16553'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:59.332315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d59380634ee4599af80ece825b16553'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:12:59.358827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:12:59.359483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 978/1943] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:12:58 2022] DELETE /identity/v3/users/7d59380634ee4599af80ece825b16553 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:12:59.360965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:59.439819 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9e518-fd8b-4cb3-a930-d6df0132f3ff admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:12:59.502073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b211bd-69a3-4110-a2dc-4252b0e2ae7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:12:59.502891 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b211bd-69a3-4110-a2dc-4252b0e2ae7b service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:12:59.503167 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b211bd-69a3-4110-a2dc-4252b0e2ae7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:12:59.503666 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b211bd-69a3-4110-a2dc-4252b0e2ae7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:12:59.505827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-89b211bd-69a3-4110-a2dc-4252b0e2ae7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:12:59.578489 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b211bd-69a3-4110-a2dc-4252b0e2ae7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:12:59.580083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b211bd-69a3-4110-a2dc-4252b0e2ae7b service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:12:59.591721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 966/1944] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:12:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:00.497383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:00.555930 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:00.559243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:00.679846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176618d-2660-46b4-aa75-6b3420eda873 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:00.686148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:00.687076 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:00.687369 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:00.687649 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3 admin admin] PATH_INFO: `/v3/projects/200d7ef48ae54e82b53db162411e3d05` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:00.688907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=200d7ef48ae54e82b53db162411e3d05)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:00.691409 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:00.971615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200d7ef48ae54e82b53db162411e3d05', 'request_id': 'req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:01.057824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200d7ef48ae54e82b53db162411e3d05', 'request_id': 'req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:01.065644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200d7ef48ae54e82b53db162411e3d05', 'request_id': 'req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:01.087401 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3 admin admin] The token cache is being invalidate because project 200d7ef48ae54e82b53db162411e3d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:01.088189 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:01.089146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-52ad6ab3-3f02-40f5-8183-ba57f0ae62a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:01.091734 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 979/1945] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:00 2022] DELETE /identity/v3/projects/200d7ef48ae54e82b53db162411e3d05 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:01.104625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb203d60-dfe3-49ec-afd7-a9007865b739 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:01.104625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb203d60-dfe3-49ec-afd7-a9007865b739 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:01.104625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb203d60-dfe3-49ec-afd7-a9007865b739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:01.123183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bb203d60-dfe3-49ec-afd7-a9007865b739 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:01.126071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bb203d60-dfe3-49ec-afd7-a9007865b739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:01.260785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 967/1946] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:01.268939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ceaec-9897-416c-8685-42865583119b None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:01.288305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ceaec-9897-416c-8685-42865583119b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:01.288305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ceaec-9897-416c-8685-42865583119b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:01.319663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-158ceaec-9897-416c-8685-42865583119b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:01.330805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-158ceaec-9897-416c-8685-42865583119b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:01.362118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 980/1947] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:01.368632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb203d60-dfe3-49ec-afd7-a9007865b739 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:01.386726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb203d60-dfe3-49ec-afd7-a9007865b739 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:01.394427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a21e1e-ecb5-4df1-9259-45ac3947a8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:01.395426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a21e1e-ecb5-4df1-9259-45ac3947a8b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:01.395714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a21e1e-ecb5-4df1-9259-45ac3947a8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:01.396263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a21e1e-ecb5-4df1-9259-45ac3947a8b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:01.397487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a21e1e-ecb5-4df1-9259-45ac3947a8b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:01.398022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a21e1e-ecb5-4df1-9259-45ac3947a8b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:01.399978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a21e1e-ecb5-4df1-9259-45ac3947a8b8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:01.418558 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 968/1948] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:01.423589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ceaec-9897-416c-8685-42865583119b None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:01.441981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ceaec-9897-416c-8685-42865583119b None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:01.455494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdcb32-0983-421d-b6a6-4849f32ec160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:01.456196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdcb32-0983-421d-b6a6-4849f32ec160 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:01.461104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdcb32-0983-421d-b6a6-4849f32ec160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:01.467726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fdcb32-0983-421d-b6a6-4849f32ec160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:01.467726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdcb32-0983-421d-b6a6-4849f32ec160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:01.467726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fdcb32-0983-421d-b6a6-4849f32ec160 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:01.628552 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 981/1949] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:01 2022] POST /identity/v3/projects => generated 407 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:01.641432 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a21e1e-ecb5-4df1-9259-45ac3947a8b8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:01.656671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a21e1e-ecb5-4df1-9259-45ac3947a8b8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:01.759642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d06126-3744-4a59-86ea-90f4a89e3a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:01.761601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d06126-3744-4a59-86ea-90f4a89e3a3e admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:01.761891 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d06126-3744-4a59-86ea-90f4a89e3a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:01.762172 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d06126-3744-4a59-86ea-90f4a89e3a3e admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:01.762894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d06126-3744-4a59-86ea-90f4a89e3a3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:01.764883 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d06126-3744-4a59-86ea-90f4a89e3a3e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:01.930232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 969/1950] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:01 2022] POST /identity/v3/users => generated 304 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:01.934451 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdcb32-0983-421d-b6a6-4849f32ec160 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:01.949697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fdcb32-0983-421d-b6a6-4849f32ec160 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:01.955145 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd630-e671-400b-b2d8-1ff524f4dee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:01.955999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd630-e671-400b-b2d8-1ff524f4dee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:01.956439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd630-e671-400b-b2d8-1ff524f4dee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:01.956901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cd630-e671-400b-b2d8-1ff524f4dee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:01.957832 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cd630-e671-400b-b2d8-1ff524f4dee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:01.960540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cd630-e671-400b-b2d8-1ff524f4dee5 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:01.976461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 982/1951] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:01.980674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d06126-3744-4a59-86ea-90f4a89e3a3e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:02.007137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d06126-3744-4a59-86ea-90f4a89e3a3e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:02.015384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2305e1d-03f8-48f1-95e2-c81bcc796089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:02.016068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2305e1d-03f8-48f1-95e2-c81bcc796089 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.016356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2305e1d-03f8-48f1-95e2-c81bcc796089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.017148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2305e1d-03f8-48f1-95e2-c81bcc796089 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.017399 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2305e1d-03f8-48f1-95e2-c81bcc796089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:02.019011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2305e1d-03f8-48f1-95e2-c81bcc796089 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:02.039724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:02.043199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 970/1952] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:02.046590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd630-e671-400b-b2d8-1ff524f4dee5 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:02.064692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cd630-e671-400b-b2d8-1ff524f4dee5 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:02.072154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de5c89-01a4-46b4-bfa6-715776f7b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:02.073720 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de5c89-01a4-46b4-bfa6-715776f7b63f admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.075462 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de5c89-01a4-46b4-bfa6-715776f7b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.075462 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de5c89-01a4-46b4-bfa6-715776f7b63f admin admin] PATH_INFO: `/v3/projects/949d6e1ab67c4b62b2ef049b9d37d48c/users/a0dd07c2faa54544b747262134c56610/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.092699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de5c89-01a4-46b4-bfa6-715776f7b63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=949d6e1ab67c4b62b2ef049b9d37d48c, user_id=a0dd07c2faa54544b747262134c56610, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:02.096345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de5c89-01a4-46b4-bfa6-715776f7b63f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:02.202504 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 983/1953] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:02 2022] PUT /identity/v3/projects/949d6e1ab67c4b62b2ef049b9d37d48c/users/a0dd07c2faa54544b747262134c56610/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:02.212898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46b76-ece4-4478-bb1d-fd31b51d92be None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.214007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46b76-ece4-4478-bb1d-fd31b51d92be None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.214463 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f46b76-ece4-4478-bb1d-fd31b51d92be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.267347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e8f46b76-ece4-4478-bb1d-fd31b51d92be None None] MFA Rules not processed for user `a0dd07c2faa54544b747262134c56610`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:02.269399 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e8f46b76-ece4-4478-bb1d-fd31b51d92be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:02.358414 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 971/1954] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:02 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:02.363648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de5c89-01a4-46b4-bfa6-715776f7b63f admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:02.452957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de5c89-01a4-46b4-bfa6-715776f7b63f admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:02.460289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41f5ab-75c2-41c3-a624-ec3c868d6bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:02.461713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41f5ab-75c2-41c3-a624-ec3c868d6bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.462020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41f5ab-75c2-41c3-a624-ec3c868d6bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.462373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d41f5ab-75c2-41c3-a624-ec3c868d6bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.463807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41f5ab-75c2-41c3-a624-ec3c868d6bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:02.466814 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d41f5ab-75c2-41c3-a624-ec3c868d6bb4 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:02.572678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 984/1955] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:02 2022] POST /identity/v3/projects => generated 409 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:02.572886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46b76-ece4-4478-bb1d-fd31b51d92be None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:02.583032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f46b76-ece4-4478-bb1d-fd31b51d92be None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:02.693116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cae706-d5c8-4e96-abba-9d76e74d9354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:02.693906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cae706-d5c8-4e96-abba-9d76e74d9354 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.694200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cae706-d5c8-4e96-abba-9d76e74d9354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.694477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cae706-d5c8-4e96-abba-9d76e74d9354 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.698910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cae706-d5c8-4e96-abba-9d76e74d9354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:02.701179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cae706-d5c8-4e96-abba-9d76e74d9354 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:02.835587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41f5ab-75c2-41c3-a624-ec3c868d6bb4 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:02.840836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 972/1956] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:02 2022] POST /identity/v3/users => generated 311 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:02.842010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cae706-d5c8-4e96-abba-9d76e74d9354 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:02.842817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2d41f5ab-75c2-41c3-a624-ec3c868d6bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:02.859042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cae706-d5c8-4e96-abba-9d76e74d9354 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:02.866566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e446b48-03ea-4756-a872-333801b8780f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:02.871545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446b48-03ea-4756-a872-333801b8780f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.871846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446b48-03ea-4756-a872-333801b8780f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.872125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e446b48-03ea-4756-a872-333801b8780f admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.872930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e446b48-03ea-4756-a872-333801b8780f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:02.876856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d41f5ab-75c2-41c3-a624-ec3c868d6bb4 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:02.882038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e446b48-03ea-4756-a872-333801b8780f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:02.893757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6822091-7fa1-46ad-b02e-a20880c248ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:02.895093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6822091-7fa1-46ad-b02e-a20880c248ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.895384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6822091-7fa1-46ad-b02e-a20880c248ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.896027 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6822091-7fa1-46ad-b02e-a20880c248ce admin admin] PATH_INFO: `/v3/users/d4d8fa710bf64036aed7f5becd8c34c4` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.897403 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6822091-7fa1-46ad-b02e-a20880c248ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d8fa710bf64036aed7f5becd8c34c4)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:02.899408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6822091-7fa1-46ad-b02e-a20880c248ce admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:02.904326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 973/1957] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:02.905784 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e446b48-03ea-4756-a872-333801b8780f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:02.951207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e446b48-03ea-4756-a872-333801b8780f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:02.959717 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dfca2-7771-4a72-955c-bbefc9d0b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:02.960555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dfca2-7771-4a72-955c-bbefc9d0b154 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:02.960981 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dfca2-7771-4a72-955c-bbefc9d0b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:02.962180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dfca2-7771-4a72-955c-bbefc9d0b154 admin admin] PATH_INFO: `/v3/projects/9478320d1f2248b38d0cdfa97ecfd04d/users/55fe5bbc0264473f8fffa58e970ee5fc/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:02.986487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dfca2-7771-4a72-955c-bbefc9d0b154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9478320d1f2248b38d0cdfa97ecfd04d, user_id=55fe5bbc0264473f8fffa58e970ee5fc, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:02.989531 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dfca2-7771-4a72-955c-bbefc9d0b154 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:03.119276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 974/1958] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:02 2022] PUT /identity/v3/projects/9478320d1f2248b38d0cdfa97ecfd04d/users/55fe5bbc0264473f8fffa58e970ee5fc/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:03.120344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dfca2-7771-4a72-955c-bbefc9d0b154 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:03.199017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c6822091-7fa1-46ad-b02e-a20880c248ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d8fa710bf64036aed7f5becd8c34c4'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:03.211886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c6822091-7fa1-46ad-b02e-a20880c248ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d8fa710bf64036aed7f5becd8c34c4'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:03.222406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dfca2-7771-4a72-955c-bbefc9d0b154 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:03.229238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2780f0-3263-4f30-9e7e-34746ec3549c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:03.230437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2780f0-3263-4f30-9e7e-34746ec3549c admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.231024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2780f0-3263-4f30-9e7e-34746ec3549c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.231619 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2780f0-3263-4f30-9e7e-34746ec3549c admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:03.232695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2780f0-3263-4f30-9e7e-34746ec3549c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:03.234813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2780f0-3263-4f30-9e7e-34746ec3549c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:03.249658 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 975/1959] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:03.251034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2780f0-3263-4f30-9e7e-34746ec3549c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:03.262947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2780f0-3263-4f30-9e7e-34746ec3549c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:03.268476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf07db-bb13-4482-8017-1f79d61e0206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:03.269472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf07db-bb13-4482-8017-1f79d61e0206 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.270031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf07db-bb13-4482-8017-1f79d61e0206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.270478 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf07db-bb13-4482-8017-1f79d61e0206 admin admin] PATH_INFO: `/v3/projects/9478320d1f2248b38d0cdfa97ecfd04d/users/55fe5bbc0264473f8fffa58e970ee5fc/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:03.273322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf07db-bb13-4482-8017-1f79d61e0206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9478320d1f2248b38d0cdfa97ecfd04d, user_id=55fe5bbc0264473f8fffa58e970ee5fc, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:03.277705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf07db-bb13-4482-8017-1f79d61e0206 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:03.293311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 976/1960] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:03 2022] PUT /identity/v3/projects/9478320d1f2248b38d0cdfa97ecfd04d/users/55fe5bbc0264473f8fffa58e970ee5fc/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:03.307476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c6822091-7fa1-46ad-b02e-a20880c248ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d8fa710bf64036aed7f5becd8c34c4'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:03.307476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c6822091-7fa1-46ad-b02e-a20880c248ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d8fa710bf64036aed7f5becd8c34c4'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:03.307736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1a80d-8e8f-4ddd-8f2f-89b642d2c0a6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.307832 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c6822091-7fa1-46ad-b02e-a20880c248ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d8fa710bf64036aed7f5becd8c34c4'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:03.307923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1a80d-8e8f-4ddd-8f2f-89b642d2c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.307923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1a80d-8e8f-4ddd-8f2f-89b642d2c0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:03.321683 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 985/1961] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:02 2022] DELETE /identity/v3/users/d4d8fa710bf64036aed7f5becd8c34c4 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:03.330618 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b5700-147f-450e-a7d0-0ab909da66cb None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.330984 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b5700-147f-450e-a7d0-0ab909da66cb None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.331280 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b5700-147f-450e-a7d0-0ab909da66cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:03.349131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bde1a80d-8e8f-4ddd-8f2f-89b642d2c0a6 None None] MFA Rules not processed for user `55fe5bbc0264473f8fffa58e970ee5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:03.351131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bde1a80d-8e8f-4ddd-8f2f-89b642d2c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:03.352727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-fa1b5700-147f-450e-a7d0-0ab909da66cb None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:03.354900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fa1b5700-147f-450e-a7d0-0ab909da66cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:03.451034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:03.466381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 977/1962] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:03.492908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 986/1963] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:03.499800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1a80d-8e8f-4ddd-8f2f-89b642d2c0a6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:03.502356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bde1a80d-8e8f-4ddd-8f2f-89b642d2c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:03.518356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b5700-147f-450e-a7d0-0ab909da66cb None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:03.520916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fa1b5700-147f-450e-a7d0-0ab909da66cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:03.605049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1a80d-8e8f-4ddd-8f2f-89b642d2c0a6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:03.615373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aed3e-09f3-43e2-8620-fcd4d5c294dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:03.616292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aed3e-09f3-43e2-8620-fcd4d5c294dc service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.616583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aed3e-09f3-43e2-8620-fcd4d5c294dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.616898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3aed3e-09f3-43e2-8620-fcd4d5c294dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:03.633021 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3aed3e-09f3-43e2-8620-fcd4d5c294dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:03.634528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3aed3e-09f3-43e2-8620-fcd4d5c294dc service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:03.635199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b5700-147f-450e-a7d0-0ab909da66cb None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:03.638992 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72554f40-8a38-4f32-a7bd-a7adad024ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:03.639646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554f40-8a38-4f32-a7bd-a7adad024ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:03.639931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554f40-8a38-4f32-a7bd-a7adad024ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:03.640211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72554f40-8a38-4f32-a7bd-a7adad024ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:03.645621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 978/1964] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:03.653217 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72554f40-8a38-4f32-a7bd-a7adad024ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:03.654679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72554f40-8a38-4f32-a7bd-a7adad024ae5 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:03.664584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 987/1965] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:03 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:04.133916 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aed3e-09f3-43e2-8620-fcd4d5c294dc service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.137685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7d3aed3e-09f3-43e2-8620-fcd4d5c294dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:04.140053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72554f40-8a38-4f32-a7bd-a7adad024ae5 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.141905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-72554f40-8a38-4f32-a7bd-a7adad024ae5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:04.154151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3aed3e-09f3-43e2-8620-fcd4d5c294dc service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:04.156199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72554f40-8a38-4f32-a7bd-a7adad024ae5 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:04.160139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd91c9d-1fc4-4972-846b-1068e152ffef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:04.160268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969b178-043c-43cb-8a43-459b7cabb8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:04.160903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd91c9d-1fc4-4972-846b-1068e152ffef service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.161084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969b178-043c-43cb-8a43-459b7cabb8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.161315 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd91c9d-1fc4-4972-846b-1068e152ffef service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.161628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd91c9d-1fc4-4972-846b-1068e152ffef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.161821 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969b178-043c-43cb-8a43-459b7cabb8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.162165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969b178-043c-43cb-8a43-459b7cabb8e1 admin admin] PATH_INFO: `/v3/projects/0594805ed08741cb93909af02d5cd657` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.163734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969b178-043c-43cb-8a43-459b7cabb8e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0594805ed08741cb93909af02d5cd657)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:04.166072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969b178-043c-43cb-8a43-459b7cabb8e1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:04.169754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9cd91c9d-1fc4-4972-846b-1068e152ffef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:04.234101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd91c9d-1fc4-4972-846b-1068e152ffef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:04.235583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd91c9d-1fc4-4972-846b-1068e152ffef service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:04.245793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 988/1966] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:04 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:04.298738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3969b178-043c-43cb-8a43-459b7cabb8e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0594805ed08741cb93909af02d5cd657', 'request_id': 'req-3969b178-043c-43cb-8a43-459b7cabb8e1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:04.403288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3969b178-043c-43cb-8a43-459b7cabb8e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0594805ed08741cb93909af02d5cd657', 'request_id': 'req-3969b178-043c-43cb-8a43-459b7cabb8e1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:04.410599 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3969b178-043c-43cb-8a43-459b7cabb8e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0594805ed08741cb93909af02d5cd657', 'request_id': 'req-3969b178-043c-43cb-8a43-459b7cabb8e1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:04.421496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3969b178-043c-43cb-8a43-459b7cabb8e1 admin admin] The token cache is being invalidate because project 0594805ed08741cb93909af02d5cd657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:04.421785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3969b178-043c-43cb-8a43-459b7cabb8e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:04.422421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3969b178-043c-43cb-8a43-459b7cabb8e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:04.423954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 979/1967] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:04 2022] DELETE /identity/v3/projects/0594805ed08741cb93909af02d5cd657 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:04.429047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2157d-5f1c-4c1c-b4f2-a8bf12debd5c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.429395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2157d-5f1c-4c1c-b4f2-a8bf12debd5c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.429678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2157d-5f1c-4c1c-b4f2-a8bf12debd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.449481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-4fd2157d-5f1c-4c1c-b4f2-a8bf12debd5c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:04.450676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4fd2157d-5f1c-4c1c-b4f2-a8bf12debd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:04.508129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 989/1968] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:04.516972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc375db4-4ea8-4e53-80e4-045079a6da85 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.517270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc375db4-4ea8-4e53-80e4-045079a6da85 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.517554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc375db4-4ea8-4e53-80e4-045079a6da85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.537104 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fc375db4-4ea8-4e53-80e4-045079a6da85 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:04.538402 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fc375db4-4ea8-4e53-80e4-045079a6da85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:04.548558 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 980/1969] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:04.552549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2157d-5f1c-4c1c-b4f2-a8bf12debd5c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.563615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2157d-5f1c-4c1c-b4f2-a8bf12debd5c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:04.569609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8898b-dd59-4aab-87b8-f4c6703e110a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:04.572904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8898b-dd59-4aab-87b8-f4c6703e110a admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.572904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8898b-dd59-4aab-87b8-f4c6703e110a admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.572904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8898b-dd59-4aab-87b8-f4c6703e110a admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.572904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8898b-dd59-4aab-87b8-f4c6703e110a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:04.572904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8898b-dd59-4aab-87b8-f4c6703e110a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:04.574525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8898b-dd59-4aab-87b8-f4c6703e110a admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:04.586451 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 990/1970] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:04.591586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc375db4-4ea8-4e53-80e4-045079a6da85 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.600879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc375db4-4ea8-4e53-80e4-045079a6da85 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:04.606682 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a85eaf-d6f0-4020-9d30-5b349f0905b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:04.606682 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85eaf-d6f0-4020-9d30-5b349f0905b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.606682 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85eaf-d6f0-4020-9d30-5b349f0905b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.607029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a85eaf-d6f0-4020-9d30-5b349f0905b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.607581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a85eaf-d6f0-4020-9d30-5b349f0905b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:04.609520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a85eaf-d6f0-4020-9d30-5b349f0905b5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:04.690105 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 981/1971] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:04 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:04.691239 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8898b-dd59-4aab-87b8-f4c6703e110a admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.704734 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8898b-dd59-4aab-87b8-f4c6703e110a admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:04.783222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b5533-883b-4405-a95b-2af7dec24cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:04.783886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b5533-883b-4405-a95b-2af7dec24cc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.784583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b5533-883b-4405-a95b-2af7dec24cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.784951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b5533-883b-4405-a95b-2af7dec24cc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.785918 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b5533-883b-4405-a95b-2af7dec24cc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:04.788275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b5533-883b-4405-a95b-2af7dec24cc1 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:04.920673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a85eaf-d6f0-4020-9d30-5b349f0905b5 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.922657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c3a85eaf-d6f0-4020-9d30-5b349f0905b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:04.936234 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a85eaf-d6f0-4020-9d30-5b349f0905b5 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:04.945486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca515fd8-ae5e-41d0-8fbc-1753756402e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:04.946397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca515fd8-ae5e-41d0-8fbc-1753756402e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.946678 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca515fd8-ae5e-41d0-8fbc-1753756402e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.946957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca515fd8-ae5e-41d0-8fbc-1753756402e9 admin admin] PATH_INFO: `/v3/users/5e3bb4dfbd694a9182826fa251170e58` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.949363 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca515fd8-ae5e-41d0-8fbc-1753756402e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3bb4dfbd694a9182826fa251170e58)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:04.954380 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca515fd8-ae5e-41d0-8fbc-1753756402e9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:04.954485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 991/1972] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:04 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:04.957639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b5533-883b-4405-a95b-2af7dec24cc1 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:04.971537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b5533-883b-4405-a95b-2af7dec24cc1 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:04.976938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffb293-a8bd-4b5f-86f6-8bd0d24ad9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:04.977610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffb293-a8bd-4b5f-86f6-8bd0d24ad9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:04.978379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffb293-a8bd-4b5f-86f6-8bd0d24ad9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:04.978379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ffb293-a8bd-4b5f-86f6-8bd0d24ad9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:04.979122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffb293-a8bd-4b5f-86f6-8bd0d24ad9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:04.980757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ffb293-a8bd-4b5f-86f6-8bd0d24ad9d7 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:04.991093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 992/1973] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:04.996110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffb293-a8bd-4b5f-86f6-8bd0d24ad9d7 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:05.005457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ffb293-a8bd-4b5f-86f6-8bd0d24ad9d7 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:05.010571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b13a10-18dc-4568-9fef-fb5ab73d456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:05.011199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b13a10-18dc-4568-9fef-fb5ab73d456d admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.011482 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b13a10-18dc-4568-9fef-fb5ab73d456d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.011757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b13a10-18dc-4568-9fef-fb5ab73d456d admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.012463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b13a10-18dc-4568-9fef-fb5ab73d456d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:05.014136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b13a10-18dc-4568-9fef-fb5ab73d456d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:05.023894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 993/1974] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:05.028658 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b13a10-18dc-4568-9fef-fb5ab73d456d admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:05.038316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b13a10-18dc-4568-9fef-fb5ab73d456d admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:05.047825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc91f4-070e-47f9-8e18-e7a932f02258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:05.048788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc91f4-070e-47f9-8e18-e7a932f02258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.049101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc91f4-070e-47f9-8e18-e7a932f02258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.049628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc91f4-070e-47f9-8e18-e7a932f02258 admin admin] PATH_INFO: `/v3/projects/75fc5be36ece45f2affb5f5d015cc6a3/users/d9989fb762e748c4b861268206c2459d/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.055467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:05.069258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc91f4-070e-47f9-8e18-e7a932f02258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75fc5be36ece45f2affb5f5d015cc6a3, user_id=d9989fb762e748c4b861268206c2459d, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:05.072084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc91f4-070e-47f9-8e18-e7a932f02258 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:05.148556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ca515fd8-ae5e-41d0-8fbc-1753756402e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3bb4dfbd694a9182826fa251170e58'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:05.162170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ca515fd8-ae5e-41d0-8fbc-1753756402e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3bb4dfbd694a9182826fa251170e58'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:05.205022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 994/1975] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:05 2022] PUT /identity/v3/projects/75fc5be36ece45f2affb5f5d015cc6a3/users/d9989fb762e748c4b861268206c2459d/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:05.218442 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db7194-fdcf-425e-a54b-d3dbd369ca45 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.218740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db7194-fdcf-425e-a54b-d3dbd369ca45 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.219291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db7194-fdcf-425e-a54b-d3dbd369ca45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.250221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e8db7194-fdcf-425e-a54b-d3dbd369ca45 None None] MFA Rules not processed for user `d9989fb762e748c4b861268206c2459d`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:05.251470 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e8db7194-fdcf-425e-a54b-d3dbd369ca45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:05.318912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 995/1976] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:05.332175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ca515fd8-ae5e-41d0-8fbc-1753756402e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3bb4dfbd694a9182826fa251170e58'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:05.332575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db7194-fdcf-425e-a54b-d3dbd369ca45 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:05.333229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ca515fd8-ae5e-41d0-8fbc-1753756402e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3bb4dfbd694a9182826fa251170e58'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:05.334020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ca515fd8-ae5e-41d0-8fbc-1753756402e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3bb4dfbd694a9182826fa251170e58'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:05.334292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e8db7194-fdcf-425e-a54b-d3dbd369ca45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:05.355090 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 982/1977] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:04 2022] DELETE /identity/v3/users/5e3bb4dfbd694a9182826fa251170e58 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:05.363801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef7ac8-0346-4ea5-8bd2-cdb5e2349914 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.364093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef7ac8-0346-4ea5-8bd2-cdb5e2349914 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.364376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef7ac8-0346-4ea5-8bd2-cdb5e2349914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.382898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3bef7ac8-0346-4ea5-8bd2-cdb5e2349914 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:05.384113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3bef7ac8-0346-4ea5-8bd2-cdb5e2349914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:05.414647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db7194-fdcf-425e-a54b-d3dbd369ca45 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:05.454452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 983/1978] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:05.465004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef7ac8-0346-4ea5-8bd2-cdb5e2349914 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:05.466625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3bef7ac8-0346-4ea5-8bd2-cdb5e2349914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:05.485923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aa49e-008e-4771-9805-c98f375d4661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:05.486592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aa49e-008e-4771-9805-c98f375d4661 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.486873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aa49e-008e-4771-9805-c98f375d4661 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.487161 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9aa49e-008e-4771-9805-c98f375d4661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.489035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1c9aa49e-008e-4771-9805-c98f375d4661 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:05.530805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef7ac8-0346-4ea5-8bd2-cdb5e2349914 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:05.534567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49302fd-9f1e-44d9-af75-b6b1be79d8f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:05.535254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49302fd-9f1e-44d9-af75-b6b1be79d8f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:05.535542 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49302fd-9f1e-44d9-af75-b6b1be79d8f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:05.535819 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49302fd-9f1e-44d9-af75-b6b1be79d8f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:05.548066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49302fd-9f1e-44d9-af75-b6b1be79d8f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:05.549841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49302fd-9f1e-44d9-af75-b6b1be79d8f5 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:05.552867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aa49e-008e-4771-9805-c98f375d4661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:05.555735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9aa49e-008e-4771-9805-c98f375d4661 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:05.560575 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 984/1979] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:05.565797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 996/1980] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:06.356514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49302fd-9f1e-44d9-af75-b6b1be79d8f5 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:06.358049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e49302fd-9f1e-44d9-af75-b6b1be79d8f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:06.372145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49302fd-9f1e-44d9-af75-b6b1be79d8f5 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:06.377274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:06.378805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:06.379425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:06.379762 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] PATH_INFO: `/v3/projects/966e96ff57b54ce1882298f2d9370447` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:06.380976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=966e96ff57b54ce1882298f2d9370447)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:06.382942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:06.451881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:06.514953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '966e96ff57b54ce1882298f2d9370447', 'request_id': 'req-00008d2a-b915-4b19-871c-9cf0c5c13cb7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:06.719571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '966e96ff57b54ce1882298f2d9370447', 'request_id': 'req-00008d2a-b915-4b19-871c-9cf0c5c13cb7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:06.726739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '966e96ff57b54ce1882298f2d9370447', 'request_id': 'req-00008d2a-b915-4b19-871c-9cf0c5c13cb7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:06.738292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] The token cache is being invalidate because project 966e96ff57b54ce1882298f2d9370447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:06.738582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:06.739448 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:06.741017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 985/1981] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:06 2022] DELETE /identity/v3/projects/966e96ff57b54ce1882298f2d9370447 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:06.746260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aa49e-008e-4771-9805-c98f375d4661 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:06.758000 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9aa49e-008e-4771-9805-c98f375d4661 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:06.818969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a94ba3-a684-4d2b-9cc7-0e7b69cc22cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:06.819844 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a94ba3-a684-4d2b-9cc7-0e7b69cc22cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:06.820130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a94ba3-a684-4d2b-9cc7-0e7b69cc22cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:06.820416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a94ba3-a684-4d2b-9cc7-0e7b69cc22cb admin admin] PATH_INFO: `/v3/users/a339049d7ff146b3afc2b3afca88f9af` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:06.821641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a94ba3-a684-4d2b-9cc7-0e7b69cc22cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a339049d7ff146b3afc2b3afca88f9af)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:06.823601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a94ba3-a684-4d2b-9cc7-0e7b69cc22cb admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:07.234876 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-65a94ba3-a684-4d2b-9cc7-0e7b69cc22cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a339049d7ff146b3afc2b3afca88f9af'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:07.247051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-65a94ba3-a684-4d2b-9cc7-0e7b69cc22cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a339049d7ff146b3afc2b3afca88f9af'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:07.420236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-65a94ba3-a684-4d2b-9cc7-0e7b69cc22cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a339049d7ff146b3afc2b3afca88f9af'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:07.420907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-65a94ba3-a684-4d2b-9cc7-0e7b69cc22cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a339049d7ff146b3afc2b3afca88f9af'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:07.421530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-65a94ba3-a684-4d2b-9cc7-0e7b69cc22cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a339049d7ff146b3afc2b3afca88f9af'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:07.437597 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 997/1982] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:06 2022] DELETE /identity/v3/users/a339049d7ff146b3afc2b3afca88f9af => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:08.020308 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:08.024500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:08.036041 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00008d2a-b915-4b19-871c-9cf0c5c13cb7 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:08.099242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:08.100117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:08.100395 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:08.100672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] PATH_INFO: `/v3/projects/fd42feefb2fc48f2a587d1721c7aaed5` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:08.101953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd42feefb2fc48f2a587d1721c7aaed5)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:08.103981 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:08.300145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd42feefb2fc48f2a587d1721c7aaed5', 'request_id': 'req-32c6f886-9ab5-40aa-bd37-350c4c5da05a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:08.469267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd42feefb2fc48f2a587d1721c7aaed5', 'request_id': 'req-32c6f886-9ab5-40aa-bd37-350c4c5da05a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:08.477207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd42feefb2fc48f2a587d1721c7aaed5', 'request_id': 'req-32c6f886-9ab5-40aa-bd37-350c4c5da05a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:08.488117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] The token cache is being invalidate because project fd42feefb2fc48f2a587d1721c7aaed5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:08.488479 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:08.489374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:08.490960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 986/1983] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:08 2022] DELETE /identity/v3/projects/fd42feefb2fc48f2a587d1721c7aaed5 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:08.496325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9d1c1-deb6-4655-941d-ee545a053e51 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:08.496833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9d1c1-deb6-4655-941d-ee545a053e51 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:08.496937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9d1c1-deb6-4655-941d-ee545a053e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:08.518205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-90e9d1c1-deb6-4655-941d-ee545a053e51 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:08.519473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-90e9d1c1-deb6-4655-941d-ee545a053e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:08.539458 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:08.541846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:08.609151 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 998/1984] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:08.616451 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2f1fc-1e71-493a-a54b-31f5a5e464f6 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:08.616750 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2f1fc-1e71-493a-a54b-31f5a5e464f6 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:08.621498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2f1fc-1e71-493a-a54b-31f5a5e464f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:08.632146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6f886-9ab5-40aa-bd37-350c4c5da05a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:08.635733 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f02b4f-9583-4f71-b36f-65b1bdd0604f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:08.637571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02b4f-9583-4f71-b36f-65b1bdd0604f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:08.638315 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02b4f-9583-4f71-b36f-65b1bdd0604f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:08.640638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f02b4f-9583-4f71-b36f-65b1bdd0604f admin admin] PATH_INFO: `/v3/users/3c53626e98264af8badbb2ed3fc931df` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:08.642815 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f02b4f-9583-4f71-b36f-65b1bdd0604f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c53626e98264af8badbb2ed3fc931df)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:08.645692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f02b4f-9583-4f71-b36f-65b1bdd0604f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:08.651070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e1a2f1fc-1e71-493a-a54b-31f5a5e464f6 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:08.652269 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e1a2f1fc-1e71-493a-a54b-31f5a5e464f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:08.661341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 999/1985] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:08.665995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2f1fc-1e71-493a-a54b-31f5a5e464f6 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:08.675910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:08.678612 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2f1fc-1e71-493a-a54b-31f5a5e464f6 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:08.683429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec23258-6506-4abb-ae58-c205c9b9ff72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:08.684089 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec23258-6506-4abb-ae58-c205c9b9ff72 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:08.684371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec23258-6506-4abb-ae58-c205c9b9ff72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:08.684649 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec23258-6506-4abb-ae58-c205c9b9ff72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:08.685421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec23258-6506-4abb-ae58-c205c9b9ff72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:08.685729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec23258-6506-4abb-ae58-c205c9b9ff72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:08.687338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec23258-6506-4abb-ae58-c205c9b9ff72 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:08.699396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1000/1986] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:13:08.703764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec23258-6506-4abb-ae58-c205c9b9ff72 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:08.713695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec23258-6506-4abb-ae58-c205c9b9ff72 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:08.718492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218901a-c221-4d15-b85c-1c9c2ffa27a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:08.719106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218901a-c221-4d15-b85c-1c9c2ffa27a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:08.719390 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218901a-c221-4d15-b85c-1c9c2ffa27a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:08.719668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218901a-c221-4d15-b85c-1c9c2ffa27a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:08.720341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218901a-c221-4d15-b85c-1c9c2ffa27a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:08.722255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218901a-c221-4d15-b85c-1c9c2ffa27a2 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:08.834040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1001/1987] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:08 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:08.849822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218901a-c221-4d15-b85c-1c9c2ffa27a2 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:08.924012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218901a-c221-4d15-b85c-1c9c2ffa27a2 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:08.928768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d86219-10fe-48fa-b138-b71d1efd6cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:08.929476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d86219-10fe-48fa-b138-b71d1efd6cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:08.929752 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d86219-10fe-48fa-b138-b71d1efd6cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:08.930038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d86219-10fe-48fa-b138-b71d1efd6cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:08.930845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d86219-10fe-48fa-b138-b71d1efd6cf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:08.932853 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d86219-10fe-48fa-b138-b71d1efd6cf6 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:08.960046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c1f02b4f-9583-4f71-b36f-65b1bdd0604f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c53626e98264af8badbb2ed3fc931df'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:08.980133 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c1f02b4f-9583-4f71-b36f-65b1bdd0604f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c53626e98264af8badbb2ed3fc931df'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:09.103396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1002/1988] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:08 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:09.104851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d86219-10fe-48fa-b138-b71d1efd6cf6 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:09.114272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d86219-10fe-48fa-b138-b71d1efd6cf6 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:09.117832 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c1f02b4f-9583-4f71-b36f-65b1bdd0604f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c53626e98264af8badbb2ed3fc931df'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:09.119783 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c1f02b4f-9583-4f71-b36f-65b1bdd0604f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c53626e98264af8badbb2ed3fc931df'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:09.120507 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c1f02b4f-9583-4f71-b36f-65b1bdd0604f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c53626e98264af8badbb2ed3fc931df'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:09.126642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4fc66-8c09-4242-a007-ecde861f09ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:09.126642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4fc66-8c09-4242-a007-ecde861f09ae admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.126642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4fc66-8c09-4242-a007-ecde861f09ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.126642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4fc66-8c09-4242-a007-ecde861f09ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.127120 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4fc66-8c09-4242-a007-ecde861f09ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:09.128507 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4fc66-8c09-4242-a007-ecde861f09ae admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:09.133992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 987/1989] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:08 2022] DELETE /identity/v3/users/3c53626e98264af8badbb2ed3fc931df => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:09.142350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1003/1990] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:09.144085 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a356-1f40-4597-8587-5c3fa4ced288 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.144381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a356-1f40-4597-8587-5c3fa4ced288 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.144659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751a356-1f40-4597-8587-5c3fa4ced288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.146342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4fc66-8c09-4242-a007-ecde861f09ae admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:09.148179 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-eee4fc66-8c09-4242-a007-ecde861f09ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:09.161848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4fc66-8c09-4242-a007-ecde861f09ae admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:09.164143 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7751a356-1f40-4597-8587-5c3fa4ced288 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:09.165513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7751a356-1f40-4597-8587-5c3fa4ced288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:09.224134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1137845-3a4a-41db-9e88-03f0deed411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:09.224840 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1137845-3a4a-41db-9e88-03f0deed411a admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.229794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1137845-3a4a-41db-9e88-03f0deed411a admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.229794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1137845-3a4a-41db-9e88-03f0deed411a admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.229794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1137845-3a4a-41db-9e88-03f0deed411a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:09.229794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1137845-3a4a-41db-9e88-03f0deed411a admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:09.234263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 988/1991] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:09.241227 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1004/1992] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:09.242199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a356-1f40-4597-8587-5c3fa4ced288 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:09.244015 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1137845-3a4a-41db-9e88-03f0deed411a admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:09.246474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b1137845-3a4a-41db-9e88-03f0deed411a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:09.252740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751a356-1f40-4597-8587-5c3fa4ced288 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:09.257441 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47429d-2f12-4d82-95ab-6065eb0bb1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:09.258328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47429d-2f12-4d82-95ab-6065eb0bb1aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.258611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47429d-2f12-4d82-95ab-6065eb0bb1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.259013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47429d-2f12-4d82-95ab-6065eb0bb1aa admin admin] PATH_INFO: `/v3/projects/b5da114168974e1d9bd9c7438e946a62/users/eed83064496b402db323a42346760fc9/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.273836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47429d-2f12-4d82-95ab-6065eb0bb1aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5da114168974e1d9bd9c7438e946a62, user_id=eed83064496b402db323a42346760fc9, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:09.277090 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47429d-2f12-4d82-95ab-6065eb0bb1aa admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:09.308422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1137845-3a4a-41db-9e88-03f0deed411a admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:09.313071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0517e-28f3-49b4-82cb-069827f2b09c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:09.313863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0517e-28f3-49b4-82cb-069827f2b09c service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.314025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0517e-28f3-49b4-82cb-069827f2b09c service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.314530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0517e-28f3-49b4-82cb-069827f2b09c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.328271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0517e-28f3-49b4-82cb-069827f2b09c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:09.330408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0517e-28f3-49b4-82cb-069827f2b09c service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:09.343214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1005/1993] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:09.426952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 989/1994] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:09 2022] PUT /identity/v3/projects/b5da114168974e1d9bd9c7438e946a62/users/eed83064496b402db323a42346760fc9/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:09.438490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4cc81-6db3-473c-8459-9ad9661f0b53 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.438628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4cc81-6db3-473c-8459-9ad9661f0b53 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.438790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4cc81-6db3-473c-8459-9ad9661f0b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.469617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-cfb4cc81-6db3-473c-8459-9ad9661f0b53 None None] MFA Rules not processed for user `eed83064496b402db323a42346760fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:09.470845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cfb4cc81-6db3-473c-8459-9ad9661f0b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:09.544852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1006/1995] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:09.548862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47429d-2f12-4d82-95ab-6065eb0bb1aa admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:09.639024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47429d-2f12-4d82-95ab-6065eb0bb1aa admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:09.644132 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad133a91-0f26-4b23-9324-950cf2b6dc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:09.644862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133a91-0f26-4b23-9324-950cf2b6dc28 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.645490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133a91-0f26-4b23-9324-950cf2b6dc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.645722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad133a91-0f26-4b23-9324-950cf2b6dc28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.646420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad133a91-0f26-4b23-9324-950cf2b6dc28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:09.648552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad133a91-0f26-4b23-9324-950cf2b6dc28 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:09.752216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 990/1996] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:09 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:09.753614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4cc81-6db3-473c-8459-9ad9661f0b53 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:09.765199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4cc81-6db3-473c-8459-9ad9661f0b53 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:09.820277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e785e-807d-4207-a6a2-3c7be2595413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:09.821039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e785e-807d-4207-a6a2-3c7be2595413 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.821322 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e785e-807d-4207-a6a2-3c7be2595413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.825075 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e785e-807d-4207-a6a2-3c7be2595413 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.825075 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e785e-807d-4207-a6a2-3c7be2595413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:09.825371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e785e-807d-4207-a6a2-3c7be2595413 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:09.902602 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad133a91-0f26-4b23-9324-950cf2b6dc28 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:09.903659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ad133a91-0f26-4b23-9324-950cf2b6dc28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:09.920099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad133a91-0f26-4b23-9324-950cf2b6dc28 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:09.925146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:09.925927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:09.926214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:09.926497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] PATH_INFO: `/v3/projects/acba0213ae8544bf926c7cef3a697e13` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:09.927718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acba0213ae8544bf926c7cef3a697e13)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:09.929744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:10.005821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1007/1997] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:09 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:10.010390 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e785e-807d-4207-a6a2-3c7be2595413 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:10.019910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e785e-807d-4207-a6a2-3c7be2595413 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:10.025131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129b60c-f44f-41e8-a2a5-f5c7fe379503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:10.027146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129b60c-f44f-41e8-a2a5-f5c7fe379503 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.027146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129b60c-f44f-41e8-a2a5-f5c7fe379503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.027146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129b60c-f44f-41e8-a2a5-f5c7fe379503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.027146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129b60c-f44f-41e8-a2a5-f5c7fe379503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:10.028723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129b60c-f44f-41e8-a2a5-f5c7fe379503 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:10.039421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1008/1998] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:10.043924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129b60c-f44f-41e8-a2a5-f5c7fe379503 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:10.054083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129b60c-f44f-41e8-a2a5-f5c7fe379503 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:10.059937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec1b97-85c1-4218-8310-35163c4323cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:10.063294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec1b97-85c1-4218-8310-35163c4323cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.063294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec1b97-85c1-4218-8310-35163c4323cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.063294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec1b97-85c1-4218-8310-35163c4323cd admin admin] PATH_INFO: `/v3/projects/513e21a5352d4b8b8be2bc239e71cee2/users/771a8e10ca2e448a9a627ef6cd3541c0/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.077714 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec1b97-85c1-4218-8310-35163c4323cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=513e21a5352d4b8b8be2bc239e71cee2, user_id=771a8e10ca2e448a9a627ef6cd3541c0, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:10.080388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec1b97-85c1-4218-8310-35163c4323cd admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:10.206238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1009/1999] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:10 2022] PUT /identity/v3/projects/513e21a5352d4b8b8be2bc239e71cee2/users/771a8e10ca2e448a9a627ef6cd3541c0/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:10.210899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec1b97-85c1-4218-8310-35163c4323cd admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:10.214579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acba0213ae8544bf926c7cef3a697e13', 'request_id': 'req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.273861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec1b97-85c1-4218-8310-35163c4323cd admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:10.330964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb0a9b-e6cb-4e72-8c6f-44d8b528fc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:10.331629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb0a9b-e6cb-4e72-8c6f-44d8b528fc0b admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.331955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb0a9b-e6cb-4e72-8c6f-44d8b528fc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.332242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb0a9b-e6cb-4e72-8c6f-44d8b528fc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.333131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb0a9b-e6cb-4e72-8c6f-44d8b528fc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:10.334886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acba0213ae8544bf926c7cef3a697e13', 'request_id': 'req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.335162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb0a9b-e6cb-4e72-8c6f-44d8b528fc0b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:10.337579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:10.344497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acba0213ae8544bf926c7cef3a697e13', 'request_id': 'req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.349377 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1010/2000] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:10.350540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb0a9b-e6cb-4e72-8c6f-44d8b528fc0b admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:10.355167 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] The token cache is being invalidate because project acba0213ae8544bf926c7cef3a697e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:10.355460 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.356271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.358081 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 991/2001] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:09 2022] DELETE /identity/v3/projects/acba0213ae8544bf926c7cef3a697e13 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:10.360790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb0a9b-e6cb-4e72-8c6f-44d8b528fc0b admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:10.361639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:10.362986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:10.365758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20a2a9-151a-43e1-9891-3c458b32ff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:10.366637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20a2a9-151a-43e1-9891-3c458b32ff95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.366924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20a2a9-151a-43e1-9891-3c458b32ff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.367419 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20a2a9-151a-43e1-9891-3c458b32ff95 admin admin] PATH_INFO: `/v3/projects/513e21a5352d4b8b8be2bc239e71cee2/users/771a8e10ca2e448a9a627ef6cd3541c0/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.369465 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20a2a9-151a-43e1-9891-3c458b32ff95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=513e21a5352d4b8b8be2bc239e71cee2, user_id=771a8e10ca2e448a9a627ef6cd3541c0, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:10.372498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20a2a9-151a-43e1-9891-3c458b32ff95 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:10.375598 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d4f0bc-ced6-49f5-b5b1-7d1cebd709c2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:10.380281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:10.387642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.387642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.387642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] PATH_INFO: `/v3/users/fc933936c5ce4f1aa8621d2324c55b89` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.387642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc933936c5ce4f1aa8621d2324c55b89)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:10.387978 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1011/2002] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:10 2022] PUT /identity/v3/projects/513e21a5352d4b8b8be2bc239e71cee2/users/771a8e10ca2e448a9a627ef6cd3541c0/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:10.388057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:10.397665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d96d8e-a028-418a-b2aa-e2f11a8cd314 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.397979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d96d8e-a028-418a-b2aa-e2f11a8cd314 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.398262 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d96d8e-a028-418a-b2aa-e2f11a8cd314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.425676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-f7d96d8e-a028-418a-b2aa-e2f11a8cd314 None None] MFA Rules not processed for user `771a8e10ca2e448a9a627ef6cd3541c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:10.426848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f7d96d8e-a028-418a-b2aa-e2f11a8cd314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:10.496505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1012/2003] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:10.507975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d96d8e-a028-418a-b2aa-e2f11a8cd314 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:10.509361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f7d96d8e-a028-418a-b2aa-e2f11a8cd314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:10.566042 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d96d8e-a028-418a-b2aa-e2f11a8cd314 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:10.569915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e09a4-6703-4b19-90fc-754b0840668e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:10.570562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e09a4-6703-4b19-90fc-754b0840668e service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.570846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e09a4-6703-4b19-90fc-754b0840668e service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.571173 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e09a4-6703-4b19-90fc-754b0840668e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.581452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e09a4-6703-4b19-90fc-754b0840668e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:10.582886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e09a4-6703-4b19-90fc-754b0840668e service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:10.592531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1013/2004] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:10.670582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc933936c5ce4f1aa8621d2324c55b89'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.684198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc933936c5ce4f1aa8621d2324c55b89'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.803349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc933936c5ce4f1aa8621d2324c55b89'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.803996 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc933936c5ce4f1aa8621d2324c55b89'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.804601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc933936c5ce4f1aa8621d2324c55b89'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:10.822909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 992/2005] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:10 2022] DELETE /identity/v3/users/fc933936c5ce4f1aa8621d2324c55b89 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:10.826614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e09a4-6703-4b19-90fc-754b0840668e service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:10.828055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-238e09a4-6703-4b19-90fc-754b0840668e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:10.839184 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e09a4-6703-4b19-90fc-754b0840668e service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:10.894746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3161e-b24c-4e3b-b9cc-18e14bb794c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:10.896062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3161e-b24c-4e3b-b9cc-18e14bb794c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:10.896873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3161e-b24c-4e3b-b9cc-18e14bb794c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:10.897157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3161e-b24c-4e3b-b9cc-18e14bb794c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:10.901145 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-94d3161e-b24c-4e3b-b9cc-18e14bb794c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:10.936542 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:10.937992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:10.968116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3161e-b24c-4e3b-b9cc-18e14bb794c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:10.969776 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3161e-b24c-4e3b-b9cc-18e14bb794c0 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:10.981283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1014/2006] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:11.010074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec7324-80bd-40e3-8785-a8de8d950f6e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:11.014044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9f19f-62c4-4475-81e0-581c21e41479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:11.014933 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f19f-62c4-4475-81e0-581c21e41479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:11.015281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f19f-62c4-4475-81e0-581c21e41479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:11.015614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f19f-62c4-4475-81e0-581c21e41479 admin admin] PATH_INFO: `/v3/users/d9989fb762e748c4b861268206c2459d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:11.020331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9f19f-62c4-4475-81e0-581c21e41479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9989fb762e748c4b861268206c2459d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:11.020331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9f19f-62c4-4475-81e0-581c21e41479 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:11.301565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b2b9f19f-62c4-4475-81e0-581c21e41479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9989fb762e748c4b861268206c2459d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:11.420199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b2b9f19f-62c4-4475-81e0-581c21e41479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9989fb762e748c4b861268206c2459d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:11.586586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b2b9f19f-62c4-4475-81e0-581c21e41479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9989fb762e748c4b861268206c2459d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:11.587415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b2b9f19f-62c4-4475-81e0-581c21e41479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9989fb762e748c4b861268206c2459d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:11.588949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b2b9f19f-62c4-4475-81e0-581c21e41479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9989fb762e748c4b861268206c2459d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:11.595244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3161e-b24c-4e3b-b9cc-18e14bb794c0 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:11.597317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-94d3161e-b24c-4e3b-b9cc-18e14bb794c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:11.606626 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 993/2007] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:10 2022] DELETE /identity/v3/users/d9989fb762e748c4b861268206c2459d => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:11.613996 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd3303-38f3-42ad-ab5f-e73e9c4c57be None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:11.614291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd3303-38f3-42ad-ab5f-e73e9c4c57be None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:11.614573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd3303-38f3-42ad-ab5f-e73e9c4c57be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:11.614692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3161e-b24c-4e3b-b9cc-18e14bb794c0 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:11.645768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c7cd3303-38f3-42ad-ab5f-e73e9c4c57be None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:11.647338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c7cd3303-38f3-42ad-ab5f-e73e9c4c57be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:11.711921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680e033-9ccb-4400-ae41-ce794b51e712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:11.715079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680e033-9ccb-4400-ae41-ce794b51e712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:11.715457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680e033-9ccb-4400-ae41-ce794b51e712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:11.716073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680e033-9ccb-4400-ae41-ce794b51e712 admin admin] PATH_INFO: `/v3/projects/b6cd1ef58d7e41ff8eedd72b21ad62ab` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:11.719120 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680e033-9ccb-4400-ae41-ce794b51e712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6cd1ef58d7e41ff8eedd72b21ad62ab)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:11.722158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680e033-9ccb-4400-ae41-ce794b51e712 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:11.747073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 994/2008] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:11.759154 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd3303-38f3-42ad-ab5f-e73e9c4c57be None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:11.761797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c7cd3303-38f3-42ad-ab5f-e73e9c4c57be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:11.822786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd3303-38f3-42ad-ab5f-e73e9c4c57be None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:11.826476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f3f1-0778-46c6-b8ee-7e4ff81fc2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:11.827138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f3f1-0778-46c6-b8ee-7e4ff81fc2fa service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:11.827426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f3f1-0778-46c6-b8ee-7e4ff81fc2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:11.827709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b2f3f1-0778-46c6-b8ee-7e4ff81fc2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:11.837226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2f3f1-0778-46c6-b8ee-7e4ff81fc2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:11.838789 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b2f3f1-0778-46c6-b8ee-7e4ff81fc2fa service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:11.850173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 995/2009] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:11.890271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f3f1-0778-46c6-b8ee-7e4ff81fc2fa service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:11.891765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-68b2f3f1-0778-46c6-b8ee-7e4ff81fc2fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:11.907301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b2f3f1-0778-46c6-b8ee-7e4ff81fc2fa service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:11.912117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c163dc-f681-40b5-af61-0b47eacfc8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:11.913319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c163dc-f681-40b5-af61-0b47eacfc8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:11.913606 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c163dc-f681-40b5-af61-0b47eacfc8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:11.913894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c163dc-f681-40b5-af61-0b47eacfc8d2 admin admin] PATH_INFO: `/v3/users/eed83064496b402db323a42346760fc9` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:11.916379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c163dc-f681-40b5-af61-0b47eacfc8d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed83064496b402db323a42346760fc9)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:11.917443 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c163dc-f681-40b5-af61-0b47eacfc8d2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:11.942648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7680e033-9ccb-4400-ae41-ce794b51e712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6cd1ef58d7e41ff8eedd72b21ad62ab', 'request_id': 'req-7680e033-9ccb-4400-ae41-ce794b51e712'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.058290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7680e033-9ccb-4400-ae41-ce794b51e712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6cd1ef58d7e41ff8eedd72b21ad62ab', 'request_id': 'req-7680e033-9ccb-4400-ae41-ce794b51e712'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.067358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7680e033-9ccb-4400-ae41-ce794b51e712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6cd1ef58d7e41ff8eedd72b21ad62ab', 'request_id': 'req-7680e033-9ccb-4400-ae41-ce794b51e712'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.080964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7680e033-9ccb-4400-ae41-ce794b51e712 admin admin] The token cache is being invalidate because project b6cd1ef58d7e41ff8eedd72b21ad62ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:12.081393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7680e033-9ccb-4400-ae41-ce794b51e712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.082253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7680e033-9ccb-4400-ae41-ce794b51e712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.084449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1015/2010] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:11 2022] DELETE /identity/v3/projects/b6cd1ef58d7e41ff8eedd72b21ad62ab => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:12.090745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbd056-40c6-4aa5-8e88-4bda6c8bbe0b None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:12.097121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbd056-40c6-4aa5-8e88-4bda6c8bbe0b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:12.097121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbd056-40c6-4aa5-8e88-4bda6c8bbe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:12.133794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-b7fbd056-40c6-4aa5-8e88-4bda6c8bbe0b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:12.136428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b7fbd056-40c6-4aa5-8e88-4bda6c8bbe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:12.217580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1016/2011] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:12.220143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20cc4f-8c5a-4b38-98ae-70dd21040fb2 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:12.221144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20cc4f-8c5a-4b38-98ae-70dd21040fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:12.221606 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20cc4f-8c5a-4b38-98ae-70dd21040fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:12.223353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-82c163dc-f681-40b5-af61-0b47eacfc8d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed83064496b402db323a42346760fc9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.237635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-82c163dc-f681-40b5-af61-0b47eacfc8d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed83064496b402db323a42346760fc9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.242565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-5f20cc4f-8c5a-4b38-98ae-70dd21040fb2 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:12.244558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5f20cc4f-8c5a-4b38-98ae-70dd21040fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:12.254842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1017/2012] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:12.259129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20cc4f-8c5a-4b38-98ae-70dd21040fb2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:12.270446 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20cc4f-8c5a-4b38-98ae-70dd21040fb2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:12.275876 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27a8d5-8c21-4481-b196-4e0befbcc4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:12.276767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27a8d5-8c21-4481-b196-4e0befbcc4cd admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:12.277090 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27a8d5-8c21-4481-b196-4e0befbcc4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:12.277375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27a8d5-8c21-4481-b196-4e0befbcc4cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:12.278173 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27a8d5-8c21-4481-b196-4e0befbcc4cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:12.278545 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27a8d5-8c21-4481-b196-4e0befbcc4cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:12.280219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27a8d5-8c21-4481-b196-4e0befbcc4cd admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:12.293200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1018/2013] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:13:12.303633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27a8d5-8c21-4481-b196-4e0befbcc4cd admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:12.311085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27a8d5-8c21-4481-b196-4e0befbcc4cd admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:12.315940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eda3a4-6e71-4f60-bd8f-d986fc9da7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:12.316617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eda3a4-6e71-4f60-bd8f-d986fc9da7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:12.316936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eda3a4-6e71-4f60-bd8f-d986fc9da7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:12.317242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eda3a4-6e71-4f60-bd8f-d986fc9da7d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:12.317951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eda3a4-6e71-4f60-bd8f-d986fc9da7d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:12.319898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eda3a4-6e71-4f60-bd8f-d986fc9da7d5 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:12.420221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-82c163dc-f681-40b5-af61-0b47eacfc8d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed83064496b402db323a42346760fc9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.420995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-82c163dc-f681-40b5-af61-0b47eacfc8d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed83064496b402db323a42346760fc9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.421608 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-82c163dc-f681-40b5-af61-0b47eacfc8d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed83064496b402db323a42346760fc9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.435058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 996/2014] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:11 2022] DELETE /identity/v3/users/eed83064496b402db323a42346760fc9 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:12.439342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84643fdc-79de-452d-a706-416851c56443 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:12.439616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84643fdc-79de-452d-a706-416851c56443 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:12.439898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84643fdc-79de-452d-a706-416851c56443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:12.460272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-84643fdc-79de-452d-a706-416851c56443 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:12.461543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-84643fdc-79de-452d-a706-416851c56443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:12.475811 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:12.487039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1019/2015] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:12 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:12.500559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eda3a4-6e71-4f60-bd8f-d986fc9da7d5 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:12.507690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b8eda3a4-6e71-4f60-bd8f-d986fc9da7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:12.554083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 997/2016] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:12.554083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84643fdc-79de-452d-a706-416851c56443 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:12.555320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-84643fdc-79de-452d-a706-416851c56443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:12.571316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84643fdc-79de-452d-a706-416851c56443 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:12.624645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eda3a4-6e71-4f60-bd8f-d986fc9da7d5 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:12.629761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:12.630725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:12.631175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:12.631629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] PATH_INFO: `/v3/projects/75fc5be36ece45f2affb5f5d015cc6a3` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:12.633181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=75fc5be36ece45f2affb5f5d015cc6a3)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:12.635549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:12.638917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f16eb3-1fdb-4904-bc85-e2d37e1dfac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:12.639410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f16eb3-1fdb-4904-bc85-e2d37e1dfac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:12.639695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f16eb3-1fdb-4904-bc85-e2d37e1dfac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:12.639973 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f16eb3-1fdb-4904-bc85-e2d37e1dfac4 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:12.641011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f16eb3-1fdb-4904-bc85-e2d37e1dfac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:12.643087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f16eb3-1fdb-4904-bc85-e2d37e1dfac4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:12.780462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 998/2017] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:12 2022] POST /identity/v3/users => generated 291 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:12.781964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f16eb3-1fdb-4904-bc85-e2d37e1dfac4 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:12.785311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-44f16eb3-1fdb-4904-bc85-e2d37e1dfac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:12.799838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75fc5be36ece45f2affb5f5d015cc6a3', 'request_id': 'req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.877870 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f16eb3-1fdb-4904-bc85-e2d37e1dfac4 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:12.949249 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75fc5be36ece45f2affb5f5d015cc6a3', 'request_id': 'req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.950921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb8f53-7da9-4cb7-b425-b4daec7f1231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:12.951601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb8f53-7da9-4cb7-b425-b4daec7f1231 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:12.951884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb8f53-7da9-4cb7-b425-b4daec7f1231 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:12.952230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb8f53-7da9-4cb7-b425-b4daec7f1231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:12.956355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75fc5be36ece45f2affb5f5d015cc6a3', 'request_id': 'req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.970062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] The token cache is being invalidate because project 75fc5be36ece45f2affb5f5d015cc6a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:12.977905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.977905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:12.977905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1020/2018] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:12 2022] DELETE /identity/v3/projects/75fc5be36ece45f2affb5f5d015cc6a3 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:12.977905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:12.977905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.028597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb8f53-7da9-4cb7-b425-b4daec7f1231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:13.031292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb8f53-7da9-4cb7-b425-b4daec7f1231 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:13.043533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 999/2019] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:13.045202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb8f53-7da9-4cb7-b425-b4daec7f1231 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:13.054854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb8f53-7da9-4cb7-b425-b4daec7f1231 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:13.062149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ad2d2-9221-45ed-bb64-e83edb5c0e7f admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:13.063809 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefc496-4fc0-4755-9dcc-3de884990b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:13.064496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefc496-4fc0-4755-9dcc-3de884990b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.064778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefc496-4fc0-4755-9dcc-3de884990b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.068776 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefc496-4fc0-4755-9dcc-3de884990b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.068776 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefc496-4fc0-4755-9dcc-3de884990b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:13.068776 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefc496-4fc0-4755-9dcc-3de884990b49 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:13.069858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa262f-6446-4526-8f5f-c2e4d5cd61b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:13.070902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa262f-6446-4526-8f5f-c2e4d5cd61b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.071629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa262f-6446-4526-8f5f-c2e4d5cd61b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.071629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa262f-6446-4526-8f5f-c2e4d5cd61b9 admin admin] PATH_INFO: `/v3/users/a0dd07c2faa54544b747262134c56610` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.073382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa262f-6446-4526-8f5f-c2e4d5cd61b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0dd07c2faa54544b747262134c56610)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:13.075637 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa262f-6446-4526-8f5f-c2e4d5cd61b9 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:13.086452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1000/2020] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:13.086452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4a13b-7cae-40f2-8f2f-b8a3ddf5e6c8 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.086452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4a13b-7cae-40f2-8f2f-b8a3ddf5e6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.086452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4a13b-7cae-40f2-8f2f-b8a3ddf5e6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.115142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c3d4a13b-7cae-40f2-8f2f-b8a3ddf5e6c8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:13.117328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c3d4a13b-7cae-40f2-8f2f-b8a3ddf5e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.130203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1001/2021] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:13.131291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4a13b-7cae-40f2-8f2f-b8a3ddf5e6c8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:13.133244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c3d4a13b-7cae-40f2-8f2f-b8a3ddf5e6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.151112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4a13b-7cae-40f2-8f2f-b8a3ddf5e6c8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:13.156759 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d44c6-e010-43c8-82d6-125de523449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:13.157587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d44c6-e010-43c8-82d6-125de523449e admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.157950 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d44c6-e010-43c8-82d6-125de523449e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.158303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d44c6-e010-43c8-82d6-125de523449e admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.160064 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d44c6-e010-43c8-82d6-125de523449e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:13.162262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d44c6-e010-43c8-82d6-125de523449e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:13.175370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1002/2022] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:13.177258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c56cf-991c-4685-93c6-0f385cd44f05 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.177595 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c56cf-991c-4685-93c6-0f385cd44f05 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.177869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c56cf-991c-4685-93c6-0f385cd44f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.198827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b12c56cf-991c-4685-93c6-0f385cd44f05 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:13.199675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b12c56cf-991c-4685-93c6-0f385cd44f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.209414 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1003/2023] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:13.210408 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c56cf-991c-4685-93c6-0f385cd44f05 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:13.223509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c56cf-991c-4685-93c6-0f385cd44f05 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:13.230445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ed23a-6003-4f4c-b1f9-6ea08faec132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:13.231609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ed23a-6003-4f4c-b1f9-6ea08faec132 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.231970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ed23a-6003-4f4c-b1f9-6ea08faec132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.232248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ed23a-6003-4f4c-b1f9-6ea08faec132 admin admin] PATH_INFO: `/v3/projects/4f1f5c0ce28a44c1bee9f262f648d69d/users/bcc7c2d5507c4f93afc59c8f5604eb24/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.250003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ed23a-6003-4f4c-b1f9-6ea08faec132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1f5c0ce28a44c1bee9f262f648d69d, user_id=bcc7c2d5507c4f93afc59c8f5604eb24, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:13.252891 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ed23a-6003-4f4c-b1f9-6ea08faec132 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:13.402398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-57aa262f-6446-4526-8f5f-c2e4d5cd61b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0dd07c2faa54544b747262134c56610'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.416478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-57aa262f-6446-4526-8f5f-c2e4d5cd61b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0dd07c2faa54544b747262134c56610'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.487025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-57aa262f-6446-4526-8f5f-c2e4d5cd61b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0dd07c2faa54544b747262134c56610'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.489209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-57aa262f-6446-4526-8f5f-c2e4d5cd61b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0dd07c2faa54544b747262134c56610'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.489859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-57aa262f-6446-4526-8f5f-c2e4d5cd61b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0dd07c2faa54544b747262134c56610'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:13.498701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1004/2024] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:13 2022] PUT /identity/v3/projects/4f1f5c0ce28a44c1bee9f262f648d69d/users/bcc7c2d5507c4f93afc59c8f5604eb24/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:13.498701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ed23a-6003-4f4c-b1f9-6ea08faec132 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:13.501481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d45ed23a-6003-4f4c-b1f9-6ea08faec132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.514196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1021/2025] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:12 2022] DELETE /identity/v3/users/a0dd07c2faa54544b747262134c56610 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:13.514196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba893553-bdc3-41d3-931a-249939294e8b None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.514196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba893553-bdc3-41d3-931a-249939294e8b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.514196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba893553-bdc3-41d3-931a-249939294e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.536718 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ba893553-bdc3-41d3-931a-249939294e8b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:13.538011 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ba893553-bdc3-41d3-931a-249939294e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.626670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ed23a-6003-4f4c-b1f9-6ea08faec132 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:13.632734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e1b5e-179e-44da-8529-61deeae63663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:13.633683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1b5e-179e-44da-8529-61deeae63663 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.634143 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1b5e-179e-44da-8529-61deeae63663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.634574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e1b5e-179e-44da-8529-61deeae63663 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.635569 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e1b5e-179e-44da-8529-61deeae63663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:13.635882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e1b5e-179e-44da-8529-61deeae63663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:13.637703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e1b5e-179e-44da-8529-61deeae63663 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:13.640894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1022/2026] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:13.642435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff8597-5c8f-4c4c-b3a4-7150d97477ef None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.642738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff8597-5c8f-4c4c-b3a4-7150d97477ef None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.643020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff8597-5c8f-4c4c-b3a4-7150d97477ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.657590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1005/2027] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:13.658400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e1b5e-179e-44da-8529-61deeae63663 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:13.660325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-198e1b5e-179e-44da-8529-61deeae63663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.676405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-19ff8597-5c8f-4c4c-b3a4-7150d97477ef None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:13.677938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-19ff8597-5c8f-4c4c-b3a4-7150d97477ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.691474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1023/2028] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:13.693005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff8597-5c8f-4c4c-b3a4-7150d97477ef None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:13.726203 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff8597-5c8f-4c4c-b3a4-7150d97477ef None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:13.736595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06f5cf-74a6-48b5-ac60-11abb808e607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:13.737320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06f5cf-74a6-48b5-ac60-11abb808e607 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.737602 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06f5cf-74a6-48b5-ac60-11abb808e607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.737931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06f5cf-74a6-48b5-ac60-11abb808e607 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.738641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06f5cf-74a6-48b5-ac60-11abb808e607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:13.740884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06f5cf-74a6-48b5-ac60-11abb808e607 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:13.759437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e1b5e-179e-44da-8529-61deeae63663 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:13.763407 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd14e9-7c82-4a46-87a2-36b1bbdaa390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:13.764175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd14e9-7c82-4a46-87a2-36b1bbdaa390 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.764357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd14e9-7c82-4a46-87a2-36b1bbdaa390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.764635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd14e9-7c82-4a46-87a2-36b1bbdaa390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.775201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd14e9-7c82-4a46-87a2-36b1bbdaa390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:13.777286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd14e9-7c82-4a46-87a2-36b1bbdaa390 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:13.787923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1006/2029] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:13.788553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd14e9-7c82-4a46-87a2-36b1bbdaa390 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:13.790079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d2cd14e9-7c82-4a46-87a2-36b1bbdaa390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.803886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd14e9-7c82-4a46-87a2-36b1bbdaa390 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:13.808111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ec358-bc84-4131-aad6-64d362e38ed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:13.808762 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec358-bc84-4131-aad6-64d362e38ed5 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:13.809084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec358-bc84-4131-aad6-64d362e38ed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:13.809366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ec358-bc84-4131-aad6-64d362e38ed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:13.819481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ec358-bc84-4131-aad6-64d362e38ed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:13.821565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ec358-bc84-4131-aad6-64d362e38ed5 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:13.835071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1007/2030] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:13.835735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ec358-bc84-4131-aad6-64d362e38ed5 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:13.837119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c34ec358-bc84-4131-aad6-64d362e38ed5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:13.886284 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1024/2031] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:13 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:13.890954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06f5cf-74a6-48b5-ac60-11abb808e607 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:13.892180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ec358-bc84-4131-aad6-64d362e38ed5 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:13.901704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:14.053148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06f5cf-74a6-48b5-ac60-11abb808e607 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.055031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.055858 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.056221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.056547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] PATH_INFO: `/v3/projects/b5da114168974e1d9bd9c7438e946a62` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.057933 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5da114168974e1d9bd9c7438e946a62)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.059006 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49513a9b-5c98-45cf-99ce-04e5cdcc7622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.059935 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49513a9b-5c98-45cf-99ce-04e5cdcc7622 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.060044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.060670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49513a9b-5c98-45cf-99ce-04e5cdcc7622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.061186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49513a9b-5c98-45cf-99ce-04e5cdcc7622 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.062102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49513a9b-5c98-45cf-99ce-04e5cdcc7622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.064329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49513a9b-5c98-45cf-99ce-04e5cdcc7622 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.222143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1025/2032] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:13 2022] POST /identity/v3/users => generated 289 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:14.223868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49513a9b-5c98-45cf-99ce-04e5cdcc7622 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.239054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49513a9b-5c98-45cf-99ce-04e5cdcc7622 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.246180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5da114168974e1d9bd9c7438e946a62', 'request_id': 'req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.300508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a3368-aaab-4b2f-96df-1736a08157f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.301206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a3368-aaab-4b2f-96df-1736a08157f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.301584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a3368-aaab-4b2f-96df-1736a08157f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.301797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683a3368-aaab-4b2f-96df-1736a08157f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.302493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a3368-aaab-4b2f-96df-1736a08157f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.304103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683a3368-aaab-4b2f-96df-1736a08157f0 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.314623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1026/2033] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:14.318186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a3368-aaab-4b2f-96df-1736a08157f0 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.319766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5da114168974e1d9bd9c7438e946a62', 'request_id': 'req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.327238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5da114168974e1d9bd9c7438e946a62', 'request_id': 'req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.341153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683a3368-aaab-4b2f-96df-1736a08157f0 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.347740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] The token cache is being invalidate because project b5da114168974e1d9bd9c7438e946a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:14.348035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.348432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fdac2-c212-4ff0-ba38-905da7d74253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.348771 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.349592 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fdac2-c212-4ff0-ba38-905da7d74253 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.350076 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fdac2-c212-4ff0-ba38-905da7d74253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.350452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fdac2-c212-4ff0-ba38-905da7d74253 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.350813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1008/2034] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:13 2022] DELETE /identity/v3/projects/b5da114168974e1d9bd9c7438e946a62 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:14.353472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fdac2-c212-4ff0-ba38-905da7d74253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.359982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.360433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fdac2-c212-4ff0-ba38-905da7d74253 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.360624 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:14.370909 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1027/2035] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:14.372971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1933bdf-dd22-4a06-bb3d-5df7c49bdb13 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.375459 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fdac2-c212-4ff0-ba38-905da7d74253 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.377542 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1f3fdac2-c212-4ff0-ba38-905da7d74253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:14.380344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c83334-b793-4eae-9220-5968ebf809a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.381457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c83334-b793-4eae-9220-5968ebf809a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.381812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c83334-b793-4eae-9220-5968ebf809a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.382205 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c83334-b793-4eae-9220-5968ebf809a7 admin admin] PATH_INFO: `/v3/users/771a8e10ca2e448a9a627ef6cd3541c0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.383530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c83334-b793-4eae-9220-5968ebf809a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=771a8e10ca2e448a9a627ef6cd3541c0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.387068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c83334-b793-4eae-9220-5968ebf809a7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.402032 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fdac2-c212-4ff0-ba38-905da7d74253 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.407558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f28b39-c89c-4e75-b75f-80a00b0addea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.408483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f28b39-c89c-4e75-b75f-80a00b0addea admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.408776 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f28b39-c89c-4e75-b75f-80a00b0addea admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.409089 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f28b39-c89c-4e75-b75f-80a00b0addea admin admin] PATH_INFO: `/v3/projects/cc633b77aa0f4e5389931010cfcec829/users/a307115d2e1b404ab2154a30b16e7a03/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.429116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f28b39-c89c-4e75-b75f-80a00b0addea admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc633b77aa0f4e5389931010cfcec829, user_id=a307115d2e1b404ab2154a30b16e7a03, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.432615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f28b39-c89c-4e75-b75f-80a00b0addea admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.451816 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:14.516287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1028/2036] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:14 2022] PUT /identity/v3/projects/cc633b77aa0f4e5389931010cfcec829/users/a307115d2e1b404ab2154a30b16e7a03/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:14.517288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f28b39-c89c-4e75-b75f-80a00b0addea admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.518923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-59f28b39-c89c-4e75-b75f-80a00b0addea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:14.599663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f28b39-c89c-4e75-b75f-80a00b0addea admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:14.606807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:14.607697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.607977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.608252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] PATH_INFO: `/v3/projects/949d6e1ab67c4b62b2ef049b9d37d48c` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.609487 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] RBAC: Authorizing `identity:delete_project(project_id=949d6e1ab67c4b62b2ef049b9d37d48c)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:14.611432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:14.677610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b5c83334-b793-4eae-9220-5968ebf809a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '771a8e10ca2e448a9a627ef6cd3541c0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.690606 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b5c83334-b793-4eae-9220-5968ebf809a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '771a8e10ca2e448a9a627ef6cd3541c0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.772000 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949d6e1ab67c4b62b2ef049b9d37d48c', 'request_id': 'req-195e870e-e1aa-4ddf-b378-036e6c7e4396'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.838891 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b5c83334-b793-4eae-9220-5968ebf809a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '771a8e10ca2e448a9a627ef6cd3541c0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.839937 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b5c83334-b793-4eae-9220-5968ebf809a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '771a8e10ca2e448a9a627ef6cd3541c0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.840492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b5c83334-b793-4eae-9220-5968ebf809a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '771a8e10ca2e448a9a627ef6cd3541c0'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.857243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1009/2037] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:14 2022] DELETE /identity/v3/users/771a8e10ca2e448a9a627ef6cd3541c0 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:14.863589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab019d-58c1-47c4-90d8-6731d332844c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:14.863589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab019d-58c1-47c4-90d8-6731d332844c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:14.863589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab019d-58c1-47c4-90d8-6731d332844c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:14.894387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d5ab019d-58c1-47c4-90d8-6731d332844c None None] MFA Rules not processed for user `a307115d2e1b404ab2154a30b16e7a03`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:14.896385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d5ab019d-58c1-47c4-90d8-6731d332844c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:14.974976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1010/2038] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:14.980676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab019d-58c1-47c4-90d8-6731d332844c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:14.982121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d5ab019d-58c1-47c4-90d8-6731d332844c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:14.986291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949d6e1ab67c4b62b2ef049b9d37d48c', 'request_id': 'req-195e870e-e1aa-4ddf-b378-036e6c7e4396'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:14.994938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949d6e1ab67c4b62b2ef049b9d37d48c', 'request_id': 'req-195e870e-e1aa-4ddf-b378-036e6c7e4396'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.014858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] The token cache is being invalidate because project 949d6e1ab67c4b62b2ef049b9d37d48c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:15.015158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.016653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.019726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1029/2039] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:14 2022] DELETE /identity/v3/projects/949d6e1ab67c4b62b2ef049b9d37d48c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:15.024373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:15.027377 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:15.113161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab019d-58c1-47c4-90d8-6731d332844c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:15.127268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10e22f-92a9-483e-94a9-4551c008fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:15.128057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10e22f-92a9-483e-94a9-4551c008fb4b admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.128457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10e22f-92a9-483e-94a9-4551c008fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.130019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10e22f-92a9-483e-94a9-4551c008fb4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.130848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10e22f-92a9-483e-94a9-4551c008fb4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:15.133008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10e22f-92a9-483e-94a9-4551c008fb4b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:15.159734 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e870e-e1aa-4ddf-b378-036e6c7e4396 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:15.167369 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:15.168946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.169602 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.169717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] PATH_INFO: `/v3/users/55fe5bbc0264473f8fffa58e970ee5fc` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.171061 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=55fe5bbc0264473f8fffa58e970ee5fc)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:15.173251 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:15.270567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1011/2040] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:14 2022] POST /identity/v3/projects => generated 377 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:15.274576 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10e22f-92a9-483e-94a9-4551c008fb4b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:15.276664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0f10e22f-92a9-483e-94a9-4551c008fb4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:15.419864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10e22f-92a9-483e-94a9-4551c008fb4b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:15.435415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460010a-fc06-434c-a502-39f3559e627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:15.436303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460010a-fc06-434c-a502-39f3559e627a admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.436597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460010a-fc06-434c-a502-39f3559e627a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.437110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460010a-fc06-434c-a502-39f3559e627a admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.438373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460010a-fc06-434c-a502-39f3559e627a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:15.441533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460010a-fc06-434c-a502-39f3559e627a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:15.518783 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55fe5bbc0264473f8fffa58e970ee5fc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.534521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55fe5bbc0264473f8fffa58e970ee5fc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.607654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1012/2041] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:15 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:15.611580 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460010a-fc06-434c-a502-39f3559e627a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:15.622704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460010a-fc06-434c-a502-39f3559e627a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:15.629044 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55fe5bbc0264473f8fffa58e970ee5fc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.629509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d76062-4034-462e-88b4-33c7028b270e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:15.630524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55fe5bbc0264473f8fffa58e970ee5fc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.631423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55fe5bbc0264473f8fffa58e970ee5fc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:15.642935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d76062-4034-462e-88b4-33c7028b270e admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.644999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d76062-4034-462e-88b4-33c7028b270e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.645544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d76062-4034-462e-88b4-33c7028b270e admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.646316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d76062-4034-462e-88b4-33c7028b270e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:15.647941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d76062-4034-462e-88b4-33c7028b270e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:15.657979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1030/2042] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:15 2022] DELETE /identity/v3/users/55fe5bbc0264473f8fffa58e970ee5fc => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:15.659413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:15.660999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:15.671638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1013/2043] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:15.675992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d76062-4034-462e-88b4-33c7028b270e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:15.684021 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e7d76062-4034-462e-88b4-33c7028b270e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:15.709051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d76062-4034-462e-88b4-33c7028b270e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:15.763463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c3c26-3ff2-4fb3-8b30-95284fefeafc admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:15.780943 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91b9b7-a5ea-4e78-bd51-fceecb528542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:15.782711 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91b9b7-a5ea-4e78-bd51-fceecb528542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.783450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91b9b7-a5ea-4e78-bd51-fceecb528542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.783944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91b9b7-a5ea-4e78-bd51-fceecb528542 admin admin] PATH_INFO: `/v3/projects/513e21a5352d4b8b8be2bc239e71cee2` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.786352 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91b9b7-a5ea-4e78-bd51-fceecb528542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=513e21a5352d4b8b8be2bc239e71cee2)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:15.789410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91b9b7-a5ea-4e78-bd51-fceecb528542 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:15.796248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b08a72-8865-4ad3-a053-f7843c01b5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:15.797061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b08a72-8865-4ad3-a053-f7843c01b5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.801142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b08a72-8865-4ad3-a053-f7843c01b5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.801142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b08a72-8865-4ad3-a053-f7843c01b5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.801142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b08a72-8865-4ad3-a053-f7843c01b5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:15.801142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b08a72-8865-4ad3-a053-f7843c01b5c2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:15.816272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1014/2044] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:15.817720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b08a72-8865-4ad3-a053-f7843c01b5c2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:15.829348 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b08a72-8865-4ad3-a053-f7843c01b5c2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:15.835471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3eec7-8fff-4221-9387-a449d1402da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:15.835471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3eec7-8fff-4221-9387-a449d1402da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:15.835849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3eec7-8fff-4221-9387-a449d1402da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:15.835849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3eec7-8fff-4221-9387-a449d1402da9 admin admin] PATH_INFO: `/v3/projects/dd2b1a997ee94e39af4fee685d10a702/users/09e04b34393640c9bbe698ce459239ce/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:15.854555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3eec7-8fff-4221-9387-a449d1402da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2b1a997ee94e39af4fee685d10a702, user_id=09e04b34393640c9bbe698ce459239ce, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:15.861366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3eec7-8fff-4221-9387-a449d1402da9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.016362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-bb91b9b7-a5ea-4e78-bd51-fceecb528542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513e21a5352d4b8b8be2bc239e71cee2', 'request_id': 'req-bb91b9b7-a5ea-4e78-bd51-fceecb528542'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:16.029544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1015/2045] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:15 2022] PUT /identity/v3/projects/dd2b1a997ee94e39af4fee685d10a702/users/09e04b34393640c9bbe698ce459239ce/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:16.032032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f688e-b1d5-4bee-aff4-840ee207c215 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.033918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f688e-b1d5-4bee-aff4-840ee207c215 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.034216 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f688e-b1d5-4bee-aff4-840ee207c215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.106548 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-725f688e-b1d5-4bee-aff4-840ee207c215 None None] MFA Rules not processed for user `09e04b34393640c9bbe698ce459239ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:16.107960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-725f688e-b1d5-4bee-aff4-840ee207c215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.108421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-bb91b9b7-a5ea-4e78-bd51-fceecb528542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513e21a5352d4b8b8be2bc239e71cee2', 'request_id': 'req-bb91b9b7-a5ea-4e78-bd51-fceecb528542'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:16.117252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-bb91b9b7-a5ea-4e78-bd51-fceecb528542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513e21a5352d4b8b8be2bc239e71cee2', 'request_id': 'req-bb91b9b7-a5ea-4e78-bd51-fceecb528542'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:16.135817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-bb91b9b7-a5ea-4e78-bd51-fceecb528542 admin admin] The token cache is being invalidate because project 513e21a5352d4b8b8be2bc239e71cee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:16.136305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-bb91b9b7-a5ea-4e78-bd51-fceecb528542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:16.137061 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-bb91b9b7-a5ea-4e78-bd51-fceecb528542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:16.138694 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1031/2046] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:15 2022] DELETE /identity/v3/projects/513e21a5352d4b8b8be2bc239e71cee2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:16.143746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6da80-1d19-44f2-a297-8e31be5531c0 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.144410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6da80-1d19-44f2-a297-8e31be5531c0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.144410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6da80-1d19-44f2-a297-8e31be5531c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.172144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-c0d6da80-1d19-44f2-a297-8e31be5531c0 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:16.177175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c0d6da80-1d19-44f2-a297-8e31be5531c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.240589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1016/2047] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:16.240589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5ba42-3c97-4c87-8ff2-2ce7c6c59521 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.242689 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5ba42-3c97-4c87-8ff2-2ce7c6c59521 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.243084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5ba42-3c97-4c87-8ff2-2ce7c6c59521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.281072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-01d5ba42-3c97-4c87-8ff2-2ce7c6c59521 None None] MFA Rules not processed for user `bcc7c2d5507c4f93afc59c8f5604eb24`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:16.282596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-01d5ba42-3c97-4c87-8ff2-2ce7c6c59521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.304839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1032/2048] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:16.306353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6da80-1d19-44f2-a297-8e31be5531c0 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.313618 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c0d6da80-1d19-44f2-a297-8e31be5531c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.335485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6da80-1d19-44f2-a297-8e31be5531c0 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.341257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ee600-f725-40fc-8762-a62f5badd8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.341961 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ee600-f725-40fc-8762-a62f5badd8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.342250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ee600-f725-40fc-8762-a62f5badd8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.342528 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ee600-f725-40fc-8762-a62f5badd8c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.343376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ee600-f725-40fc-8762-a62f5badd8c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.345352 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ee600-f725-40fc-8762-a62f5badd8c6 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.361136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:16.391236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1017/2049] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:16.393599 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973042c-0779-410b-8a75-87bd893138e7 None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.394100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973042c-0779-410b-8a75-87bd893138e7 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.394519 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973042c-0779-410b-8a75-87bd893138e7 None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.404457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1018/2050] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:13:16 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:13:16.405986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e1601-203b-4a45-90cc-ec46ec0ac225 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.406473 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e1601-203b-4a45-90cc-ec46ec0ac225 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.406751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e1601-203b-4a45-90cc-ec46ec0ac225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.430681 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e67e1601-203b-4a45-90cc-ec46ec0ac225 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:16.432661 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e67e1601-203b-4a45-90cc-ec46ec0ac225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.442266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1019/2051] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:16.443026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e1601-203b-4a45-90cc-ec46ec0ac225 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.446964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e67e1601-203b-4a45-90cc-ec46ec0ac225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.455450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1033/2052] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:16 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:16.461351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a990b-33a5-4623-b42d-4af034583a89 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.461351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a990b-33a5-4623-b42d-4af034583a89 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.461351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038a990b-33a5-4623-b42d-4af034583a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.478255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-038a990b-33a5-4623-b42d-4af034583a89 None None] MFA Rules not processed for user `69b5745bfb5d4e6ca172bb8fab229e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:16.479851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-038a990b-33a5-4623-b42d-4af034583a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.533890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e1601-203b-4a45-90cc-ec46ec0ac225 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.568639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1034/2053] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:13:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:16.573726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a990b-33a5-4623-b42d-4af034583a89 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.593145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80139b-f15d-4dd8-9354-84bb1b029748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.593807 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80139b-f15d-4dd8-9354-84bb1b029748 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.594092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80139b-f15d-4dd8-9354-84bb1b029748 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.594493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80139b-f15d-4dd8-9354-84bb1b029748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.637443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038a990b-33a5-4623-b42d-4af034583a89 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.642185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa5666-9cc5-4bfb-8f82-a8acbdd3a32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.642847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa5666-9cc5-4bfb-8f82-a8acbdd3a32d admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.643127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa5666-9cc5-4bfb-8f82-a8acbdd3a32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.643401 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa5666-9cc5-4bfb-8f82-a8acbdd3a32d admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.644190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa5666-9cc5-4bfb-8f82-a8acbdd3a32d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:16.644443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa5666-9cc5-4bfb-8f82-a8acbdd3a32d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.646338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa5666-9cc5-4bfb-8f82-a8acbdd3a32d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.653650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80139b-f15d-4dd8-9354-84bb1b029748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.655120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80139b-f15d-4dd8-9354-84bb1b029748 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.659185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1035/2054] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:16.663580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa5666-9cc5-4bfb-8f82-a8acbdd3a32d admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.667017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1020/2055] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:16.667993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80139b-f15d-4dd8-9354-84bb1b029748 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.669470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3e80139b-f15d-4dd8-9354-84bb1b029748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.675216 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa5666-9cc5-4bfb-8f82-a8acbdd3a32d admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.679953 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971cb20-e125-4038-8683-8404c491932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.680627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971cb20-e125-4038-8683-8404c491932c admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.680950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971cb20-e125-4038-8683-8404c491932c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.681233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971cb20-e125-4038-8683-8404c491932c admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.682489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971cb20-e125-4038-8683-8404c491932c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.684431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971cb20-e125-4038-8683-8404c491932c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.685992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80139b-f15d-4dd8-9354-84bb1b029748 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.696469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.696469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.696469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.696469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] PATH_INFO: `/v3/users/49262765416243a0be91135df74ec914` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.698900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=49262765416243a0be91135df74ec914)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.701383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.777491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:16.840862 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1036/2056] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:16 2022] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:16.840862 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971cb20-e125-4038-8683-8404c491932c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.841958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-a971cb20-e125-4038-8683-8404c491932c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:16.856493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971cb20-e125-4038-8683-8404c491932c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.862231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8304984-e5e7-4ca3-9721-fe4cc63e1efd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b5745bfb5d4e6ca172bb8fab229e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.862931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8304984-e5e7-4ca3-9721-fe4cc63e1efd service placement] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.863258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8304984-e5e7-4ca3-9721-fe4cc63e1efd service placement] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.868555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8304984-e5e7-4ca3-9721-fe4cc63e1efd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.873218 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8304984-e5e7-4ca3-9721-fe4cc63e1efd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.875668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8304984-e5e7-4ca3-9721-fe4cc63e1efd service placement] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.887223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1037/2057] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:16.887998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8304984-e5e7-4ca3-9721-fe4cc63e1efd service placement] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:16.898419 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8304984-e5e7-4ca3-9721-fe4cc63e1efd service placement] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:16.903462 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335995a-7c68-494b-a899-62604c4c4544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:16.904114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335995a-7c68-494b-a899-62604c4c4544 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:16.904401 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335995a-7c68-494b-a899-62604c4c4544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:16.904687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5335995a-7c68-494b-a899-62604c4c4544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:16.905693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335995a-7c68-494b-a899-62604c4c4544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:16.907612 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5335995a-7c68-494b-a899-62604c4c4544 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:16.953860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49262765416243a0be91135df74ec914'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:16.965421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49262765416243a0be91135df74ec914'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.022627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49262765416243a0be91135df74ec914'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.033959 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49262765416243a0be91135df74ec914'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.033959 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49262765416243a0be91135df74ec914'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.034169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1038/2058] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:16 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:17.034169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335995a-7c68-494b-a899-62604c4c4544 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.035523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5335995a-7c68-494b-a899-62604c4c4544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:17.037398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1021/2059] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:16 2022] DELETE /identity/v3/users/49262765416243a0be91135df74ec914 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:17.038271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.039564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:17.108677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5335995a-7c68-494b-a899-62604c4c4544 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.109482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cddf04-3dfb-4bb2-b1e9-4bd289f5c61c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.115608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.123475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9b69f-5db2-46b7-9517-b97cd5dd8c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.123475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9b69f-5db2-46b7-9517-b97cd5dd8c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.123475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9b69f-5db2-46b7-9517-b97cd5dd8c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.123475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9b69f-5db2-46b7-9517-b97cd5dd8c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.123908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.123908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.123908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] PATH_INFO: `/v3/projects/9478320d1f2248b38d0cdfa97ecfd04d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.124138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9b69f-5db2-46b7-9517-b97cd5dd8c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.124237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9478320d1f2248b38d0cdfa97ecfd04d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.124323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9b69f-5db2-46b7-9517-b97cd5dd8c66 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.124439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.132941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1022/2060] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:17.137433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9b69f-5db2-46b7-9517-b97cd5dd8c66 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.139253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-83f9b69f-5db2-46b7-9517-b97cd5dd8c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:17.158130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9b69f-5db2-46b7-9517-b97cd5dd8c66 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.158397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d88cb-73e1-42cd-a5b1-5f0e77a6668e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.159080 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d88cb-73e1-42cd-a5b1-5f0e77a6668e admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.159361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d88cb-73e1-42cd-a5b1-5f0e77a6668e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.159635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d88cb-73e1-42cd-a5b1-5f0e77a6668e admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.160327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d88cb-73e1-42cd-a5b1-5f0e77a6668e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.162297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6d88cb-73e1-42cd-a5b1-5f0e77a6668e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.241848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1023/2061] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:17 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:17.242756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d88cb-73e1-42cd-a5b1-5f0e77a6668e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.260273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6d88cb-73e1-42cd-a5b1-5f0e77a6668e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.260490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9478320d1f2248b38d0cdfa97ecfd04d', 'request_id': 'req-b563ed8b-31dd-4324-8714-a840a6b0e21d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.315072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b64ca-80d1-48af-8106-d64f236991a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.315968 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b64ca-80d1-48af-8106-d64f236991a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.316251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b64ca-80d1-48af-8106-d64f236991a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.316527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b64ca-80d1-48af-8106-d64f236991a0 admin admin] PATH_INFO: `/v3/projects/7f4446f2521c41d4906fed2889c7c8dd/users/b2d948db7e5e4dbe97df764e37a2d548/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.331111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9478320d1f2248b38d0cdfa97ecfd04d', 'request_id': 'req-b563ed8b-31dd-4324-8714-a840a6b0e21d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.339995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b64ca-80d1-48af-8106-d64f236991a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4446f2521c41d4906fed2889c7c8dd, user_id=b2d948db7e5e4dbe97df764e37a2d548, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.341615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9478320d1f2248b38d0cdfa97ecfd04d', 'request_id': 'req-b563ed8b-31dd-4324-8714-a840a6b0e21d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.342921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b64ca-80d1-48af-8106-d64f236991a0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.361461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] The token cache is being invalidate because project 9478320d1f2248b38d0cdfa97ecfd04d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:17.361787 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.364267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.364858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1039/2062] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:17 2022] DELETE /identity/v3/projects/9478320d1f2248b38d0cdfa97ecfd04d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:17.365841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.369585 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:17.383045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563ed8b-31dd-4324-8714-a840a6b0e21d admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.388580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fe719-020f-4395-a5ee-f0fd489b8afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.389282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fe719-020f-4395-a5ee-f0fd489b8afb admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.389570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fe719-020f-4395-a5ee-f0fd489b8afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.389852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894fe719-020f-4395-a5ee-f0fd489b8afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.390599 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fe719-020f-4395-a5ee-f0fd489b8afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.392216 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894fe719-020f-4395-a5ee-f0fd489b8afb admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.404033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1040/2063] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:17.405721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fe719-020f-4395-a5ee-f0fd489b8afb admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.407558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-894fe719-020f-4395-a5ee-f0fd489b8afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:17.421500 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894fe719-020f-4395-a5ee-f0fd489b8afb admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.428329 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1024/2064] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:17 2022] PUT /identity/v3/projects/7f4446f2521c41d4906fed2889c7c8dd/users/b2d948db7e5e4dbe97df764e37a2d548/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:17.432436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88e184-694a-4ce9-ba83-c0e022bd9da6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.432436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88e184-694a-4ce9-ba83-c0e022bd9da6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.432436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb88e184-694a-4ce9-ba83-c0e022bd9da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.469117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fb88e184-694a-4ce9-ba83-c0e022bd9da6 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:17.470371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fb88e184-694a-4ce9-ba83-c0e022bd9da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:17.481402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09e513-a35f-4627-b43d-1bcc0500a10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.482293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09e513-a35f-4627-b43d-1bcc0500a10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.482574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09e513-a35f-4627-b43d-1bcc0500a10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.482853 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09e513-a35f-4627-b43d-1bcc0500a10d admin admin] PATH_INFO: `/v3/projects/ca4ec99d0138476e9232c9b026041966` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.484306 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09e513-a35f-4627-b43d-1bcc0500a10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4ec99d0138476e9232c9b026041966)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.486536 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09e513-a35f-4627-b43d-1bcc0500a10d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.542921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1025/2065] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:17.543581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88e184-694a-4ce9-ba83-c0e022bd9da6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.552969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb88e184-694a-4ce9-ba83-c0e022bd9da6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.558495 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7addd-e076-4fa5-bf6f-1d69dfa5d9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.559160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7addd-e076-4fa5-bf6f-1d69dfa5d9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.559447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7addd-e076-4fa5-bf6f-1d69dfa5d9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.559727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7addd-e076-4fa5-bf6f-1d69dfa5d9a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.560463 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7addd-e076-4fa5-bf6f-1d69dfa5d9a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.562099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7addd-e076-4fa5-bf6f-1d69dfa5d9a1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.572189 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1026/2066] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:17.573022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7addd-e076-4fa5-bf6f-1d69dfa5d9a1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.574788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d6f7addd-e076-4fa5-bf6f-1d69dfa5d9a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:17.587302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7addd-e076-4fa5-bf6f-1d69dfa5d9a1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.592467 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b98a3f-a8f5-47a0-93c9-afa7c89073c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.593171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b98a3f-a8f5-47a0-93c9-afa7c89073c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.593456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b98a3f-a8f5-47a0-93c9-afa7c89073c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.593734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b98a3f-a8f5-47a0-93c9-afa7c89073c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.594525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b98a3f-a8f5-47a0-93c9-afa7c89073c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.596161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b98a3f-a8f5-47a0-93c9-afa7c89073c6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.609637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1027/2067] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:17.609637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659cbcb-60a3-48c7-acca-d8875d8aa8ee None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.609637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659cbcb-60a3-48c7-acca-d8875d8aa8ee None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.609637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659cbcb-60a3-48c7-acca-d8875d8aa8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.626853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9659cbcb-60a3-48c7-acca-d8875d8aa8ee None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:17.628065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9659cbcb-60a3-48c7-acca-d8875d8aa8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:17.636714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1028/2068] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:17.637510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659cbcb-60a3-48c7-acca-d8875d8aa8ee None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.649597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659cbcb-60a3-48c7-acca-d8875d8aa8ee None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.658562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd683b-e95d-4307-bc79-556093dc2f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.658562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd683b-e95d-4307-bc79-556093dc2f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.658562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd683b-e95d-4307-bc79-556093dc2f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.658562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd683b-e95d-4307-bc79-556093dc2f12 admin admin] PATH_INFO: `/v3/projects/6cf6804abe4b4dd9a44a8d2ad4964ceb/users/f07f54d82e8c4d3c82feb643e6a9c089/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.671419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd683b-e95d-4307-bc79-556093dc2f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf6804abe4b4dd9a44a8d2ad4964ceb, user_id=f07f54d82e8c4d3c82feb643e6a9c089, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.674078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd683b-e95d-4307-bc79-556093dc2f12 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.767262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1029/2069] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:17 2022] PUT /identity/v3/projects/6cf6804abe4b4dd9a44a8d2ad4964ceb/users/f07f54d82e8c4d3c82feb643e6a9c089/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:17.767262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd683b-e95d-4307-bc79-556093dc2f12 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.773237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7a09e513-a35f-4627-b43d-1bcc0500a10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4ec99d0138476e9232c9b026041966', 'request_id': 'req-7a09e513-a35f-4627-b43d-1bcc0500a10d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.814950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:17.830208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd683b-e95d-4307-bc79-556093dc2f12 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.834986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cfd18-4520-426e-8199-cefb29bb2034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.836243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cfd18-4520-426e-8199-cefb29bb2034 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.836243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cfd18-4520-426e-8199-cefb29bb2034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.836412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cfd18-4520-426e-8199-cefb29bb2034 admin admin] PATH_INFO: `/v3/projects/7f4446f2521c41d4906fed2889c7c8dd/users/b2d948db7e5e4dbe97df764e37a2d548/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.839122 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cfd18-4520-426e-8199-cefb29bb2034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f4446f2521c41d4906fed2889c7c8dd, user_id=b2d948db7e5e4dbe97df764e37a2d548, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.841847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719cfd18-4520-426e-8199-cefb29bb2034 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.851992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1030/2070] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:17 2022] PUT /identity/v3/projects/7f4446f2521c41d4906fed2889c7c8dd/users/b2d948db7e5e4dbe97df764e37a2d548/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:17.852869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cfd18-4520-426e-8199-cefb29bb2034 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:17.880008 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7a09e513-a35f-4627-b43d-1bcc0500a10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4ec99d0138476e9232c9b026041966', 'request_id': 'req-7a09e513-a35f-4627-b43d-1bcc0500a10d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.887897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7a09e513-a35f-4627-b43d-1bcc0500a10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4ec99d0138476e9232c9b026041966', 'request_id': 'req-7a09e513-a35f-4627-b43d-1bcc0500a10d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.899292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7a09e513-a35f-4627-b43d-1bcc0500a10d admin admin] The token cache is being invalidate because project ca4ec99d0138476e9232c9b026041966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:17.899615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7a09e513-a35f-4627-b43d-1bcc0500a10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.900921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7a09e513-a35f-4627-b43d-1bcc0500a10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:17.902489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1041/2071] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:17 2022] DELETE /identity/v3/projects/ca4ec99d0138476e9232c9b026041966 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:17.906001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d0c80-833f-4442-804e-e95e7142e985 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.906001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d0c80-833f-4442-804e-e95e7142e985 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.906001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d0c80-833f-4442-804e-e95e7142e985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.924875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cfd18-4520-426e-8199-cefb29bb2034 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:17.929462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793b740-b8b2-41b9-b8f4-ed1b965d3c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:17.930224 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793b740-b8b2-41b9-b8f4-ed1b965d3c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.930440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793b740-b8b2-41b9-b8f4-ed1b965d3c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.930715 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793b740-b8b2-41b9-b8f4-ed1b965d3c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.931106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-0c1d0c80-833f-4442-804e-e95e7142e985 None None] MFA Rules not processed for user `f07f54d82e8c4d3c82feb643e6a9c089`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:17.931549 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793b740-b8b2-41b9-b8f4-ed1b965d3c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:17.932391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0c1d0c80-833f-4442-804e-e95e7142e985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:17.932685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793b740-b8b2-41b9-b8f4-ed1b965d3c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:17.934323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793b740-b8b2-41b9-b8f4-ed1b965d3c50 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:17.946440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1031/2072] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:17.949032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d235a-430a-4aaa-b8de-d5f49ed8ae15 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:17.949347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d235a-430a-4aaa-b8de-d5f49ed8ae15 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:17.949628 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d235a-430a-4aaa-b8de-d5f49ed8ae15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:17.975539 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-203d235a-430a-4aaa-b8de-d5f49ed8ae15 None None] MFA Rules not processed for user `b2d948db7e5e4dbe97df764e37a2d548`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:17.976760 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-203d235a-430a-4aaa-b8de-d5f49ed8ae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.001183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1042/2073] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:18.002570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d2c0d-0f78-4541-be88-1f4456d00b49 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.002778 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d2c0d-0f78-4541-be88-1f4456d00b49 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.003029 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294d2c0d-0f78-4541-be88-1f4456d00b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.023121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-294d2c0d-0f78-4541-be88-1f4456d00b49 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:18.026488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-294d2c0d-0f78-4541-be88-1f4456d00b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.033081 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1043/2074] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:18.033654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d2c0d-0f78-4541-be88-1f4456d00b49 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.034842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-294d2c0d-0f78-4541-be88-1f4456d00b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.048454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294d2c0d-0f78-4541-be88-1f4456d00b49 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.050038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1032/2075] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:18.050934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d235a-430a-4aaa-b8de-d5f49ed8ae15 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.052336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-203d235a-430a-4aaa-b8de-d5f49ed8ae15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.054375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe737583-a6c0-4ce6-8846-aab8e6f1d033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.055050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe737583-a6c0-4ce6-8846-aab8e6f1d033 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.055388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe737583-a6c0-4ce6-8846-aab8e6f1d033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.055664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe737583-a6c0-4ce6-8846-aab8e6f1d033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.056981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe737583-a6c0-4ce6-8846-aab8e6f1d033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.059209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe737583-a6c0-4ce6-8846-aab8e6f1d033 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.076629 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:18.113040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d235a-430a-4aaa-b8de-d5f49ed8ae15 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.116635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957697a-d37a-4ac7-8489-ca76c4adaa4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.117317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957697a-d37a-4ac7-8489-ca76c4adaa4f service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.117600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957697a-d37a-4ac7-8489-ca76c4adaa4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.117892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957697a-d37a-4ac7-8489-ca76c4adaa4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.126786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957697a-d37a-4ac7-8489-ca76c4adaa4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.128201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957697a-d37a-4ac7-8489-ca76c4adaa4f service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.137644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1033/2076] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:18.138878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ccc85-4791-4274-a1df-b0af5643f329 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.139099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ccc85-4791-4274-a1df-b0af5643f329 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.139376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ccc85-4791-4274-a1df-b0af5643f329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.157322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-be1ccc85-4791-4274-a1df-b0af5643f329 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:18.158623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-be1ccc85-4791-4274-a1df-b0af5643f329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.166706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1034/2077] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:18.167465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ccc85-4791-4274-a1df-b0af5643f329 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.168693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-be1ccc85-4791-4274-a1df-b0af5643f329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.185916 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ccc85-4791-4274-a1df-b0af5643f329 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.185916 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56eabc-f711-485a-8845-4953eb600a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.186129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1044/2078] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:18 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:18.186222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56eabc-f711-485a-8845-4953eb600a27 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.186222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56eabc-f711-485a-8845-4953eb600a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.186222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56eabc-f711-485a-8845-4953eb600a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.186729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe737583-a6c0-4ce6-8846-aab8e6f1d033 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.188567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fe737583-a6c0-4ce6-8846-aab8e6f1d033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.189441 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-cb56eabc-f711-485a-8845-4953eb600a27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.250209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56eabc-f711-485a-8845-4953eb600a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.251672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56eabc-f711-485a-8845-4953eb600a27 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.253104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe737583-a6c0-4ce6-8846-aab8e6f1d033 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.259092 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.260691 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.261005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.261317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] PATH_INFO: `/v3/users/f07f54d82e8c4d3c82feb643e6a9c089` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.261702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1035/2079] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:18.262495 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56eabc-f711-485a-8845-4953eb600a27 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.267505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07f54d82e8c4d3c82feb643e6a9c089)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.267505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.273578 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56eabc-f711-485a-8845-4953eb600a27 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.278409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcc268-1dfa-48c0-8e8d-859434c3b24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.279246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcc268-1dfa-48c0-8e8d-859434c3b24b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.279536 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcc268-1dfa-48c0-8e8d-859434c3b24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.279814 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcc268-1dfa-48c0-8e8d-859434c3b24b admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.281254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcc268-1dfa-48c0-8e8d-859434c3b24b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:18.281562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcc268-1dfa-48c0-8e8d-859434c3b24b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.283163 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dcc268-1dfa-48c0-8e8d-859434c3b24b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.296540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1036/2080] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:18.297371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcc268-1dfa-48c0-8e8d-859434c3b24b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.307932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcc268-1dfa-48c0-8e8d-859434c3b24b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.312614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2efbac-7573-4488-a9db-04665ba1b64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.313420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2efbac-7573-4488-a9db-04665ba1b64c admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.313705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2efbac-7573-4488-a9db-04665ba1b64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.314013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2efbac-7573-4488-a9db-04665ba1b64c admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.314703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2efbac-7573-4488-a9db-04665ba1b64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.316612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2efbac-7573-4488-a9db-04665ba1b64c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.558627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1037/2081] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:18 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:18.558627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2efbac-7573-4488-a9db-04665ba1b64c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.563611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07f54d82e8c4d3c82feb643e6a9c089'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:18.566327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2efbac-7573-4488-a9db-04665ba1b64c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.572412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa898e-04f8-469e-9686-b16c41fe71aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.573090 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa898e-04f8-469e-9686-b16c41fe71aa admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.573375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa898e-04f8-469e-9686-b16c41fe71aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.573652 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa898e-04f8-469e-9686-b16c41fe71aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.574344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa898e-04f8-469e-9686-b16c41fe71aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.576060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07f54d82e8c4d3c82feb643e6a9c089'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:18.576250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa898e-04f8-469e-9686-b16c41fe71aa admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.667796 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07f54d82e8c4d3c82feb643e6a9c089'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:18.668472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07f54d82e8c4d3c82feb643e6a9c089'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:18.669120 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07f54d82e8c4d3c82feb643e6a9c089'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:18.677272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1038/2082] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:18 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:18.677272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522f9dd-c2c7-4788-9aa7-a500d092acad None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.677272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522f9dd-c2c7-4788-9aa7-a500d092acad None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.677272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522f9dd-c2c7-4788-9aa7-a500d092acad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.685873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1045/2083] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:18 2022] DELETE /identity/v3/users/f07f54d82e8c4d3c82feb643e6a9c089 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:18.686490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.688293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.695083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0522f9dd-c2c7-4788-9aa7-a500d092acad None None] MFA Rules not processed for user `bcc7c2d5507c4f93afc59c8f5604eb24`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:18.695519 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0522f9dd-c2c7-4788-9aa7-a500d092acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.760848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1039/2084] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:18.762005 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522f9dd-c2c7-4788-9aa7-a500d092acad None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.763637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0522f9dd-c2c7-4788-9aa7-a500d092acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.776957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad85d3-8762-4c80-8ac1-188f4952c25c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.780036 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522f9dd-c2c7-4788-9aa7-a500d092acad None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.788458 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69182971-38fe-4305-b1db-82b1d97e462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.789355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025780aa-24d6-411f-9723-dd4564048e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.790220 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025780aa-24d6-411f-9723-dd4564048e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.791902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025780aa-24d6-411f-9723-dd4564048e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.792180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025780aa-24d6-411f-9723-dd4564048e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.793064 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69182971-38fe-4305-b1db-82b1d97e462e admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.793198 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025780aa-24d6-411f-9723-dd4564048e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.793434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69182971-38fe-4305-b1db-82b1d97e462e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.793732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69182971-38fe-4305-b1db-82b1d97e462e admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.794715 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69182971-38fe-4305-b1db-82b1d97e462e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.794878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025780aa-24d6-411f-9723-dd4564048e05 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.796622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69182971-38fe-4305-b1db-82b1d97e462e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.810771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1046/2085] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:18.810771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87413c78-44e6-4a27-ba56-767f8e7c8ea9 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.810771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87413c78-44e6-4a27-ba56-767f8e7c8ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.810771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87413c78-44e6-4a27-ba56-767f8e7c8ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.832933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-87413c78-44e6-4a27-ba56-767f8e7c8ea9 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:18.834257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-87413c78-44e6-4a27-ba56-767f8e7c8ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.844369 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1047/2086] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:18.845188 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87413c78-44e6-4a27-ba56-767f8e7c8ea9 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.857020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87413c78-44e6-4a27-ba56-767f8e7c8ea9 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.867980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01e059-8b4a-4cca-95d3-bd17dc3d7dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.868786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01e059-8b4a-4cca-95d3-bd17dc3d7dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.869892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01e059-8b4a-4cca-95d3-bd17dc3d7dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.870485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01e059-8b4a-4cca-95d3-bd17dc3d7dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.872981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01e059-8b4a-4cca-95d3-bd17dc3d7dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.875621 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01e059-8b4a-4cca-95d3-bd17dc3d7dc8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.890825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1048/2087] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:18.891825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01e059-8b4a-4cca-95d3-bd17dc3d7dc8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.894826 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7a01e059-8b4a-4cca-95d3-bd17dc3d7dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:18.916851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1040/2088] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:18 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:18.916851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69182971-38fe-4305-b1db-82b1d97e462e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:18.928594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69182971-38fe-4305-b1db-82b1d97e462e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.934200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e6d51-c64c-4b1a-8533-2736491b3b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.935221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6d51-c64c-4b1a-8533-2736491b3b68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.935519 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6d51-c64c-4b1a-8533-2736491b3b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.938130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e6d51-c64c-4b1a-8533-2736491b3b68 admin admin] PATH_INFO: `/v3/projects/1c82aecb33fb4f3eb025104922a9371e/users/d42321f45c754a05b9ef57dad911a350/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.951634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e6d51-c64c-4b1a-8533-2736491b3b68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c82aecb33fb4f3eb025104922a9371e, user_id=d42321f45c754a05b9ef57dad911a350, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:18.954413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e6d51-c64c-4b1a-8533-2736491b3b68 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:18.974981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01e059-8b4a-4cca-95d3-bd17dc3d7dc8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:18.986926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8765316-2e89-40a8-a943-f4320ed7a323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:18.989843 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8765316-2e89-40a8-a943-f4320ed7a323 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:18.989843 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8765316-2e89-40a8-a943-f4320ed7a323 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:18.989843 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8765316-2e89-40a8-a943-f4320ed7a323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:18.999187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8765316-2e89-40a8-a943-f4320ed7a323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.000650 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8765316-2e89-40a8-a943-f4320ed7a323 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.017001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1049/2089] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:19.018023 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8765316-2e89-40a8-a943-f4320ed7a323 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:19.032632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8765316-2e89-40a8-a943-f4320ed7a323 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.038155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff7162-d932-452b-afa8-4ee0a7251d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.038910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff7162-d932-452b-afa8-4ee0a7251d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.039271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff7162-d932-452b-afa8-4ee0a7251d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.039647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff7162-d932-452b-afa8-4ee0a7251d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.040636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff7162-d932-452b-afa8-4ee0a7251d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.042700 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff7162-d932-452b-afa8-4ee0a7251d0d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.053973 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1050/2090] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:19.058874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff7162-d932-452b-afa8-4ee0a7251d0d admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:19.068974 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff7162-d932-452b-afa8-4ee0a7251d0d admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.074607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da8b1f-789c-4f0e-be98-3f65cc9238db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.075275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da8b1f-789c-4f0e-be98-3f65cc9238db admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.075561 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da8b1f-789c-4f0e-be98-3f65cc9238db admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.076011 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da8b1f-789c-4f0e-be98-3f65cc9238db admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.077074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da8b1f-789c-4f0e-be98-3f65cc9238db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.078826 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da8b1f-789c-4f0e-be98-3f65cc9238db admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.091347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1051/2091] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:19.093687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1041/2092] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:18 2022] PUT /identity/v3/projects/1c82aecb33fb4f3eb025104922a9371e/users/d42321f45c754a05b9ef57dad911a350/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:19.102584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da8b1f-789c-4f0e-be98-3f65cc9238db admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:19.106582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ddbc8-bd03-44a9-8d16-93f4d4f839ae None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.107092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ddbc8-bd03-44a9-8d16-93f4d4f839ae None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.107396 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ddbc8-bd03-44a9-8d16-93f4d4f839ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.118338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da8b1f-789c-4f0e-be98-3f65cc9238db admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.148393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d83ddbc8-bd03-44a9-8d16-93f4d4f839ae None None] MFA Rules not processed for user `d42321f45c754a05b9ef57dad911a350`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:19.149764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d83ddbc8-bd03-44a9-8d16-93f4d4f839ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:19.196423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd2b85-e5e2-4e2a-a688-655eb9712f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.198889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd2b85-e5e2-4e2a-a688-655eb9712f53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.199248 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd2b85-e5e2-4e2a-a688-655eb9712f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.199597 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd2b85-e5e2-4e2a-a688-655eb9712f53 admin admin] PATH_INFO: `/v3/projects/0dc9ccb280644ba1b17274a76677a98b/users/0ac9553e75a9408c80c0777f37c2b815/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.224527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd2b85-e5e2-4e2a-a688-655eb9712f53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc9ccb280644ba1b17274a76677a98b, user_id=0ac9553e75a9408c80c0777f37c2b815, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.227269 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd2b85-e5e2-4e2a-a688-655eb9712f53 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.260661 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1042/2093] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:19.273292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ddbc8-bd03-44a9-8d16-93f4d4f839ae None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:19.275017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d83ddbc8-bd03-44a9-8d16-93f4d4f839ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:19.346405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ddbc8-bd03-44a9-8d16-93f4d4f839ae None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.348775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1052/2094] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:19 2022] PUT /identity/v3/projects/0dc9ccb280644ba1b17274a76677a98b/users/0ac9553e75a9408c80c0777f37c2b815/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:19.355243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1692c-938b-4db3-9bb8-e50925e6540c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.355546 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1692c-938b-4db3-9bb8-e50925e6540c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.355811 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1692c-938b-4db3-9bb8-e50925e6540c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.376466 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-39a1692c-938b-4db3-9bb8-e50925e6540c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:19.377977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-39a1692c-938b-4db3-9bb8-e50925e6540c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:19.403676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe68a42-19a3-461f-b99a-c8258145c10c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.404332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe68a42-19a3-461f-b99a-c8258145c10c service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.404619 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe68a42-19a3-461f-b99a-c8258145c10c service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.404923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe68a42-19a3-461f-b99a-c8258145c10c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.448147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1053/2095] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:19.456307 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1692c-938b-4db3-9bb8-e50925e6540c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:19.469713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe68a42-19a3-461f-b99a-c8258145c10c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.473375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe68a42-19a3-461f-b99a-c8258145c10c service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.501790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1043/2096] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:19.502747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe68a42-19a3-461f-b99a-c8258145c10c service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:19.506029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8fe68a42-19a3-461f-b99a-c8258145c10c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:19.540170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe68a42-19a3-461f-b99a-c8258145c10c service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.547687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8d402-f198-45e3-9f43-0aa7fd7c9467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.548794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8d402-f198-45e3-9f43-0aa7fd7c9467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.549211 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8d402-f198-45e3-9f43-0aa7fd7c9467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.549723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8d402-f198-45e3-9f43-0aa7fd7c9467 admin admin] PATH_INFO: `/v3/projects/6cf6804abe4b4dd9a44a8d2ad4964ceb` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.551089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8d402-f198-45e3-9f43-0aa7fd7c9467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf6804abe4b4dd9a44a8d2ad4964ceb)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.553957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8d402-f198-45e3-9f43-0aa7fd7c9467 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.573252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1692c-938b-4db3-9bb8-e50925e6540c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.576975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff142e0-9cff-488b-828e-5ae732180129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.577631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff142e0-9cff-488b-828e-5ae732180129 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.577920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff142e0-9cff-488b-828e-5ae732180129 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.578199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff142e0-9cff-488b-828e-5ae732180129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.589419 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff142e0-9cff-488b-828e-5ae732180129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.590984 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff142e0-9cff-488b-828e-5ae732180129 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.601520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1054/2097] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:19.602630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff142e0-9cff-488b-828e-5ae732180129 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:19.614400 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff142e0-9cff-488b-828e-5ae732180129 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:19.622336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7291349-6089-40f9-bcb3-c0f95a05154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:19.623410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7291349-6089-40f9-bcb3-c0f95a05154e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.623980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7291349-6089-40f9-bcb3-c0f95a05154e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.624106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7291349-6089-40f9-bcb3-c0f95a05154e admin admin] PATH_INFO: `/v3/users/d42321f45c754a05b9ef57dad911a350` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.625739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7291349-6089-40f9-bcb3-c0f95a05154e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d42321f45c754a05b9ef57dad911a350)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:19.627574 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7291349-6089-40f9-bcb3-c0f95a05154e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:19.729648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6df8d402-f198-45e3-9f43-0aa7fd7c9467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf6804abe4b4dd9a44a8d2ad4964ceb', 'request_id': 'req-6df8d402-f198-45e3-9f43-0aa7fd7c9467'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:19.855573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6df8d402-f198-45e3-9f43-0aa7fd7c9467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf6804abe4b4dd9a44a8d2ad4964ceb', 'request_id': 'req-6df8d402-f198-45e3-9f43-0aa7fd7c9467'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:19.865173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6df8d402-f198-45e3-9f43-0aa7fd7c9467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf6804abe4b4dd9a44a8d2ad4964ceb', 'request_id': 'req-6df8d402-f198-45e3-9f43-0aa7fd7c9467'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:19.877135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6df8d402-f198-45e3-9f43-0aa7fd7c9467 admin admin] The token cache is being invalidate because project 6cf6804abe4b4dd9a44a8d2ad4964ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:19.877433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6df8d402-f198-45e3-9f43-0aa7fd7c9467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:19.878137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6df8d402-f198-45e3-9f43-0aa7fd7c9467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:19.879713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1044/2098] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:19 2022] DELETE /identity/v3/projects/6cf6804abe4b4dd9a44a8d2ad4964ceb => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:19.884466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779061-ec1f-45ee-addf-ae199781a598 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.885210 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779061-ec1f-45ee-addf-ae199781a598 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.885210 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779061-ec1f-45ee-addf-ae199781a598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.903318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-4f779061-ec1f-45ee-addf-ae199781a598 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:19.904525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4f779061-ec1f-45ee-addf-ae199781a598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:19.965162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1045/2099] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:19.973729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f2e87-bddb-4e8b-99c8-6542b6063cfe None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:19.974023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f2e87-bddb-4e8b-99c8-6542b6063cfe None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:19.974303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f2e87-bddb-4e8b-99c8-6542b6063cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:19.992612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-171f2e87-bddb-4e8b-99c8-6542b6063cfe None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:19.993998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-171f2e87-bddb-4e8b-99c8-6542b6063cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:19.995619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f7291349-6089-40f9-bcb3-c0f95a05154e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd42321f45c754a05b9ef57dad911a350'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:20.002938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1046/2100] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:20.007023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f2e87-bddb-4e8b-99c8-6542b6063cfe None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.019662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171f2e87-bddb-4e8b-99c8-6542b6063cfe None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:20.024728 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0a3ab-9382-407b-bafe-35a96db4d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:20.026701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0a3ab-9382-407b-bafe-35a96db4d2af admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.026701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0a3ab-9382-407b-bafe-35a96db4d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.026701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0a3ab-9382-407b-bafe-35a96db4d2af admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.027403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0a3ab-9382-407b-bafe-35a96db4d2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:20.027718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0a3ab-9382-407b-bafe-35a96db4d2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:20.029434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0a3ab-9382-407b-bafe-35a96db4d2af admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:20.031803 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f7291349-6089-40f9-bcb3-c0f95a05154e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd42321f45c754a05b9ef57dad911a350'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:20.047198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1047/2101] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:13:20.048691 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0a3ab-9382-407b-bafe-35a96db4d2af admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.064113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0a3ab-9382-407b-bafe-35a96db4d2af admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:20.069643 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892d92f-0773-464e-817e-d020ca284fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:20.070413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d92f-0773-464e-817e-d020ca284fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.070708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d92f-0773-464e-817e-d020ca284fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.070989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d92f-0773-464e-817e-d020ca284fd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.071933 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d92f-0773-464e-817e-d020ca284fd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:20.074739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d92f-0773-464e-817e-d020ca284fd7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:20.126210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f7291349-6089-40f9-bcb3-c0f95a05154e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd42321f45c754a05b9ef57dad911a350'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:20.126371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f7291349-6089-40f9-bcb3-c0f95a05154e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd42321f45c754a05b9ef57dad911a350'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:20.126933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f7291349-6089-40f9-bcb3-c0f95a05154e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd42321f45c754a05b9ef57dad911a350'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:20.144864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1055/2102] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:19 2022] DELETE /identity/v3/users/d42321f45c754a05b9ef57dad911a350 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:20.147275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905ff7-e3f5-4d44-92ec-6516fcc8d717 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.147420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905ff7-e3f5-4d44-92ec-6516fcc8d717 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.147713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905ff7-e3f5-4d44-92ec-6516fcc8d717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.169237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-cd905ff7-e3f5-4d44-92ec-6516fcc8d717 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:20.170512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cd905ff7-e3f5-4d44-92ec-6516fcc8d717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:20.178470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1048/2103] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:20 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:20.183344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892d92f-0773-464e-817e-d020ca284fd7 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.184998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0892d92f-0773-464e-817e-d020ca284fd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:20.233969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1056/2104] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:20.249444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd905ff7-e3f5-4d44-92ec-6516fcc8d717 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.254016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cd905ff7-e3f5-4d44-92ec-6516fcc8d717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:20.259312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892d92f-0773-464e-817e-d020ca284fd7 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:20.265443 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab6a30-b798-4c21-b49a-75d72e2e9fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:20.266144 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab6a30-b798-4c21-b49a-75d72e2e9fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.266426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab6a30-b798-4c21-b49a-75d72e2e9fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.266864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab6a30-b798-4c21-b49a-75d72e2e9fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.267768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab6a30-b798-4c21-b49a-75d72e2e9fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:20.277755 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab6a30-b798-4c21-b49a-75d72e2e9fe8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:20.303905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:20.332959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd905ff7-e3f5-4d44-92ec-6516fcc8d717 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:20.372796 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1049/2105] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:20 2022] POST /identity/v3/users => generated 284 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:20.374113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab6a30-b798-4c21-b49a-75d72e2e9fe8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.375960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-25ab6a30-b798-4c21-b49a-75d72e2e9fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:20.414281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f0140-dbdd-47f2-98f0-9d3d6311d7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:20.415035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f0140-dbdd-47f2-98f0-9d3d6311d7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.415384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f0140-dbdd-47f2-98f0-9d3d6311d7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.415795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f0140-dbdd-47f2-98f0-9d3d6311d7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.428751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f0140-dbdd-47f2-98f0-9d3d6311d7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:20.430751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f0140-dbdd-47f2-98f0-9d3d6311d7c6 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:20.442582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1057/2106] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:20.450406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f0140-dbdd-47f2-98f0-9d3d6311d7c6 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.461029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab6a30-b798-4c21-b49a-75d72e2e9fe8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:20.464114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f0140-dbdd-47f2-98f0-9d3d6311d7c6 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:20.467170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287a045-0841-43a1-ac96-78a9c04027e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:20.468353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287a045-0841-43a1-ac96-78a9c04027e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.468927 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287a045-0841-43a1-ac96-78a9c04027e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.469148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d51d7-ad13-4358-9455-b7b2c62cfcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:20.469657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287a045-0841-43a1-ac96-78a9c04027e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.469763 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d51d7-ad13-4358-9455-b7b2c62cfcee admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.470114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d51d7-ad13-4358-9455-b7b2c62cfcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.470400 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d51d7-ad13-4358-9455-b7b2c62cfcee admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.471030 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d51d7-ad13-4358-9455-b7b2c62cfcee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:20.472947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d51d7-ad13-4358-9455-b7b2c62cfcee admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:20.473343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e287a045-0841-43a1-ac96-78a9c04027e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:20.484851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1058/2107] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:20.489011 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d51d7-ad13-4358-9455-b7b2c62cfcee admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.501408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d51d7-ad13-4358-9455-b7b2c62cfcee admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:20.508546 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4f4b6-3532-4a57-a911-df16700bdb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:20.510178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4f4b6-3532-4a57-a911-df16700bdb4e admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.510707 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4f4b6-3532-4a57-a911-df16700bdb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.511532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4f4b6-3532-4a57-a911-df16700bdb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.512628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4f4b6-3532-4a57-a911-df16700bdb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:20.514749 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4f4b6-3532-4a57-a911-df16700bdb4e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:20.531274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1059/2108] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:13:20.536252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4f4b6-3532-4a57-a911-df16700bdb4e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.552050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4f4b6-3532-4a57-a911-df16700bdb4e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:20.557966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287a045-0841-43a1-ac96-78a9c04027e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:20.558905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287a045-0841-43a1-ac96-78a9c04027e5 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:20.562258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66d900-9947-4415-9ba3-f7b6792a4896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:20.564159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66d900-9947-4415-9ba3-f7b6792a4896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.564159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66d900-9947-4415-9ba3-f7b6792a4896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.564159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66d900-9947-4415-9ba3-f7b6792a4896 admin admin] PATH_INFO: `/v3/projects/70c06920d03c432885d7074b3610b304/users/019026ebf4d24a3a9b10a9386b1e1d34/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.573139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1050/2109] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:20.586923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66d900-9947-4415-9ba3-f7b6792a4896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c06920d03c432885d7074b3610b304, user_id=019026ebf4d24a3a9b10a9386b1e1d34, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:20.590935 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66d900-9947-4415-9ba3-f7b6792a4896 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:20.689869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1060/2110] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:20 2022] PUT /identity/v3/projects/70c06920d03c432885d7074b3610b304/users/019026ebf4d24a3a9b10a9386b1e1d34/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:20.698992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e84b1d-0bdf-480a-8e28-53111bb64db6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.699287 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e84b1d-0bdf-480a-8e28-53111bb64db6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.699573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e84b1d-0bdf-480a-8e28-53111bb64db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.726197 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e2e84b1d-0bdf-480a-8e28-53111bb64db6 None None] MFA Rules not processed for user `019026ebf4d24a3a9b10a9386b1e1d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:20.727421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e2e84b1d-0bdf-480a-8e28-53111bb64db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:20.807525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1051/2111] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:20.822060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66d900-9947-4415-9ba3-f7b6792a4896 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:20.825803 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9b66d900-9947-4415-9ba3-f7b6792a4896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:20.901078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66d900-9947-4415-9ba3-f7b6792a4896 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:20.906009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9584-1d96-46a4-a862-2e21ce344d96 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6832291d504cff9e787c0d791c70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:20.907326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9584-1d96-46a4-a862-2e21ce344d96 service glance] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:20.907614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9584-1d96-46a4-a862-2e21ce344d96 service glance] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:20.907947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9584-1d96-46a4-a862-2e21ce344d96 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:20.920382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9584-1d96-46a4-a862-2e21ce344d96 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:20.921886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9584-1d96-46a4-a862-2e21ce344d96 service glance] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:20.931834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1061/2112] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:20 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:20.975810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:21.067340 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e84b1d-0bdf-480a-8e28-53111bb64db6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:21.069014 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e2e84b1d-0bdf-480a-8e28-53111bb64db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:21.165236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e84b1d-0bdf-480a-8e28-53111bb64db6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:21.184491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47beb91-981d-45be-9f08-6fb3373f3d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:21.186273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47beb91-981d-45be-9f08-6fb3373f3d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.186802 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47beb91-981d-45be-9f08-6fb3373f3d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.187486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47beb91-981d-45be-9f08-6fb3373f3d6c admin admin] PATH_INFO: `/v3/projects/1c82aecb33fb4f3eb025104922a9371e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.190280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47beb91-981d-45be-9f08-6fb3373f3d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c82aecb33fb4f3eb025104922a9371e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:21.204578 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47beb91-981d-45be-9f08-6fb3373f3d6c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:21.365925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b47beb91-981d-45be-9f08-6fb3373f3d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c82aecb33fb4f3eb025104922a9371e', 'request_id': 'req-b47beb91-981d-45be-9f08-6fb3373f3d6c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:21.442304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:21.443295 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b47beb91-981d-45be-9f08-6fb3373f3d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c82aecb33fb4f3eb025104922a9371e', 'request_id': 'req-b47beb91-981d-45be-9f08-6fb3373f3d6c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:21.460902 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b47beb91-981d-45be-9f08-6fb3373f3d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c82aecb33fb4f3eb025104922a9371e', 'request_id': 'req-b47beb91-981d-45be-9f08-6fb3373f3d6c'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:21.498111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b47beb91-981d-45be-9f08-6fb3373f3d6c admin admin] The token cache is being invalidate because project 1c82aecb33fb4f3eb025104922a9371e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:21.498403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b47beb91-981d-45be-9f08-6fb3373f3d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:21.499212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b47beb91-981d-45be-9f08-6fb3373f3d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:21.502326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1052/2113] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:21 2022] DELETE /identity/v3/projects/1c82aecb33fb4f3eb025104922a9371e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:21.508349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172947cd-2ab7-443f-88f4-3fcb52d11c08 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.510225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172947cd-2ab7-443f-88f4-3fcb52d11c08 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.510694 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172947cd-2ab7-443f-88f4-3fcb52d11c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.538246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-172947cd-2ab7-443f-88f4-3fcb52d11c08 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:21.539498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-172947cd-2ab7-443f-88f4-3fcb52d11c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:21.614273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1062/2114] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:21.623533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9093fbb-c1b0-4ba4-a64c-777da4d6b5a8 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.623825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9093fbb-c1b0-4ba4-a64c-777da4d6b5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.624106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9093fbb-c1b0-4ba4-a64c-777da4d6b5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.645827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d9093fbb-c1b0-4ba4-a64c-777da4d6b5a8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:21.647316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d9093fbb-c1b0-4ba4-a64c-777da4d6b5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:21.659427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1053/2115] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:21.660823 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172947cd-2ab7-443f-88f4-3fcb52d11c08 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:21.675049 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172947cd-2ab7-443f-88f4-3fcb52d11c08 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:21.681299 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2c192-d271-4008-96bc-dcf59e19ce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:21.682877 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2c192-d271-4008-96bc-dcf59e19ce6a admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.683333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2c192-d271-4008-96bc-dcf59e19ce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.683772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2c192-d271-4008-96bc-dcf59e19ce6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.684685 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2c192-d271-4008-96bc-dcf59e19ce6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:21.685222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2c192-d271-4008-96bc-dcf59e19ce6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:21.687216 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2c192-d271-4008-96bc-dcf59e19ce6a admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:21.700358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1063/2116] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:21.704737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9093fbb-c1b0-4ba4-a64c-777da4d6b5a8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:21.724931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9093fbb-c1b0-4ba4-a64c-777da4d6b5a8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:21.724931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43f2b-b19e-48ee-a100-d2e3e4a3480f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:21.724931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43f2b-b19e-48ee-a100-d2e3e4a3480f admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:21.724931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43f2b-b19e-48ee-a100-d2e3e4a3480f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:21.725341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd43f2b-b19e-48ee-a100-d2e3e4a3480f admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:21.725341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd43f2b-b19e-48ee-a100-d2e3e4a3480f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:21.726825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd43f2b-b19e-48ee-a100-d2e3e4a3480f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:21.907817 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1054/2117] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:21 2022] POST /identity/v3/projects => generated 357 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:21.914076 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2c192-d271-4008-96bc-dcf59e19ce6a admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:21.925182 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2c192-d271-4008-96bc-dcf59e19ce6a admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:21.999673 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2378b-ed51-42d6-90a2-45895b1ed404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:22.000368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2378b-ed51-42d6-90a2-45895b1ed404 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.000655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2378b-ed51-42d6-90a2-45895b1ed404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.001113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc2378b-ed51-42d6-90a2-45895b1ed404 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.001904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2378b-ed51-42d6-90a2-45895b1ed404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:22.004681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc2378b-ed51-42d6-90a2-45895b1ed404 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:22.221764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1064/2118] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:21 2022] POST /identity/v3/users => generated 279 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:22.226621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43f2b-b19e-48ee-a100-d2e3e4a3480f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:22.237419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd43f2b-b19e-48ee-a100-d2e3e4a3480f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:22.242318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965ab70-5656-4c8c-aeea-f4670d3e522e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:22.243006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965ab70-5656-4c8c-aeea-f4670d3e522e admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.243291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965ab70-5656-4c8c-aeea-f4670d3e522e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.243570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965ab70-5656-4c8c-aeea-f4670d3e522e admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.244382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965ab70-5656-4c8c-aeea-f4670d3e522e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:22.246043 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965ab70-5656-4c8c-aeea-f4670d3e522e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:22.258125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1055/2119] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:22.267016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2378b-ed51-42d6-90a2-45895b1ed404 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:22.294651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc2378b-ed51-42d6-90a2-45895b1ed404 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:22.300498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46d69f-7ed4-4458-9b02-d4ed4a08f51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:22.303097 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46d69f-7ed4-4458-9b02-d4ed4a08f51f admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.303458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46d69f-7ed4-4458-9b02-d4ed4a08f51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.303803 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46d69f-7ed4-4458-9b02-d4ed4a08f51f admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.305133 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46d69f-7ed4-4458-9b02-d4ed4a08f51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:22.306771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46d69f-7ed4-4458-9b02-d4ed4a08f51f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:22.320575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1065/2120] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:22.326305 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965ab70-5656-4c8c-aeea-f4670d3e522e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:22.341437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965ab70-5656-4c8c-aeea-f4670d3e522e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:22.376486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bc1fc-6198-43c9-9723-f74f9a64deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:22.388254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bc1fc-6198-43c9-9723-f74f9a64deb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.388598 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bc1fc-6198-43c9-9723-f74f9a64deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.388974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bc1fc-6198-43c9-9723-f74f9a64deb0 admin admin] PATH_INFO: `/v3/projects/3bca97757ac74d70861e9ea241bff64c/users/27a37be7c58c4051961df38f9bf90c22/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.418554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bc1fc-6198-43c9-9723-f74f9a64deb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bca97757ac74d70861e9ea241bff64c, user_id=27a37be7c58c4051961df38f9bf90c22, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:22.423413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bc1fc-6198-43c9-9723-f74f9a64deb0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:22.535823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1056/2121] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:22 2022] PUT /identity/v3/projects/3bca97757ac74d70861e9ea241bff64c/users/27a37be7c58c4051961df38f9bf90c22/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:22.538186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d878c9-4d6e-40aa-a989-69e56848fc3f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.538678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d878c9-4d6e-40aa-a989-69e56848fc3f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.538678 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d878c9-4d6e-40aa-a989-69e56848fc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.555453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bc1fc-6198-43c9-9723-f74f9a64deb0 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:22.560227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1e7bc1fc-6198-43c9-9723-f74f9a64deb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:22.598203 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-12d878c9-4d6e-40aa-a989-69e56848fc3f None None] MFA Rules not processed for user `27a37be7c58c4051961df38f9bf90c22`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:22.599715 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-12d878c9-4d6e-40aa-a989-69e56848fc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:22.696147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bc1fc-6198-43c9-9723-f74f9a64deb0 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:22.702852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c8499-b81a-4a5c-9abb-a5c35e67fe67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:22.703614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c8499-b81a-4a5c-9abb-a5c35e67fe67 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.703912 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c8499-b81a-4a5c-9abb-a5c35e67fe67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.704196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c8499-b81a-4a5c-9abb-a5c35e67fe67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.707033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-322c8499-b81a-4a5c-9abb-a5c35e67fe67 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:22.800887 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1066/2122] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:22 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:22.842098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d878c9-4d6e-40aa-a989-69e56848fc3f None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:22.845333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-12d878c9-4d6e-40aa-a989-69e56848fc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:22.904476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d878c9-4d6e-40aa-a989-69e56848fc3f None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:22.915866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d612f7-99fb-4edf-be4b-dad2e0e3f73a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:22.918664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d612f7-99fb-4edf-be4b-dad2e0e3f73a service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:22.919154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d612f7-99fb-4edf-be4b-dad2e0e3f73a service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:22.919436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d612f7-99fb-4edf-be4b-dad2e0e3f73a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:22.930342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d612f7-99fb-4edf-be4b-dad2e0e3f73a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:22.932543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c8499-b81a-4a5c-9abb-a5c35e67fe67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:22.932897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d612f7-99fb-4edf-be4b-dad2e0e3f73a service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:22.934495 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c8499-b81a-4a5c-9abb-a5c35e67fe67 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:22.956632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1067/2123] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:22 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:22.963555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d612f7-99fb-4edf-be4b-dad2e0e3f73a service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:22.978133 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1057/2124] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:13:23.057218 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d612f7-99fb-4edf-be4b-dad2e0e3f73a service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:23.062406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:23.063350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:23.063635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:23.063931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] PATH_INFO: `/v3/users/27a37be7c58c4051961df38f9bf90c22` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:23.065394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=27a37be7c58c4051961df38f9bf90c22)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:23.067679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:23.367642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27a37be7c58c4051961df38f9bf90c22'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:23.399294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27a37be7c58c4051961df38f9bf90c22'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:23.522159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27a37be7c58c4051961df38f9bf90c22'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:23.523358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27a37be7c58c4051961df38f9bf90c22'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:23.523358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27a37be7c58c4051961df38f9bf90c22'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:23.546136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1068/2125] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:22 2022] DELETE /identity/v3/users/27a37be7c58c4051961df38f9bf90c22 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:23.552162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4783373-a542-43aa-bb40-5980ce03b414 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:23.552162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4783373-a542-43aa-bb40-5980ce03b414 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:23.552162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4783373-a542-43aa-bb40-5980ce03b414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:23.575840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f4783373-a542-43aa-bb40-5980ce03b414 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:23.577037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f4783373-a542-43aa-bb40-5980ce03b414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:23.662462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1058/2126] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:23.676564 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:23.678103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:23.766807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01f8ce-5715-490c-8d75-e22f882678cd admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:23.785577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717d9f7-f2d4-452f-a248-b7a2aa6cd346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:23.786905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d9f7-f2d4-452f-a248-b7a2aa6cd346 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:23.787541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d9f7-f2d4-452f-a248-b7a2aa6cd346 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:23.787949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d9f7-f2d4-452f-a248-b7a2aa6cd346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:23.807007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717d9f7-f2d4-452f-a248-b7a2aa6cd346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:23.811159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717d9f7-f2d4-452f-a248-b7a2aa6cd346 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:23.828743 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1069/2127] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:24.195224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:24.839570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:25.003263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4783373-a542-43aa-bb40-5980ce03b414 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:25.006840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f4783373-a542-43aa-bb40-5980ce03b414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:25.021001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4783373-a542-43aa-bb40-5980ce03b414 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:25.027757 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb775b-f9ca-4831-9243-30feaf917712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:25.028750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb775b-f9ca-4831-9243-30feaf917712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.029192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb775b-f9ca-4831-9243-30feaf917712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.029481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb775b-f9ca-4831-9243-30feaf917712 admin admin] PATH_INFO: `/v3/projects/3bca97757ac74d70861e9ea241bff64c` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.030899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb775b-f9ca-4831-9243-30feaf917712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bca97757ac74d70861e9ea241bff64c)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:25.032965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb775b-f9ca-4831-9243-30feaf917712 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:25.243506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-80fb775b-f9ca-4831-9243-30feaf917712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bca97757ac74d70861e9ea241bff64c', 'request_id': 'req-80fb775b-f9ca-4831-9243-30feaf917712'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.323955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-80fb775b-f9ca-4831-9243-30feaf917712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bca97757ac74d70861e9ea241bff64c', 'request_id': 'req-80fb775b-f9ca-4831-9243-30feaf917712'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.338555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-80fb775b-f9ca-4831-9243-30feaf917712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bca97757ac74d70861e9ea241bff64c', 'request_id': 'req-80fb775b-f9ca-4831-9243-30feaf917712'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.355048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-80fb775b-f9ca-4831-9243-30feaf917712 admin admin] The token cache is being invalidate because project 3bca97757ac74d70861e9ea241bff64c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:25.356782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-80fb775b-f9ca-4831-9243-30feaf917712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.358120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-80fb775b-f9ca-4831-9243-30feaf917712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:25.365480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1059/2128] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:25 2022] DELETE /identity/v3/projects/3bca97757ac74d70861e9ea241bff64c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:25.366159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26145f25-6f7b-43a5-8170-91e9f9cab3c5 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.366632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26145f25-6f7b-43a5-8170-91e9f9cab3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.366714 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26145f25-6f7b-43a5-8170-91e9f9cab3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.407852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-26145f25-6f7b-43a5-8170-91e9f9cab3c5 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:25.409539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-26145f25-6f7b-43a5-8170-91e9f9cab3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:25.517521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1070/2129] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:13:25.522890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b94f42-2385-4182-8fad-f62a18c90aed None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.522890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b94f42-2385-4182-8fad-f62a18c90aed None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.522890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b94f42-2385-4182-8fad-f62a18c90aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.544798 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-96b94f42-2385-4182-8fad-f62a18c90aed None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:25.546059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-96b94f42-2385-4182-8fad-f62a18c90aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:25.555634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1060/2130] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:25.560658 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26145f25-6f7b-43a5-8170-91e9f9cab3c5 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:25.574828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26145f25-6f7b-43a5-8170-91e9f9cab3c5 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:25.579609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104b1e1-792f-450e-8a23-eef3113fa3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:25.581792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104b1e1-792f-450e-8a23-eef3113fa3fb admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.581792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104b1e1-792f-450e-8a23-eef3113fa3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.581792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104b1e1-792f-450e-8a23-eef3113fa3fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.581792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104b1e1-792f-450e-8a23-eef3113fa3fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:25.582079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104b1e1-792f-450e-8a23-eef3113fa3fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:25.583845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104b1e1-792f-450e-8a23-eef3113fa3fb admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:25.601324 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1071/2131] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:25.605733 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b94f42-2385-4182-8fad-f62a18c90aed None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:25.616146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b94f42-2385-4182-8fad-f62a18c90aed None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:25.622042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d8336-e448-4da0-9916-b4840fbaa4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:25.623336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d8336-e448-4da0-9916-b4840fbaa4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.623336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d8336-e448-4da0-9916-b4840fbaa4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.623336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d8336-e448-4da0-9916-b4840fbaa4d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.624000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d8336-e448-4da0-9916-b4840fbaa4d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:25.625983 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d8336-e448-4da0-9916-b4840fbaa4d4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:25.759239 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1061/2132] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:25 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:25.764232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104b1e1-792f-450e-8a23-eef3113fa3fb admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:25.775455 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104b1e1-792f-450e-8a23-eef3113fa3fb admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:25.838048 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507a6e3-f53c-4b1e-85ad-dad9de57f01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:25.846730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507a6e3-f53c-4b1e-85ad-dad9de57f01e admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:25.846730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507a6e3-f53c-4b1e-85ad-dad9de57f01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:25.846730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507a6e3-f53c-4b1e-85ad-dad9de57f01e admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:25.846730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507a6e3-f53c-4b1e-85ad-dad9de57f01e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:25.846730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5507a6e3-f53c-4b1e-85ad-dad9de57f01e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:26.008356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1072/2133] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:25 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:26.009841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d8336-e448-4da0-9916-b4840fbaa4d4 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:26.036008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d8336-e448-4da0-9916-b4840fbaa4d4 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:26.036008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef90d9-e382-4e22-829e-498dcc0642de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:26.036008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef90d9-e382-4e22-829e-498dcc0642de admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:26.036008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef90d9-e382-4e22-829e-498dcc0642de admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:26.036775 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef90d9-e382-4e22-829e-498dcc0642de admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.036775 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef90d9-e382-4e22-829e-498dcc0642de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:26.036775 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef90d9-e382-4e22-829e-498dcc0642de admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:26.064740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507a6e3-f53c-4b1e-85ad-dad9de57f01e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:26.070684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1062/2134] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:26.077706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507a6e3-f53c-4b1e-85ad-dad9de57f01e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:26.084754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815a8d7-aefb-44a9-866c-f11d53be9c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:26.085487 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a8d7-aefb-44a9-866c-f11d53be9c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:26.085777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a8d7-aefb-44a9-866c-f11d53be9c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:26.086058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815a8d7-aefb-44a9-866c-f11d53be9c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.086880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815a8d7-aefb-44a9-866c-f11d53be9c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:26.093140 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815a8d7-aefb-44a9-866c-f11d53be9c6a admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:26.114896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1073/2135] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:26.119566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef90d9-e382-4e22-829e-498dcc0642de admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:26.137003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef90d9-e382-4e22-829e-498dcc0642de admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:26.149066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea042c-2239-4988-82c8-3237db029a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:26.150343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea042c-2239-4988-82c8-3237db029a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:26.150701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea042c-2239-4988-82c8-3237db029a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:26.150982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea042c-2239-4988-82c8-3237db029a90 admin admin] PATH_INFO: `/v3/projects/f4cbddd0130c4b77b2df7f28d21ccc10/users/a36c6e5ac77e45b79dfdb3e60b31f325/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.179948 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea042c-2239-4988-82c8-3237db029a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4cbddd0130c4b77b2df7f28d21ccc10, user_id=a36c6e5ac77e45b79dfdb3e60b31f325, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:26.184651 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea042c-2239-4988-82c8-3237db029a90 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:26.315308 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1063/2136] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:26 2022] PUT /identity/v3/projects/f4cbddd0130c4b77b2df7f28d21ccc10/users/a36c6e5ac77e45b79dfdb3e60b31f325/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:26.328394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909bd60-54e8-4baf-94bf-fee4b2996010 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:26.329375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909bd60-54e8-4baf-94bf-fee4b2996010 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:26.329669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909bd60-54e8-4baf-94bf-fee4b2996010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.373287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-f909bd60-54e8-4baf-94bf-fee4b2996010 None None] MFA Rules not processed for user `a36c6e5ac77e45b79dfdb3e60b31f325`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:26.376098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f909bd60-54e8-4baf-94bf-fee4b2996010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:26.432156 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:26.473336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1074/2137] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:26.487986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea042c-2239-4988-82c8-3237db029a90 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:26.490099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-94ea042c-2239-4988-82c8-3237db029a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:26.564324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea042c-2239-4988-82c8-3237db029a90 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:26.574949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916ed86-c6b6-4cfc-a01e-f92ce508d913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:26.576006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916ed86-c6b6-4cfc-a01e-f92ce508d913 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:26.576692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916ed86-c6b6-4cfc-a01e-f92ce508d913 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:26.577160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916ed86-c6b6-4cfc-a01e-f92ce508d913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:26.614276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916ed86-c6b6-4cfc-a01e-f92ce508d913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:26.615906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916ed86-c6b6-4cfc-a01e-f92ce508d913 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:26.632937 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1064/2138] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:27.437024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a8626-e84d-4f25-a34f-d090fe25b6a4 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:27.441320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a8626-e84d-4f25-a34f-d090fe25b6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:27.441320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a8626-e84d-4f25-a34f-d090fe25b6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:27.478322 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e24a8626-e84d-4f25-a34f-d090fe25b6a4 None None] MFA Rules not processed for user `0ac9553e75a9408c80c0777f37c2b815`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:27.479663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e24a8626-e84d-4f25-a34f-d090fe25b6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:27.554881 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1075/2139] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:27.569431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916ed86-c6b6-4cfc-a01e-f92ce508d913 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:27.570962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1916ed86-c6b6-4cfc-a01e-f92ce508d913 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:27.662710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916ed86-c6b6-4cfc-a01e-f92ce508d913 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:27.670756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff7b5e-a6b7-47bd-8117-0168703e6aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:27.671659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff7b5e-a6b7-47bd-8117-0168703e6aff service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:27.671941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff7b5e-a6b7-47bd-8117-0168703e6aff service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:27.672230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff7b5e-a6b7-47bd-8117-0168703e6aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:27.682458 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff7b5e-a6b7-47bd-8117-0168703e6aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:27.686456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff7b5e-a6b7-47bd-8117-0168703e6aff service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:27.707116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1065/2140] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:28.366083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:28.535320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a8626-e84d-4f25-a34f-d090fe25b6a4 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:28.536979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e24a8626-e84d-4f25-a34f-d090fe25b6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:28.614186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a8626-e84d-4f25-a34f-d090fe25b6a4 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:28.619053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:28.620459 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:28.620741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:28.621114 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] PATH_INFO: `/v3/users/a307115d2e1b404ab2154a30b16e7a03` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:28.622406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a307115d2e1b404ab2154a30b16e7a03)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:28.625111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:28.934639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a307115d2e1b404ab2154a30b16e7a03'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:28.963812 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a307115d2e1b404ab2154a30b16e7a03'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:29.007201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:29.068844 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a307115d2e1b404ab2154a30b16e7a03'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:29.072849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a307115d2e1b404ab2154a30b16e7a03'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:29.072849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a307115d2e1b404ab2154a30b16e7a03'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:29.088279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1076/2141] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:28 2022] DELETE /identity/v3/users/a307115d2e1b404ab2154a30b16e7a03 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:29.092987 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaf655-8fd1-47ae-a6bd-4a17d25f8978 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.093498 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaf655-8fd1-47ae-a6bd-4a17d25f8978 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.093611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaf655-8fd1-47ae-a6bd-4a17d25f8978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.111736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0adaf655-8fd1-47ae-a6bd-4a17d25f8978 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:29.113053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0adaf655-8fd1-47ae-a6bd-4a17d25f8978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:29.177076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1066/2142] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:29.187915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:29.189381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:29.258010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a308a7-ae32-4207-be93-5c8081801eea admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:29.262328 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc81a4-fb24-4c36-bbd9-e1a0a1dd1a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:29.262987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc81a4-fb24-4c36-bbd9-e1a0a1dd1a78 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:29.263268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc81a4-fb24-4c36-bbd9-e1a0a1dd1a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:29.263542 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc81a4-fb24-4c36-bbd9-e1a0a1dd1a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:29.277785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc81a4-fb24-4c36-bbd9-e1a0a1dd1a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:29.279279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc81a4-fb24-4c36-bbd9-e1a0a1dd1a78 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:29.290477 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1077/2143] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:30.019366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adaf655-8fd1-47ae-a6bd-4a17d25f8978 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.021309 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0adaf655-8fd1-47ae-a6bd-4a17d25f8978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:30.034834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adaf655-8fd1-47ae-a6bd-4a17d25f8978 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.053008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348554e-ae06-44d4-9264-92a7f77d3486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.061015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348554e-ae06-44d4-9264-92a7f77d3486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.061015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348554e-ae06-44d4-9264-92a7f77d3486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.061015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348554e-ae06-44d4-9264-92a7f77d3486 admin admin] PATH_INFO: `/v3/projects/cc633b77aa0f4e5389931010cfcec829` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.061015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348554e-ae06-44d4-9264-92a7f77d3486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc633b77aa0f4e5389931010cfcec829)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.066327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348554e-ae06-44d4-9264-92a7f77d3486 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.210290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9348554e-ae06-44d4-9264-92a7f77d3486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc633b77aa0f4e5389931010cfcec829', 'request_id': 'req-9348554e-ae06-44d4-9264-92a7f77d3486'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:30.383377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9348554e-ae06-44d4-9264-92a7f77d3486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc633b77aa0f4e5389931010cfcec829', 'request_id': 'req-9348554e-ae06-44d4-9264-92a7f77d3486'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:30.393919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9348554e-ae06-44d4-9264-92a7f77d3486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc633b77aa0f4e5389931010cfcec829', 'request_id': 'req-9348554e-ae06-44d4-9264-92a7f77d3486'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:30.418971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9348554e-ae06-44d4-9264-92a7f77d3486 admin admin] The token cache is being invalidate because project cc633b77aa0f4e5389931010cfcec829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:30.419267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9348554e-ae06-44d4-9264-92a7f77d3486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:30.420255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9348554e-ae06-44d4-9264-92a7f77d3486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:30.424212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1067/2144] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:30 2022] DELETE /identity/v3/projects/cc633b77aa0f4e5389931010cfcec829 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:30.428546 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc81a4-fb24-4c36-bbd9-e1a0a1dd1a78 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:30.442396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc81a4-fb24-4c36-bbd9-e1a0a1dd1a78 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:30.535242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:30.541882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:30.541882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:30.541882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] PATH_INFO: `/v3/users/09e04b34393640c9bbe698ce459239ce` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:30.541882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e04b34393640c9bbe698ce459239ce)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:30.541882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:30.908721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e04b34393640c9bbe698ce459239ce'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:30.935201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e04b34393640c9bbe698ce459239ce'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.007096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:31.034111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e04b34393640c9bbe698ce459239ce'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.038524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e04b34393640c9bbe698ce459239ce'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.038524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e04b34393640c9bbe698ce459239ce'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.057692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1078/2145] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:30 2022] DELETE /identity/v3/users/09e04b34393640c9bbe698ce459239ce => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:13:31.494971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192319d-1267-4239-8b97-ea4c65f1d2e2 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:31.495851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192319d-1267-4239-8b97-ea4c65f1d2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:31.496301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192319d-1267-4239-8b97-ea4c65f1d2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:31.520051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7192319d-1267-4239-8b97-ea4c65f1d2e2 None None] MFA Rules not processed for user `0ac9553e75a9408c80c0777f37c2b815`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:31.522239 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7192319d-1267-4239-8b97-ea4c65f1d2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:31.604780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:31.607162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1068/2146] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:31.607862 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:31.704040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff15e70-b29e-4ed7-8e1f-058056677aab admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:31.714383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:31.715241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:31.715528 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:31.715809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] PATH_INFO: `/v3/projects/dd2b1a997ee94e39af4fee685d10a702` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:31.719317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2b1a997ee94e39af4fee685d10a702)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:31.723520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:31.931754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2b1a997ee94e39af4fee685d10a702', 'request_id': 'req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:31.994849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:32.028399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2b1a997ee94e39af4fee685d10a702', 'request_id': 'req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.036040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2b1a997ee94e39af4fee685d10a702', 'request_id': 'req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.051416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] The token cache is being invalidate because project dd2b1a997ee94e39af4fee685d10a702 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:32.051805 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.052651 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.057741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1079/2147] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:31 2022] DELETE /identity/v3/projects/dd2b1a997ee94e39af4fee685d10a702 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:32.059265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192319d-1267-4239-8b97-ea4c65f1d2e2 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:32.072638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192319d-1267-4239-8b97-ea4c65f1d2e2 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:32.160779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:32.161741 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:32.162032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:32.162317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] PATH_INFO: `/v3/users/b2d948db7e5e4dbe97df764e37a2d548` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:32.167978 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d948db7e5e4dbe97df764e37a2d548)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:32.170512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:32.416947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d948db7e5e4dbe97df764e37a2d548'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.429688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d948db7e5e4dbe97df764e37a2d548'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.520155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d948db7e5e4dbe97df764e37a2d548'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.521109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d948db7e5e4dbe97df764e37a2d548'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.522184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d948db7e5e4dbe97df764e37a2d548'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:32.535653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1069/2148] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:32 2022] DELETE /identity/v3/users/b2d948db7e5e4dbe97df764e37a2d548 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:33.026353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:33.028338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:33.046686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95b3d27-5d23-439e-9a60-2fc1a8a77a20 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:33.112773 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:33.113738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:33.114031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:33.114306 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa admin admin] PATH_INFO: `/v3/projects/7f4446f2521c41d4906fed2889c7c8dd` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:33.115557 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f4446f2521c41d4906fed2889c7c8dd)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:33.117600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:33.275698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f4446f2521c41d4906fed2889c7c8dd', 'request_id': 'req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:33.365786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f4446f2521c41d4906fed2889c7c8dd', 'request_id': 'req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:33.373190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f4446f2521c41d4906fed2889c7c8dd', 'request_id': 'req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:33.384000 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa admin admin] The token cache is being invalidate because project 7f4446f2521c41d4906fed2889c7c8dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:33.384330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:33.385260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1c4dfcdd-a82f-4264-ad9e-41007f2d6baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:33.386897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1080/2149] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:33 2022] DELETE /identity/v3/projects/7f4446f2521c41d4906fed2889c7c8dd => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:34.486475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:36.252262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:36.829240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:38.195166 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:39.256225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:40.515028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:41.240185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:41.381121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:42.895218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:43.197245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:43.713043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:44.021425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:45.472286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:45.473796 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:45.559922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e04de2-529a-49bf-9e3d-46d280bc4e41 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:45.615689 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:45.616494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:45.616784 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:45.617101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] PATH_INFO: `/v3/users/a36c6e5ac77e45b79dfdb3e60b31f325` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:45.618359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36c6e5ac77e45b79dfdb3e60b31f325)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:45.621225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:45.783287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:45.946256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36c6e5ac77e45b79dfdb3e60b31f325'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:45.958018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36c6e5ac77e45b79dfdb3e60b31f325'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:46.083566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36c6e5ac77e45b79dfdb3e60b31f325'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:46.084223 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36c6e5ac77e45b79dfdb3e60b31f325'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:46.084880 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36c6e5ac77e45b79dfdb3e60b31f325'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:46.098079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1070/2150] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:45 2022] DELETE /identity/v3/users/a36c6e5ac77e45b79dfdb3e60b31f325 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:46.102691 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9758e-c358-46dd-a5e9-d74d789e08ac None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:46.103642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9758e-c358-46dd-a5e9-d74d789e08ac None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:46.103986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9758e-c358-46dd-a5e9-d74d789e08ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:46.129776 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-87c9758e-c358-46dd-a5e9-d74d789e08ac None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:46.130911 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-87c9758e-c358-46dd-a5e9-d74d789e08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:46.191662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1081/2151] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:46.202000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:46.203532 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:46.304025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad2180e-09df-41b8-8684-f5a80771acb8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:46.309441 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06781c8-59b3-4595-9eaa-9dd2277b42f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:46.310106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06781c8-59b3-4595-9eaa-9dd2277b42f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:46.316729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06781c8-59b3-4595-9eaa-9dd2277b42f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:46.316729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06781c8-59b3-4595-9eaa-9dd2277b42f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:46.331018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06781c8-59b3-4595-9eaa-9dd2277b42f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:46.331018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06781c8-59b3-4595-9eaa-9dd2277b42f5 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:46.338881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1071/2152] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:46.985671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9758e-c358-46dd-a5e9-d74d789e08ac None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:46.987992 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-87c9758e-c358-46dd-a5e9-d74d789e08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:47.004749 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9758e-c358-46dd-a5e9-d74d789e08ac None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:47.010849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:47.011766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:47.012004 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:47.012284 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67 admin admin] PATH_INFO: `/v3/projects/f4cbddd0130c4b77b2df7f28d21ccc10` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:47.013742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4cbddd0130c4b77b2df7f28d21ccc10)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:47.015833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:47.158743 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4cbddd0130c4b77b2df7f28d21ccc10', 'request_id': 'req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.277529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4cbddd0130c4b77b2df7f28d21ccc10', 'request_id': 'req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.284357 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4cbddd0130c4b77b2df7f28d21ccc10', 'request_id': 'req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.295719 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67 admin admin] The token cache is being invalidate because project f4cbddd0130c4b77b2df7f28d21ccc10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:47.296006 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.296654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f1ba6d4c-e6c2-4803-b2cd-5f99d165be67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:47.298257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1082/2153] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:46 2022] DELETE /identity/v3/projects/f4cbddd0130c4b77b2df7f28d21ccc10 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:47.783792 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:48.234670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:51.463797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:51.901521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:53.383299 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:53.544948 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06781c8-59b3-4595-9eaa-9dd2277b42f5 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:53.546348 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d06781c8-59b3-4595-9eaa-9dd2277b42f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:53.559787 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06781c8-59b3-4595-9eaa-9dd2277b42f5 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:53.566039 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:53.616740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:53.617644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:53.617924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:53.618198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] PATH_INFO: `/v3/users/019026ebf4d24a3a9b10a9386b1e1d34` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:53.620268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=019026ebf4d24a3a9b10a9386b1e1d34)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:53.622258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:53.877946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '019026ebf4d24a3a9b10a9386b1e1d34'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:53.890594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '019026ebf4d24a3a9b10a9386b1e1d34'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:53.977288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '019026ebf4d24a3a9b10a9386b1e1d34'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:53.978074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '019026ebf4d24a3a9b10a9386b1e1d34'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:53.978724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '019026ebf4d24a3a9b10a9386b1e1d34'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:53.991333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1072/2154] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:53 2022] DELETE /identity/v3/users/019026ebf4d24a3a9b10a9386b1e1d34 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:53.995920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c90c8b-e8c0-4a3e-94e7-583e0caeba92 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:53.996211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c90c8b-e8c0-4a3e-94e7-583e0caeba92 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:53.996490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c90c8b-e8c0-4a3e-94e7-583e0caeba92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:54.014759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-66c90c8b-e8c0-4a3e-94e7-583e0caeba92 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:54.016018 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-66c90c8b-e8c0-4a3e-94e7-583e0caeba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:54.099092 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1083/2155] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:54.108773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:54.110243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:54.166768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224bc9c7-71a5-4f95-a879-24557d71e536 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:54.170444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de8584-f3f8-455d-88e5-166c0f76c980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:54.171093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de8584-f3f8-455d-88e5-166c0f76c980 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:54.171378 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de8584-f3f8-455d-88e5-166c0f76c980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:54.171655 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de8584-f3f8-455d-88e5-166c0f76c980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:54.180637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de8584-f3f8-455d-88e5-166c0f76c980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:54.182793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de8584-f3f8-455d-88e5-166c0f76c980 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:54.192092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1073/2156] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:54.474888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:54.779843 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c90c8b-e8c0-4a3e-94e7-583e0caeba92 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:54.781465 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-66c90c8b-e8c0-4a3e-94e7-583e0caeba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:54.797581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c90c8b-e8c0-4a3e-94e7-583e0caeba92 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:54.803440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b977d57-ae5c-4073-8c0b-2de36df42937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:54.805577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b977d57-ae5c-4073-8c0b-2de36df42937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:54.806013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b977d57-ae5c-4073-8c0b-2de36df42937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:54.806582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b977d57-ae5c-4073-8c0b-2de36df42937 admin admin] PATH_INFO: `/v3/projects/70c06920d03c432885d7074b3610b304` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:54.816338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b977d57-ae5c-4073-8c0b-2de36df42937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c06920d03c432885d7074b3610b304)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:54.818495 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b977d57-ae5c-4073-8c0b-2de36df42937 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:54.991454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8b977d57-ae5c-4073-8c0b-2de36df42937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c06920d03c432885d7074b3610b304', 'request_id': 'req-8b977d57-ae5c-4073-8c0b-2de36df42937'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:55.080229 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8b977d57-ae5c-4073-8c0b-2de36df42937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c06920d03c432885d7074b3610b304', 'request_id': 'req-8b977d57-ae5c-4073-8c0b-2de36df42937'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:55.087663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8b977d57-ae5c-4073-8c0b-2de36df42937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c06920d03c432885d7074b3610b304', 'request_id': 'req-8b977d57-ae5c-4073-8c0b-2de36df42937'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:55.098391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8b977d57-ae5c-4073-8c0b-2de36df42937 admin admin] The token cache is being invalidate because project 70c06920d03c432885d7074b3610b304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:13:55.098699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8b977d57-ae5c-4073-8c0b-2de36df42937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:55.099343 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8b977d57-ae5c-4073-8c0b-2de36df42937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:55.100970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1084/2157] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:13:54 2022] DELETE /identity/v3/projects/70c06920d03c432885d7074b3610b304 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:55.106675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca782be6-20af-4d5c-9e92-ac4d68a5ab01 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:55.107157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca782be6-20af-4d5c-9e92-ac4d68a5ab01 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:55.107261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca782be6-20af-4d5c-9e92-ac4d68a5ab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:55.153203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ca782be6-20af-4d5c-9e92-ac4d68a5ab01 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:55.154411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ca782be6-20af-4d5c-9e92-ac4d68a5ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:55.169404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:55.215461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1074/2158] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:55.224512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1617759-3651-427b-b289-8fa8830754c4 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:55.224835 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1617759-3651-427b-b289-8fa8830754c4 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:55.225128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1617759-3651-427b-b289-8fa8830754c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:55.243709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-f1617759-3651-427b-b289-8fa8830754c4 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:55.244955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f1617759-3651-427b-b289-8fa8830754c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:55.253113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1085/2159] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:55.257395 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca782be6-20af-4d5c-9e92-ac4d68a5ab01 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:55.266634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:55.268784 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca782be6-20af-4d5c-9e92-ac4d68a5ab01 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:55.274067 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221db0da-28b1-4656-947c-6fcfb10b0ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:55.275382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221db0da-28b1-4656-947c-6fcfb10b0ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:55.275669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221db0da-28b1-4656-947c-6fcfb10b0ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:55.275985 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221db0da-28b1-4656-947c-6fcfb10b0ef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:55.276731 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221db0da-28b1-4656-947c-6fcfb10b0ef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:13:55.277076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221db0da-28b1-4656-947c-6fcfb10b0ef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:55.278693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221db0da-28b1-4656-947c-6fcfb10b0ef7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:55.291036 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1075/2160] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:13:55.295667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1617759-3651-427b-b289-8fa8830754c4 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:55.305176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1617759-3651-427b-b289-8fa8830754c4 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:55.310527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bcbb9-4eb5-4392-b8e1-8301fa01d5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:55.311217 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bcbb9-4eb5-4392-b8e1-8301fa01d5af admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:55.311557 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bcbb9-4eb5-4392-b8e1-8301fa01d5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:55.311893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4bcbb9-4eb5-4392-b8e1-8301fa01d5af admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:55.312606 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bcbb9-4eb5-4392-b8e1-8301fa01d5af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:55.314576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4bcbb9-4eb5-4392-b8e1-8301fa01d5af admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:55.405897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1086/2161] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:13:55 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:13:55.407041 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221db0da-28b1-4656-947c-6fcfb10b0ef7 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:55.418084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221db0da-28b1-4656-947c-6fcfb10b0ef7 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:55.476935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345e3f3-fb69-42c1-96fe-ce517538227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:55.477616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345e3f3-fb69-42c1-96fe-ce517538227b admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:55.478071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345e3f3-fb69-42c1-96fe-ce517538227b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:55.478357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345e3f3-fb69-42c1-96fe-ce517538227b admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:55.479078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345e3f3-fb69-42c1-96fe-ce517538227b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:55.481006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345e3f3-fb69-42c1-96fe-ce517538227b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:55.603916 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1076/2162] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:13:55 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:13:55.607889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bcbb9-4eb5-4392-b8e1-8301fa01d5af admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:55.618155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4bcbb9-4eb5-4392-b8e1-8301fa01d5af admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:55.623306 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170500e-bd79-4a76-80ca-7897b41bb5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:55.623963 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170500e-bd79-4a76-80ca-7897b41bb5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:55.624249 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170500e-bd79-4a76-80ca-7897b41bb5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:55.624531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170500e-bd79-4a76-80ca-7897b41bb5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:55.625779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170500e-bd79-4a76-80ca-7897b41bb5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:55.627126 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170500e-bd79-4a76-80ca-7897b41bb5f3 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:55.641831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1087/2163] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:55.643030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345e3f3-fb69-42c1-96fe-ce517538227b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:55.655839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345e3f3-fb69-42c1-96fe-ce517538227b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:55.660449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47b760c-5e51-43b4-98a4-f25b9d77e5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:55.661145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b760c-5e51-43b4-98a4-f25b9d77e5fa admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:55.661437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b760c-5e51-43b4-98a4-f25b9d77e5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:55.661766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b760c-5e51-43b4-98a4-f25b9d77e5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:55.662499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b760c-5e51-43b4-98a4-f25b9d77e5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:55.664111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47b760c-5e51-43b4-98a4-f25b9d77e5fa admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:55.675884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1077/2164] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:13:55.681818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170500e-bd79-4a76-80ca-7897b41bb5f3 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:55.693238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170500e-bd79-4a76-80ca-7897b41bb5f3 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:55.699101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22ff2b-c6d7-4c04-b17b-467fb9b8bf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:55.699993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22ff2b-c6d7-4c04-b17b-467fb9b8bf2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:55.700303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22ff2b-c6d7-4c04-b17b-467fb9b8bf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:55.700582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22ff2b-c6d7-4c04-b17b-467fb9b8bf2c admin admin] PATH_INFO: `/v3/projects/3a91e890b4f847dabd4aa8ccde18e7be/users/db46212b8350499e8004369bb3358d59/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:55.716379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22ff2b-c6d7-4c04-b17b-467fb9b8bf2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a91e890b4f847dabd4aa8ccde18e7be, user_id=db46212b8350499e8004369bb3358d59, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:55.719129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c22ff2b-c6d7-4c04-b17b-467fb9b8bf2c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:55.800645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1088/2165] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:13:55 2022] PUT /identity/v3/projects/3a91e890b4f847dabd4aa8ccde18e7be/users/db46212b8350499e8004369bb3358d59/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:55.811741 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781b3fd-7301-42f6-add9-1e5099aca375 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:55.812037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781b3fd-7301-42f6-add9-1e5099aca375 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:55.812275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781b3fd-7301-42f6-add9-1e5099aca375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:55.845621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c781b3fd-7301-42f6-add9-1e5099aca375 None None] MFA Rules not processed for user `db46212b8350499e8004369bb3358d59`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:55.846917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c781b3fd-7301-42f6-add9-1e5099aca375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:55.919036 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1078/2166] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:13:55.930194 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22ff2b-c6d7-4c04-b17b-467fb9b8bf2c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:55.932617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7c22ff2b-c6d7-4c04-b17b-467fb9b8bf2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:13:55.990629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22ff2b-c6d7-4c04-b17b-467fb9b8bf2c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:55.995414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac34f-11a8-49c4-b226-55c7b1eff19a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:55.996139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac34f-11a8-49c4-b226-55c7b1eff19a service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:55.996527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac34f-11a8-49c4-b226-55c7b1eff19a service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:55.996830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac34f-11a8-49c4-b226-55c7b1eff19a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:56.005958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ac34f-11a8-49c4-b226-55c7b1eff19a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:56.007422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ac34f-11a8-49c4-b226-55c7b1eff19a service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:56.016383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1089/2167] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:13:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:13:56.069561 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:56.136160 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:57.874560 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:58.012267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:59.416562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781b3fd-7301-42f6-add9-1e5099aca375 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:13:59.483481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781b3fd-7301-42f6-add9-1e5099aca375 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:13:59.488212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:13:59.489229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:59.489511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:59.489799 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] PATH_INFO: `/v3/users/db46212b8350499e8004369bb3358d59` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:59.490988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db46212b8350499e8004369bb3358d59)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:13:59.493003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:13:59.596425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:59.668940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:13:59.745504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db46212b8350499e8004369bb3358d59'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:59.757187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db46212b8350499e8004369bb3358d59'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:59.920201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db46212b8350499e8004369bb3358d59'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:59.920749 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db46212b8350499e8004369bb3358d59'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:59.921396 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db46212b8350499e8004369bb3358d59'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:13:59.934823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1079/2168] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:13:59 2022] DELETE /identity/v3/users/db46212b8350499e8004369bb3358d59 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:13:59.939233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49d8a6-5ce0-4e42-94be-acdacad8428e None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:13:59.939525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49d8a6-5ce0-4e42-94be-acdacad8428e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:13:59.939803 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49d8a6-5ce0-4e42-94be-acdacad8428e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:13:59.957912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-4b49d8a6-5ce0-4e42-94be-acdacad8428e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:13:59.959134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4b49d8a6-5ce0-4e42-94be-acdacad8428e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:00.016288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1090/2169] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:13:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:00.027443 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:00.028957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:00.087237 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49855a2e-920e-42ef-b399-91054b829742 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:00.090875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac754106-055d-40ff-a1ba-019b563e0ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:00.091531 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754106-055d-40ff-a1ba-019b563e0ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:00.091816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754106-055d-40ff-a1ba-019b563e0ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:00.092096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754106-055d-40ff-a1ba-019b563e0ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:00.102500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac754106-055d-40ff-a1ba-019b563e0ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:00.104120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac754106-055d-40ff-a1ba-019b563e0ac2 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:00.114068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1080/2170] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:00.503279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:00.694633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49d8a6-5ce0-4e42-94be-acdacad8428e None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:00.696180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4b49d8a6-5ce0-4e42-94be-acdacad8428e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:00.727547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b49d8a6-5ce0-4e42-94be-acdacad8428e None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:00.727547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765eb5e-cad9-474d-bc64-c53d737a566d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:00.727547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765eb5e-cad9-474d-bc64-c53d737a566d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:00.727547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765eb5e-cad9-474d-bc64-c53d737a566d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:00.728745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765eb5e-cad9-474d-bc64-c53d737a566d admin admin] PATH_INFO: `/v3/projects/3a91e890b4f847dabd4aa8ccde18e7be` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:00.729062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765eb5e-cad9-474d-bc64-c53d737a566d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a91e890b4f847dabd4aa8ccde18e7be)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:00.731261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765eb5e-cad9-474d-bc64-c53d737a566d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:00.889155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4765eb5e-cad9-474d-bc64-c53d737a566d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a91e890b4f847dabd4aa8ccde18e7be', 'request_id': 'req-4765eb5e-cad9-474d-bc64-c53d737a566d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:00.982992 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4765eb5e-cad9-474d-bc64-c53d737a566d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a91e890b4f847dabd4aa8ccde18e7be', 'request_id': 'req-4765eb5e-cad9-474d-bc64-c53d737a566d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:00.990108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4765eb5e-cad9-474d-bc64-c53d737a566d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a91e890b4f847dabd4aa8ccde18e7be', 'request_id': 'req-4765eb5e-cad9-474d-bc64-c53d737a566d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:01.002305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4765eb5e-cad9-474d-bc64-c53d737a566d admin admin] The token cache is being invalidate because project 3a91e890b4f847dabd4aa8ccde18e7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:14:01.002599 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4765eb5e-cad9-474d-bc64-c53d737a566d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:01.003359 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4765eb5e-cad9-474d-bc64-c53d737a566d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:01.005450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1091/2171] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:14:00 2022] DELETE /identity/v3/projects/3a91e890b4f847dabd4aa8ccde18e7be => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:01.010914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d5db3-312e-4382-b4fb-61792d3a3ba8 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:01.011255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d5db3-312e-4382-b4fb-61792d3a3ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:01.011576 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d5db3-312e-4382-b4fb-61792d3a3ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:01.032074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f20d5db3-312e-4382-b4fb-61792d3a3ba8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:01.033331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f20d5db3-312e-4382-b4fb-61792d3a3ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:01.095324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1081/2172] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:01.103523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbb5f5-77e6-457d-b59f-3aec3f7b45f2 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:01.103815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbb5f5-77e6-457d-b59f-3aec3f7b45f2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:01.104098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbb5f5-77e6-457d-b59f-3aec3f7b45f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:01.123733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-bffbb5f5-77e6-457d-b59f-3aec3f7b45f2 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:01.125024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-bffbb5f5-77e6-457d-b59f-3aec3f7b45f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:01.133019 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1092/2173] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:01.138057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d5db3-312e-4382-b4fb-61792d3a3ba8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:01.148108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d5db3-312e-4382-b4fb-61792d3a3ba8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:01.153881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221fb96-fea6-48c1-a413-6bec74256947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:01.153881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221fb96-fea6-48c1-a413-6bec74256947 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:01.154142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221fb96-fea6-48c1-a413-6bec74256947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:01.154424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221fb96-fea6-48c1-a413-6bec74256947 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:01.155148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221fb96-fea6-48c1-a413-6bec74256947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:14:01.155453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221fb96-fea6-48c1-a413-6bec74256947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:01.157061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221fb96-fea6-48c1-a413-6bec74256947 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:01.169591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1082/2174] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:14:01.173866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbb5f5-77e6-457d-b59f-3aec3f7b45f2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:01.184274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbb5f5-77e6-457d-b59f-3aec3f7b45f2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:01.189021 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167c92e-d4cd-41b1-bfdc-e56092f2b4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:01.189667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c92e-d4cd-41b1-bfdc-e56092f2b4fd admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:01.189947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c92e-d4cd-41b1-bfdc-e56092f2b4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:01.190351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167c92e-d4cd-41b1-bfdc-e56092f2b4fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:01.191059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167c92e-d4cd-41b1-bfdc-e56092f2b4fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:01.193063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167c92e-d4cd-41b1-bfdc-e56092f2b4fd admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:01.230242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:01.319368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1093/2175] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:14:01 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:14:01.323194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221fb96-fea6-48c1-a413-6bec74256947 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:01.333169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221fb96-fea6-48c1-a413-6bec74256947 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:01.396183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88507c8-9175-429e-9b4a-9548cef4bb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:01.397163 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88507c8-9175-429e-9b4a-9548cef4bb1e admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:01.402290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88507c8-9175-429e-9b4a-9548cef4bb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:01.402290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88507c8-9175-429e-9b4a-9548cef4bb1e admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:01.402290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88507c8-9175-429e-9b4a-9548cef4bb1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:01.402290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88507c8-9175-429e-9b4a-9548cef4bb1e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:01.514703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1083/2176] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:14:01 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:14:01.518737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167c92e-d4cd-41b1-bfdc-e56092f2b4fd admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:01.529981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167c92e-d4cd-41b1-bfdc-e56092f2b4fd admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:01.536794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eeb31-fa03-4558-8f33-32ef0c8aebc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:01.536794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eeb31-fa03-4558-8f33-32ef0c8aebc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:01.536794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eeb31-fa03-4558-8f33-32ef0c8aebc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:01.536794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eeb31-fa03-4558-8f33-32ef0c8aebc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:01.537188 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645eeb31-fa03-4558-8f33-32ef0c8aebc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:01.538157 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645eeb31-fa03-4558-8f33-32ef0c8aebc8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:01.550163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1094/2177] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:14:01.554058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88507c8-9175-429e-9b4a-9548cef4bb1e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:01.564336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88507c8-9175-429e-9b4a-9548cef4bb1e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:01.571116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a404d-c9d0-4c8f-a385-3dcaa075f6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:01.571116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a404d-c9d0-4c8f-a385-3dcaa075f6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:01.571116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a404d-c9d0-4c8f-a385-3dcaa075f6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:01.571116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a404d-c9d0-4c8f-a385-3dcaa075f6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:01.571517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a404d-c9d0-4c8f-a385-3dcaa075f6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:01.572966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a404d-c9d0-4c8f-a385-3dcaa075f6e9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:01.582922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1084/2178] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:14:01.586907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eeb31-fa03-4558-8f33-32ef0c8aebc8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:01.597607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eeb31-fa03-4558-8f33-32ef0c8aebc8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:01.602183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7512a98-1f7b-4776-8644-87f4c54361df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:01.603858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7512a98-1f7b-4776-8644-87f4c54361df admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:01.603964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7512a98-1f7b-4776-8644-87f4c54361df admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:01.604201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7512a98-1f7b-4776-8644-87f4c54361df admin admin] PATH_INFO: `/v3/projects/722bc393778647538509f49c94611e7a/users/77000db4de044ceda00decb28c0d86a2/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:01.618777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7512a98-1f7b-4776-8644-87f4c54361df admin admin] RBAC: Authorizing `identity:create_grant(project_id=722bc393778647538509f49c94611e7a, user_id=77000db4de044ceda00decb28c0d86a2, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:01.621517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7512a98-1f7b-4776-8644-87f4c54361df admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:01.698341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1095/2179] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:14:01 2022] PUT /identity/v3/projects/722bc393778647538509f49c94611e7a/users/77000db4de044ceda00decb28c0d86a2/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:14:01.709709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c1848-90a5-4f51-9199-aae25d33a748 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:01.710065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c1848-90a5-4f51-9199-aae25d33a748 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:01.710288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c1848-90a5-4f51-9199-aae25d33a748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:01.718472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:01.747050 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-981c1848-90a5-4f51-9199-aae25d33a748 None None] MFA Rules not processed for user `77000db4de044ceda00decb28c0d86a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:01.747050 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-981c1848-90a5-4f51-9199-aae25d33a748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:01.815550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1085/2180] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:14:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:01.831502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7512a98-1f7b-4776-8644-87f4c54361df admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:01.833284 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b7512a98-1f7b-4776-8644-87f4c54361df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:01.893624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7512a98-1f7b-4776-8644-87f4c54361df admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:01.897559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4606477-e7e2-4a06-962d-5c7ed17a2060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:01.898211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4606477-e7e2-4a06-962d-5c7ed17a2060 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:01.898496 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4606477-e7e2-4a06-962d-5c7ed17a2060 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:01.898779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4606477-e7e2-4a06-962d-5c7ed17a2060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:01.907605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4606477-e7e2-4a06-962d-5c7ed17a2060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:01.909147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4606477-e7e2-4a06-962d-5c7ed17a2060 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:01.919001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1096/2181] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:01.951703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c1848-90a5-4f51-9199-aae25d33a748 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:02.007840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c1848-90a5-4f51-9199-aae25d33a748 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:02.012684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:02.013589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:02.013883 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:02.014164 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] PATH_INFO: `/v3/users/77000db4de044ceda00decb28c0d86a2` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:02.015422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=77000db4de044ceda00decb28c0d86a2)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:02.017455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:02.029770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:02.324896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77000db4de044ceda00decb28c0d86a2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:02.340137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77000db4de044ceda00decb28c0d86a2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:02.443331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77000db4de044ceda00decb28c0d86a2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:02.444142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77000db4de044ceda00decb28c0d86a2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:02.444877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77000db4de044ceda00decb28c0d86a2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:02.460597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1086/2182] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:14:01 2022] DELETE /identity/v3/users/77000db4de044ceda00decb28c0d86a2 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:02.465149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3875610-6d2b-405f-95cf-f1f4e1c4da3c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:02.465617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3875610-6d2b-405f-95cf-f1f4e1c4da3c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:02.465913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3875610-6d2b-405f-95cf-f1f4e1c4da3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:02.485480 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-a3875610-6d2b-405f-95cf-f1f4e1c4da3c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:02.487576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-a3875610-6d2b-405f-95cf-f1f4e1c4da3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:02.514684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:02.549352 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1097/2183] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:02.559817 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:02.561432 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:02.619943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9649f2-1966-4ed0-b813-cb9ef9eee34b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:02.623532 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc709271-e801-4d77-9768-137d19525d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:02.624185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc709271-e801-4d77-9768-137d19525d30 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:02.624465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc709271-e801-4d77-9768-137d19525d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:02.624740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc709271-e801-4d77-9768-137d19525d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:02.634875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:02.636575 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc709271-e801-4d77-9768-137d19525d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:02.636575 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc709271-e801-4d77-9768-137d19525d30 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:02.646286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1087/2184] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:02.801066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:03.070985 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:03.233345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3875610-6d2b-405f-95cf-f1f4e1c4da3c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:03.235464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-a3875610-6d2b-405f-95cf-f1f4e1c4da3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:03.247311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3875610-6d2b-405f-95cf-f1f4e1c4da3c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:03.252718 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:03.253644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:03.253950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:03.257069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] PATH_INFO: `/v3/projects/722bc393778647538509f49c94611e7a` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:03.259723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=722bc393778647538509f49c94611e7a)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:03.262204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:03.378234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:03.385633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722bc393778647538509f49c94611e7a', 'request_id': 'req-43c83666-c943-46ac-9967-2553981c2e43'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:03.448818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722bc393778647538509f49c94611e7a', 'request_id': 'req-43c83666-c943-46ac-9967-2553981c2e43'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:03.455396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722bc393778647538509f49c94611e7a', 'request_id': 'req-43c83666-c943-46ac-9967-2553981c2e43'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:03.465583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] The token cache is being invalidate because project 722bc393778647538509f49c94611e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:14:03.465876 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:03.466580 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:14:03.468208 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1098/2185] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:14:03 2022] DELETE /identity/v3/projects/722bc393778647538509f49c94611e7a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:14:03.558065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:03.840758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:03.884016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:04.180947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:04.230913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:04.394885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:04.594988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:04.726168 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:05.458417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:05.703236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:05.958399 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84826ed6-9620-4e85-a91d-5f80d0e5e4ba None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:05.958590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84826ed6-9620-4e85-a91d-5f80d0e5e4ba None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:05.958884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84826ed6-9620-4e85-a91d-5f80d0e5e4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:05.977470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-84826ed6-9620-4e85-a91d-5f80d0e5e4ba None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:05.978711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-84826ed6-9620-4e85-a91d-5f80d0e5e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:06.036560 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1088/2186] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jun 23 13:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:06.050682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:06.052150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:06.160843 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c83666-c943-46ac-9967-2553981c2e43 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:06.166421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea2615-785e-4e1a-b142-faa1bf59d8c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:06.167119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea2615-785e-4e1a-b142-faa1bf59d8c5 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:06.167540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea2615-785e-4e1a-b142-faa1bf59d8c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:06.167941 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea2615-785e-4e1a-b142-faa1bf59d8c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:06.176689 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea2615-785e-4e1a-b142-faa1bf59d8c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:06.178305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea2615-785e-4e1a-b142-faa1bf59d8c5 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:06.189024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1099/2187] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:06.190716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.301178 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.434490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.517677 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.604263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.715303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.764211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.960499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:06.989166 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.375315 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.404968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.589344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.617720 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.811906 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.840629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:07.992309 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:08.020796 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:08.108945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:08.286539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:08.392524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:12.294637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f84e-ad1f-4d50-89eb-9467af1b2b67 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:12.295222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f84e-ad1f-4d50-89eb-9467af1b2b67 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:12.295222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6f84e-ad1f-4d50-89eb-9467af1b2b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:12.314176 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d8c6f84e-ad1f-4d50-89eb-9467af1b2b67 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:12.315349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d8c6f84e-ad1f-4d50-89eb-9467af1b2b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:12.324422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1089/2188] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jun 23 13:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:12.348259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea2615-785e-4e1a-b142-faa1bf59d8c5 service nova] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:12.349899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ecea2615-785e-4e1a-b142-faa1bf59d8c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:12.366438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea2615-785e-4e1a-b142-faa1bf59d8c5 service nova] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:12.373154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ccd44-91eb-423a-8243-67757672dfa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:12.373930 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ccd44-91eb-423a-8243-67757672dfa3 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:12.374326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ccd44-91eb-423a-8243-67757672dfa3 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:12.374671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ccd44-91eb-423a-8243-67757672dfa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:12.383604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ccd44-91eb-423a-8243-67757672dfa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:12.385859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ccd44-91eb-423a-8243-67757672dfa3 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:12.395601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1100/2189] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:13.888493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17cd03-49b7-41d5-bfea-d428be9fa6a8 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:13.889087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17cd03-49b7-41d5-bfea-d428be9fa6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:13.889087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17cd03-49b7-41d5-bfea-d428be9fa6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:13.910634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2c17cd03-49b7-41d5-bfea-d428be9fa6a8 None None] MFA Rules not processed for user `824c74155450401ba02db90ff00aa9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:13.911867 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2c17cd03-49b7-41d5-bfea-d428be9fa6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:13.957116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:13.980280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1090/2190] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:14:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:15.941327 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601892c-4e81-4bbf-a810-bb02c01fdd7a None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:15.941909 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601892c-4e81-4bbf-a810-bb02c01fdd7a None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:15.941909 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601892c-4e81-4bbf-a810-bb02c01fdd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:15.960539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-a601892c-4e81-4bbf-a810-bb02c01fdd7a None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:15.962106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-a601892c-4e81-4bbf-a810-bb02c01fdd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:15.971741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1101/2191] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jun 23 13:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:15.988714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17cd03-49b7-41d5-bfea-d428be9fa6a8 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:16.001876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17cd03-49b7-41d5-bfea-d428be9fa6a8 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:16.007758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eae617-7bab-4041-a636-7887000f00d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:16.008413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eae617-7bab-4041-a636-7887000f00d2 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:16.008695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eae617-7bab-4041-a636-7887000f00d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:16.009009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eae617-7bab-4041-a636-7887000f00d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:16.017808 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eae617-7bab-4041-a636-7887000f00d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:16.020527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eae617-7bab-4041-a636-7887000f00d2 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:16.029627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1091/2192] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:19.670760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0362d99-4268-4f7b-a0c6-16c6f7618951 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:19.670760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0362d99-4268-4f7b-a0c6-16c6f7618951 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:19.671598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0362d99-4268-4f7b-a0c6-16c6f7618951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:19.692483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d0362d99-4268-4f7b-a0c6-16c6f7618951 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:19.694103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d0362d99-4268-4f7b-a0c6-16c6f7618951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:19.704955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1102/2193] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jun 23 13:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:19.719851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eae617-7bab-4041-a636-7887000f00d2 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:19.733257 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eae617-7bab-4041-a636-7887000f00d2 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:19.739226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5c55d-eaa3-43f1-883a-55905952d26c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:19.740330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5c55d-eaa3-43f1-883a-55905952d26c service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:19.740611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5c55d-eaa3-43f1-883a-55905952d26c service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:19.741019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5c55d-eaa3-43f1-883a-55905952d26c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:19.751068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5c55d-eaa3-43f1-883a-55905952d26c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:19.753199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5c55d-eaa3-43f1-883a-55905952d26c service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:19.765099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1092/2194] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:23.976609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89786a0e-6806-40ad-bc8e-dd716b5fa4a6 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:23.977134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89786a0e-6806-40ad-bc8e-dd716b5fa4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:23.977224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89786a0e-6806-40ad-bc8e-dd716b5fa4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:23.995907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-89786a0e-6806-40ad-bc8e-dd716b5fa4a6 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:23.997207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-89786a0e-6806-40ad-bc8e-dd716b5fa4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:24.005690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1103/2195] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jun 23 13:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:24.029863 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5c55d-eaa3-43f1-883a-55905952d26c service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:24.041129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5c55d-eaa3-43f1-883a-55905952d26c service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:24.047170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d93fc-2ff0-44e8-b716-8aae237103da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:24.047803 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d93fc-2ff0-44e8-b716-8aae237103da service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:24.048086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d93fc-2ff0-44e8-b716-8aae237103da service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:24.048360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d93fc-2ff0-44e8-b716-8aae237103da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:24.056415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d93fc-2ff0-44e8-b716-8aae237103da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:24.058191 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d93fc-2ff0-44e8-b716-8aae237103da service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:24.067645 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1093/2196] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:26.477118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce9477-9cf7-4312-9a60-29f2c5275a20 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:26.477622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce9477-9cf7-4312-9a60-29f2c5275a20 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:26.477730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce9477-9cf7-4312-9a60-29f2c5275a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:26.508685 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-42ce9477-9cf7-4312-9a60-29f2c5275a20 None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:26.509927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-42ce9477-9cf7-4312-9a60-29f2c5275a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:26.570319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1104/2197] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:14:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:26.621030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d93fc-2ff0-44e8-b716-8aae237103da service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:26.622659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9b9d93fc-2ff0-44e8-b716-8aae237103da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:26.720361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d93fc-2ff0-44e8-b716-8aae237103da service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:26.725525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbffbed-f5de-4ec2-af41-a39a334514c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:26.726178 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbffbed-f5de-4ec2-af41-a39a334514c6 service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:26.726457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbffbed-f5de-4ec2-af41-a39a334514c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:26.726733 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbffbed-f5de-4ec2-af41-a39a334514c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:26.735567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbffbed-f5de-4ec2-af41-a39a334514c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:26.737372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbffbed-f5de-4ec2-af41-a39a334514c6 service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:26.745454 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1094/2198] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:14:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:14:28.266807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0f59c-fc87-42e1-8f51-26f4a13845f6 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:28.267403 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0f59c-fc87-42e1-8f51-26f4a13845f6 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:28.267403 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e0f59c-fc87-42e1-8f51-26f4a13845f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:28.292232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-c7e0f59c-fc87-42e1-8f51-26f4a13845f6 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:28.293744 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c7e0f59c-fc87-42e1-8f51-26f4a13845f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:28.303008 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1105/2199] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jun 23 13:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:28.326645 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbffbed-f5de-4ec2-af41-a39a334514c6 service swift] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:28.355136 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbffbed-f5de-4ec2-af41-a39a334514c6 service swift] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:28.363115 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe72d25-4160-4ce1-8f2e-08f745365e56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:28.364106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe72d25-4160-4ce1-8f2e-08f745365e56 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:28.367202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe72d25-4160-4ce1-8f2e-08f745365e56 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:28.367691 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe72d25-4160-4ce1-8f2e-08f745365e56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:28.380390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe72d25-4160-4ce1-8f2e-08f745365e56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:28.382291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe72d25-4160-4ce1-8f2e-08f745365e56 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:28.396840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1095/2200] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:38.284284 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=73 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:38.391555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=62 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:14:48.780948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f8dfe-8b9f-4161-b5f6-06b339bb36ec None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:48.781536 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f8dfe-8b9f-4161-b5f6-06b339bb36ec None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:48.781536 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f8dfe-8b9f-4161-b5f6-06b339bb36ec None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:48.782889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1106/2201] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:14:48.788757 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea83a-82ac-48eb-888e-402c949bc5ef None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:48.789287 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea83a-82ac-48eb-888e-402c949bc5ef None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:48.789556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea83a-82ac-48eb-888e-402c949bc5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:48.841394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f5eea83a-82ac-48eb-888e-402c949bc5ef None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:48.842800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f5eea83a-82ac-48eb-888e-402c949bc5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:48.853361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1096/2202] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:14:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:14:48.866797 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f8dfe-8b9f-4161-b5f6-06b339bb36ec None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:48.868516 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-488f8dfe-8b9f-4161-b5f6-06b339bb36ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:48.949231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f8dfe-8b9f-4161-b5f6-06b339bb36ec None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:48.953531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326148f-8d11-471c-bae7-f070872adfaf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6832291d504cff9e787c0d791c70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:48.954170 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326148f-8d11-471c-bae7-f070872adfaf service glance] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:48.954455 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326148f-8d11-471c-bae7-f070872adfaf service glance] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:48.954733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326148f-8d11-471c-bae7-f070872adfaf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:48.965014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326148f-8d11-471c-bae7-f070872adfaf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:48.966582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326148f-8d11-471c-bae7-f070872adfaf service glance] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:48.979321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1107/2203] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:49.199513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcb87c-39b5-4745-b53f-5841be3754ec None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:49.199821 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcb87c-39b5-4745-b53f-5841be3754ec None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:49.200118 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcb87c-39b5-4745-b53f-5841be3754ec None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:49.201706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1097/2204] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:14:49.206382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04864ab-a002-4c3d-8714-008d1fdfaa7d None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:49.210771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04864ab-a002-4c3d-8714-008d1fdfaa7d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:49.210771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04864ab-a002-4c3d-8714-008d1fdfaa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:49.224915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d04864ab-a002-4c3d-8714-008d1fdfaa7d None None] MFA Rules not processed for user `83858713769b41af800bab317602bf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:49.226105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d04864ab-a002-4c3d-8714-008d1fdfaa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:49.279132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1108/2205] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:14:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:49.290780 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcb87c-39b5-4745-b53f-5841be3754ec None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:49.292467 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-71fcb87c-39b5-4745-b53f-5841be3754ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:49.306258 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcb87c-39b5-4745-b53f-5841be3754ec None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:49.310320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440911a-02a3-4d8d-a344-7ffd292e0f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:49.310953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440911a-02a3-4d8d-a344-7ffd292e0f32 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:49.311238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440911a-02a3-4d8d-a344-7ffd292e0f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:49.311517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440911a-02a3-4d8d-a344-7ffd292e0f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:49.318717 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440911a-02a3-4d8d-a344-7ffd292e0f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:49.320139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1440911a-02a3-4d8d-a344-7ffd292e0f32 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:49.328372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1098/2206] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:49.449628 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3983403-a799-4f71-8cef-2ddcac96ad26 None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:49.450050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3983403-a799-4f71-8cef-2ddcac96ad26 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:49.451015 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3983403-a799-4f71-8cef-2ddcac96ad26 None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:49.452896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1109/2207] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:14:49.458689 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb8ea0-7dd9-4c88-be51-630f38db1d4b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:49.458991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb8ea0-7dd9-4c88-be51-630f38db1d4b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:49.459286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb8ea0-7dd9-4c88-be51-630f38db1d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:49.478229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-17eb8ea0-7dd9-4c88-be51-630f38db1d4b None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:49.479441 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-17eb8ea0-7dd9-4c88-be51-630f38db1d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:49.489544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1099/2208] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:14:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:49.500257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3983403-a799-4f71-8cef-2ddcac96ad26 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:49.511435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3983403-a799-4f71-8cef-2ddcac96ad26 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:49.516761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e07754-3adc-4899-aff6-bd77146d1c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:49.517419 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e07754-3adc-4899-aff6-bd77146d1c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:49.517826 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e07754-3adc-4899-aff6-bd77146d1c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:49.518106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e07754-3adc-4899-aff6-bd77146d1c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:49.531289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e07754-3adc-4899-aff6-bd77146d1c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:49.532721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e07754-3adc-4899-aff6-bd77146d1c9d service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:49.545407 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1110/2209] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:14:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:14:51.085435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d17104-c3db-43aa-83c1-2db525ada0c6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:51.085972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d17104-c3db-43aa-83c1-2db525ada0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:51.085972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d17104-c3db-43aa-83c1-2db525ada0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:51.104538 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-54d17104-c3db-43aa-83c1-2db525ada0c6 None None] MFA Rules not processed for user `bcc7c2d5507c4f93afc59c8f5604eb24`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:51.105768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-54d17104-c3db-43aa-83c1-2db525ada0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:51.170071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1100/2210] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:14:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:52.705136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb892a-8a01-433f-9e74-2e405e9a1a8e None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:52.705676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb892a-8a01-433f-9e74-2e405e9a1a8e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:52.705771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb892a-8a01-433f-9e74-2e405e9a1a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:52.723913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-83bb892a-8a01-433f-9e74-2e405e9a1a8e None None] MFA Rules not processed for user `0ac9553e75a9408c80c0777f37c2b815`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:52.725124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-83bb892a-8a01-433f-9e74-2e405e9a1a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:52.782788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1111/2211] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:14:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:54.018051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e1fb-16ee-4ed6-9f80-37d30c10afdd None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:54.018965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e1fb-16ee-4ed6-9f80-37d30c10afdd None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:54.019275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376e1fb-16ee-4ed6-9f80-37d30c10afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:54.072634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e376e1fb-16ee-4ed6-9f80-37d30c10afdd None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:14:54.073963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e376e1fb-16ee-4ed6-9f80-37d30c10afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:14:54.092078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1101/2212] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:14:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:14:54.110737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb892a-8a01-433f-9e74-2e405e9a1a8e None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:14:54.132704 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb892a-8a01-433f-9e74-2e405e9a1a8e None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:14:54.140641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09b1e79-bf41-4632-876e-28936ec993f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:14:54.140641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b1e79-bf41-4632-876e-28936ec993f8 service swift] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:14:54.140641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b1e79-bf41-4632-876e-28936ec993f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:14:54.140641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b1e79-bf41-4632-876e-28936ec993f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:14:54.151144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b1e79-bf41-4632-876e-28936ec993f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:14:54.153361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09b1e79-bf41-4632-876e-28936ec993f8 service swift] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:14:54.162348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1112/2213] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:14:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:15:04.092170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=61 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:04.158787 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:07.249951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376e1fb-16ee-4ed6-9f80-37d30c10afdd None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:07.251490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e376e1fb-16ee-4ed6-9f80-37d30c10afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:07.354979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376e1fb-16ee-4ed6-9f80-37d30c10afdd None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:07.361829 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a42f72-89ad-496f-b7aa-2586f161e5b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b5745bfb5d4e6ca172bb8fab229e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:07.362690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a42f72-89ad-496f-b7aa-2586f161e5b7 service placement] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:07.362976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a42f72-89ad-496f-b7aa-2586f161e5b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:07.363255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a42f72-89ad-496f-b7aa-2586f161e5b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:07.365307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c2a42f72-89ad-496f-b7aa-2586f161e5b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:07.379931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a42f72-89ad-496f-b7aa-2586f161e5b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:07.381633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a42f72-89ad-496f-b7aa-2586f161e5b7 service placement] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:07.396374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1102/2214] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:13.170322 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91869b2-ae95-4b20-a7c3-dc0e7833a383 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:13.170972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91869b2-ae95-4b20-a7c3-dc0e7833a383 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:13.170972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91869b2-ae95-4b20-a7c3-dc0e7833a383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:13.188866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-c91869b2-ae95-4b20-a7c3-dc0e7833a383 None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:13.190057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c91869b2-ae95-4b20-a7c3-dc0e7833a383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:13.197138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1113/2215] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jun 23 13:15:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:13.210004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a42f72-89ad-496f-b7aa-2586f161e5b7 service placement] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:13.221065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a42f72-89ad-496f-b7aa-2586f161e5b7 service placement] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:13.225975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab00e0b-df15-42d6-9ba1-a232288a5eca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:13.226628 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab00e0b-df15-42d6-9ba1-a232288a5eca service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:13.226895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab00e0b-df15-42d6-9ba1-a232288a5eca service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:13.227173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab00e0b-df15-42d6-9ba1-a232288a5eca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:13.235858 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab00e0b-df15-42d6-9ba1-a232288a5eca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:13.237476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab00e0b-df15-42d6-9ba1-a232288a5eca service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:13.245450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1103/2216] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:15:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:15:23.183681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:23.242209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=47 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:24.701608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c18f0-7955-46ec-9277-bb0266edc5dd None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:24.702092 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c18f0-7955-46ec-9277-bb0266edc5dd None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:24.702197 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c18f0-7955-46ec-9277-bb0266edc5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:24.720485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ae3c18f0-7955-46ec-9277-bb0266edc5dd None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:24.721746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ae3c18f0-7955-46ec-9277-bb0266edc5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:24.729801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1114/2217] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jun 23 13:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:24.749864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab00e0b-df15-42d6-9ba1-a232288a5eca service swift] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:24.762221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab00e0b-df15-42d6-9ba1-a232288a5eca service swift] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:24.768587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d35667-6642-4026-ad80-bb2af88a0c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:24.770328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d35667-6642-4026-ad80-bb2af88a0c1d service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:24.770328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d35667-6642-4026-ad80-bb2af88a0c1d service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:24.770526 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d35667-6642-4026-ad80-bb2af88a0c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:24.779411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d35667-6642-4026-ad80-bb2af88a0c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:24.785405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d35667-6642-4026-ad80-bb2af88a0c1d service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:24.791634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1104/2218] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:28.218815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48ec3d-f7ca-415a-8c9d-f5404f45122f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:28.219376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48ec3d-f7ca-415a-8c9d-f5404f45122f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:28.219479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48ec3d-f7ca-415a-8c9d-f5404f45122f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:28.239463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-fa48ec3d-f7ca-415a-8c9d-f5404f45122f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:28.240675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fa48ec3d-f7ca-415a-8c9d-f5404f45122f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:28.249416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1115/2219] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jun 23 13:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:28.264459 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d35667-6642-4026-ad80-bb2af88a0c1d service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:28.275734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d35667-6642-4026-ad80-bb2af88a0c1d service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:28.282287 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5dfca-7319-4f4a-8def-6fe9ffeaf9b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:28.282930 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5dfca-7319-4f4a-8def-6fe9ffeaf9b8 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:28.283212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5dfca-7319-4f4a-8def-6fe9ffeaf9b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:28.283487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5dfca-7319-4f4a-8def-6fe9ffeaf9b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:28.291512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5dfca-7319-4f4a-8def-6fe9ffeaf9b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:28.293121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5dfca-7319-4f4a-8def-6fe9ffeaf9b8 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:28.303077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1105/2220] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:32.013590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6fa6f-d866-4d86-a7b0-eb1d54e92016 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:32.014108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6fa6f-d866-4d86-a7b0-eb1d54e92016 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:32.014214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae6fa6f-d866-4d86-a7b0-eb1d54e92016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:32.032512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-bae6fa6f-d866-4d86-a7b0-eb1d54e92016 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:32.033743 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-bae6fa6f-d866-4d86-a7b0-eb1d54e92016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:32.042195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1116/2221] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jun 23 13:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:32.057380 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5dfca-7319-4f4a-8def-6fe9ffeaf9b8 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:32.068672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5dfca-7319-4f4a-8def-6fe9ffeaf9b8 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:32.074266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79603a82-4d1b-4e2b-8f83-c12986fdb153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:32.074910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79603a82-4d1b-4e2b-8f83-c12986fdb153 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:32.075197 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79603a82-4d1b-4e2b-8f83-c12986fdb153 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:32.076290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79603a82-4d1b-4e2b-8f83-c12986fdb153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:32.084349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79603a82-4d1b-4e2b-8f83-c12986fdb153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:32.085985 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79603a82-4d1b-4e2b-8f83-c12986fdb153 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:32.095748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1106/2222] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:36.315740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f75f4f-47a6-4cec-8b55-6fef9dedf0a7 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:36.316304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f75f4f-47a6-4cec-8b55-6fef9dedf0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:36.316304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f75f4f-47a6-4cec-8b55-6fef9dedf0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:36.335044 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-f6f75f4f-47a6-4cec-8b55-6fef9dedf0a7 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:36.336251 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f6f75f4f-47a6-4cec-8b55-6fef9dedf0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:36.344884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1117/2223] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jun 23 13:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:36.367925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79603a82-4d1b-4e2b-8f83-c12986fdb153 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:36.379269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79603a82-4d1b-4e2b-8f83-c12986fdb153 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:36.384711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8154f29e-fa7e-4f55-bd6f-50027410f023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:36.385375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f29e-fa7e-4f55-bd6f-50027410f023 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:36.385668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f29e-fa7e-4f55-bd6f-50027410f023 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:36.386033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8154f29e-fa7e-4f55-bd6f-50027410f023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:36.395499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154f29e-fa7e-4f55-bd6f-50027410f023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:36.397106 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8154f29e-fa7e-4f55-bd6f-50027410f023 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:36.408013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1107/2224] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:40.712393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa52567-df16-4a8b-a3cf-67c7a3956b40 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:40.712928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa52567-df16-4a8b-a3cf-67c7a3956b40 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:40.713024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa52567-df16-4a8b-a3cf-67c7a3956b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:40.731908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-5fa52567-df16-4a8b-a3cf-67c7a3956b40 None None] MFA Rules not processed for user `824c74155450401ba02db90ff00aa9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:40.733162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5fa52567-df16-4a8b-a3cf-67c7a3956b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:40.740087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1118/2225] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:15:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:41.634703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bcde9-ccd7-4bf3-9de4-e4aa7b82992d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:41.635253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bcde9-ccd7-4bf3-9de4-e4aa7b82992d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:41.635253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bcde9-ccd7-4bf3-9de4-e4aa7b82992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:41.653942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3f8bcde9-ccd7-4bf3-9de4-e4aa7b82992d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:15:41.655174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3f8bcde9-ccd7-4bf3-9de4-e4aa7b82992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:15:41.664265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1108/2226] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jun 23 13:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:15:41.684324 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa52567-df16-4a8b-a3cf-67c7a3956b40 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:15:41.697667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa52567-df16-4a8b-a3cf-67c7a3956b40 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:15:41.704058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee262b0-1364-4989-97f2-e35a3ad45d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:15:41.704761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee262b0-1364-4989-97f2-e35a3ad45d9d service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:15:41.708790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee262b0-1364-4989-97f2-e35a3ad45d9d service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:15:41.708790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee262b0-1364-4989-97f2-e35a3ad45d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:15:41.714223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee262b0-1364-4989-97f2-e35a3ad45d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:15:41.716437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee262b0-1364-4989-97f2-e35a3ad45d9d service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:15:41.726652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1119/2227] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:15:51.648701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=27 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:15:51.721930 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=21 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:09.281346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85505f-3e3b-41f6-ac93-533cd4ab434b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:09.281923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85505f-3e3b-41f6-ac93-533cd4ab434b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:09.281923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85505f-3e3b-41f6-ac93-533cd4ab434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:09.299555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-4b85505f-3e3b-41f6-ac93-533cd4ab434b None None] MFA Rules not processed for user `f7d95bfecf5d4d82b51094e0bf9fbedf`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:09.300706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4b85505f-3e3b-41f6-ac93-533cd4ab434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:09.358838 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1109/2228] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:16:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:16:19.043938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee262b0-1364-4989-97f2-e35a3ad45d9d service nova] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:19.043938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7ee262b0-1364-4989-97f2-e35a3ad45d9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:19.055854 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee262b0-1364-4989-97f2-e35a3ad45d9d service nova] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:19.061024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1874bf-f6d8-43c1-87f9-d300da9fa40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:19.063011 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1874bf-f6d8-43c1-87f9-d300da9fa40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:19.063278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1874bf-f6d8-43c1-87f9-d300da9fa40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:19.063550 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1874bf-f6d8-43c1-87f9-d300da9fa40b admin admin] PATH_INFO: `/v3/users/bcc7c2d5507c4f93afc59c8f5604eb24` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:19.064734 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1874bf-f6d8-43c1-87f9-d300da9fa40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc7c2d5507c4f93afc59c8f5604eb24)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:19.066677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1874bf-f6d8-43c1-87f9-d300da9fa40b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:19.297854 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1f1874bf-f6d8-43c1-87f9-d300da9fa40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc7c2d5507c4f93afc59c8f5604eb24'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:19.309535 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1f1874bf-f6d8-43c1-87f9-d300da9fa40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc7c2d5507c4f93afc59c8f5604eb24'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:19.351849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=25 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:19.377415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1f1874bf-f6d8-43c1-87f9-d300da9fa40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc7c2d5507c4f93afc59c8f5604eb24'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:19.377977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1f1874bf-f6d8-43c1-87f9-d300da9fa40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc7c2d5507c4f93afc59c8f5604eb24'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:19.378595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1f1874bf-f6d8-43c1-87f9-d300da9fa40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc7c2d5507c4f93afc59c8f5604eb24'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:19.391302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1120/2229] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:16:19 2022] DELETE /identity/v3/users/bcc7c2d5507c4f93afc59c8f5604eb24 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:16:19.719913 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85505f-3e3b-41f6-ac93-533cd4ab434b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:19.732209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85505f-3e3b-41f6-ac93-533cd4ab434b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:19.793841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3969ce-84e2-418e-ba64-493993299f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:19.794700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3969ce-84e2-418e-ba64-493993299f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:19.795001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3969ce-84e2-418e-ba64-493993299f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:19.795288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3969ce-84e2-418e-ba64-493993299f0a admin admin] PATH_INFO: `/v3/projects/4f1f5c0ce28a44c1bee9f262f648d69d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:19.796727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3969ce-84e2-418e-ba64-493993299f0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1f5c0ce28a44c1bee9f262f648d69d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:19.798696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3969ce-84e2-418e-ba64-493993299f0a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:19.901685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3a3969ce-84e2-418e-ba64-493993299f0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1f5c0ce28a44c1bee9f262f648d69d', 'request_id': 'req-3a3969ce-84e2-418e-ba64-493993299f0a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:19.972046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3a3969ce-84e2-418e-ba64-493993299f0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1f5c0ce28a44c1bee9f262f648d69d', 'request_id': 'req-3a3969ce-84e2-418e-ba64-493993299f0a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:19.978992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3a3969ce-84e2-418e-ba64-493993299f0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1f5c0ce28a44c1bee9f262f648d69d', 'request_id': 'req-3a3969ce-84e2-418e-ba64-493993299f0a'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:19.990002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3a3969ce-84e2-418e-ba64-493993299f0a admin admin] The token cache is being invalidate because project 4f1f5c0ce28a44c1bee9f262f648d69d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:16:19.990318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3a3969ce-84e2-418e-ba64-493993299f0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:19.990969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3a3969ce-84e2-418e-ba64-493993299f0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:16:19.992855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1110/2230] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:16:19 2022] DELETE /identity/v3/projects/4f1f5c0ce28a44c1bee9f262f648d69d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:16:19.998230 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b374-3c35-40ad-b4b2-fa966c331d01 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:19.998523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b374-3c35-40ad-b4b2-fa966c331d01 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:19.998826 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6b374-3c35-40ad-b4b2-fa966c331d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.018170 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-3ea6b374-3c35-40ad-b4b2-fa966c331d01 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:20.019577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-3ea6b374-3c35-40ad-b4b2-fa966c331d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:20.082846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1121/2231] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:20.090767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867acbea-28c4-43a7-ae9c-791d9bd8a0eb None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.091058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867acbea-28c4-43a7-ae9c-791d9bd8a0eb None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.091338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867acbea-28c4-43a7-ae9c-791d9bd8a0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.111275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-867acbea-28c4-43a7-ae9c-791d9bd8a0eb None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:20.112509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-867acbea-28c4-43a7-ae9c-791d9bd8a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:20.120738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1111/2232] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:20.125587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6b374-3c35-40ad-b4b2-fa966c331d01 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.135520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6b374-3c35-40ad-b4b2-fa966c331d01 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.141293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e83e13-5138-4c81-83cb-c6d37bfbcce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.142354 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e83e13-5138-4c81-83cb-c6d37bfbcce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.142664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e83e13-5138-4c81-83cb-c6d37bfbcce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.142959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e83e13-5138-4c81-83cb-c6d37bfbcce5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.143703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e83e13-5138-4c81-83cb-c6d37bfbcce5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:16:20.144016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e83e13-5138-4c81-83cb-c6d37bfbcce5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.145974 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e83e13-5138-4c81-83cb-c6d37bfbcce5 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.160886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1122/2233] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:16:20.163755 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867acbea-28c4-43a7-ae9c-791d9bd8a0eb None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.173376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867acbea-28c4-43a7-ae9c-791d9bd8a0eb None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.178304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fa824-7090-4731-8f35-c226de73e53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.179137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fa824-7090-4731-8f35-c226de73e53f admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.179394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fa824-7090-4731-8f35-c226de73e53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.179672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fa824-7090-4731-8f35-c226de73e53f admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.180372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fa824-7090-4731-8f35-c226de73e53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.182307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fa824-7090-4731-8f35-c226de73e53f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.300005 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1112/2234] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:16:20 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:16:20.301115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e83e13-5138-4c81-83cb-c6d37bfbcce5 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.311988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e83e13-5138-4c81-83cb-c6d37bfbcce5 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.372868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215581b-bf34-4e5d-a1a9-661161445b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.374050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215581b-bf34-4e5d-a1a9-661161445b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.374337 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215581b-bf34-4e5d-a1a9-661161445b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.374609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8215581b-bf34-4e5d-a1a9-661161445b3b admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.375351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215581b-bf34-4e5d-a1a9-661161445b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.377499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8215581b-bf34-4e5d-a1a9-661161445b3b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.384448 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:20.472642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1123/2235] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:16:20 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:16:20.480391 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fa824-7090-4731-8f35-c226de73e53f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.491242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fa824-7090-4731-8f35-c226de73e53f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.496060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e9940-efd2-4da1-bd37-b52e328062a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.496751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e9940-efd2-4da1-bd37-b52e328062a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.497096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e9940-efd2-4da1-bd37-b52e328062a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.497403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e9940-efd2-4da1-bd37-b52e328062a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.498138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e9940-efd2-4da1-bd37-b52e328062a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.500438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e9940-efd2-4da1-bd37-b52e328062a8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.510934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1113/2236] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:16:20.514858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215581b-bf34-4e5d-a1a9-661161445b3b admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.524791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8215581b-bf34-4e5d-a1a9-661161445b3b admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.529687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab1e29-f39c-4687-89b1-23ee7ae7ff93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.530446 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab1e29-f39c-4687-89b1-23ee7ae7ff93 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.530736 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab1e29-f39c-4687-89b1-23ee7ae7ff93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.531016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab1e29-f39c-4687-89b1-23ee7ae7ff93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.531747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab1e29-f39c-4687-89b1-23ee7ae7ff93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.533386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab1e29-f39c-4687-89b1-23ee7ae7ff93 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.543767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1124/2237] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:16:20.549435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e9940-efd2-4da1-bd37-b52e328062a8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.559419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e9940-efd2-4da1-bd37-b52e328062a8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.565288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ae389-9464-479e-9115-dc102cc2bb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.566170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ae389-9464-479e-9115-dc102cc2bb1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.566451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ae389-9464-479e-9115-dc102cc2bb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.566723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ae389-9464-479e-9115-dc102cc2bb1e admin admin] PATH_INFO: `/v3/projects/744f6f94c38a43cdb86f936500bd0188/users/ebeab772bc3a42608af8215ee8264d5b/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.581327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ae389-9464-479e-9115-dc102cc2bb1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=744f6f94c38a43cdb86f936500bd0188, user_id=ebeab772bc3a42608af8215ee8264d5b, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.583962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ae389-9464-479e-9115-dc102cc2bb1e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.662834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1114/2238] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:16:20 2022] PUT /identity/v3/projects/744f6f94c38a43cdb86f936500bd0188/users/ebeab772bc3a42608af8215ee8264d5b/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:16:20.667747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b238a1-1d24-46b5-8f37-4800640c639a None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.668040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b238a1-1d24-46b5-8f37-4800640c639a None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.668318 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b238a1-1d24-46b5-8f37-4800640c639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.687576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d1b238a1-1d24-46b5-8f37-4800640c639a None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:20.688725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d1b238a1-1d24-46b5-8f37-4800640c639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:20.753644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1125/2239] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:20.765354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ae389-9464-479e-9115-dc102cc2bb1e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:20.767280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ce0ae389-9464-479e-9115-dc102cc2bb1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:20.802840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:20.830328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ae389-9464-479e-9115-dc102cc2bb1e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:20.834001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee34ce0-e845-4020-9bb0-87fc81cc4b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:20.834622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee34ce0-e845-4020-9bb0-87fc81cc4b12 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:20.834905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee34ce0-e845-4020-9bb0-87fc81cc4b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:20.835181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee34ce0-e845-4020-9bb0-87fc81cc4b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:20.845686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee34ce0-e845-4020-9bb0-87fc81cc4b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:20.847204 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee34ce0-e845-4020-9bb0-87fc81cc4b12 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:20.857413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1115/2240] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:16:27.613852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ed4f-d928-42aa-a134-5cc79a84b893 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:27.614349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ed4f-d928-42aa-a134-5cc79a84b893 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:27.614441 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598ed4f-d928-42aa-a134-5cc79a84b893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:27.644692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-a598ed4f-d928-42aa-a134-5cc79a84b893 None None] MFA Rules not processed for user `ebeab772bc3a42608af8215ee8264d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:27.645954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-a598ed4f-d928-42aa-a134-5cc79a84b893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:27.719837 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1126/2241] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:16:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:27.724300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee34ce0-e845-4020-9bb0-87fc81cc4b12 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:27.735479 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee34ce0-e845-4020-9bb0-87fc81cc4b12 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:27.740864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d8e16-06ad-466a-b1d9-8f393e284587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:27.741555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8e16-06ad-466a-b1d9-8f393e284587 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:27.741815 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8e16-06ad-466a-b1d9-8f393e284587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:27.742091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63d8e16-06ad-466a-b1d9-8f393e284587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:27.742787 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d8e16-06ad-466a-b1d9-8f393e284587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:27.744694 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63d8e16-06ad-466a-b1d9-8f393e284587 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:27.888524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1116/2242] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:16:27 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:16:27.889968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598ed4f-d928-42aa-a134-5cc79a84b893 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:27.901714 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598ed4f-d928-42aa-a134-5cc79a84b893 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:27.961226 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5395cab-473f-429e-8896-5d3e70cb2692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:27.961906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5395cab-473f-429e-8896-5d3e70cb2692 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:27.962192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5395cab-473f-429e-8896-5d3e70cb2692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:27.962468 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5395cab-473f-429e-8896-5d3e70cb2692 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:27.963175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5395cab-473f-429e-8896-5d3e70cb2692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:27.965158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5395cab-473f-429e-8896-5d3e70cb2692 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:28.106903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:28.113884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1127/2243] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:16:27 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:16:28.118494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d8e16-06ad-466a-b1d9-8f393e284587 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:28.131804 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63d8e16-06ad-466a-b1d9-8f393e284587 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:28.137879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a4a01-af59-4749-a00c-df56f14be605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:28.139438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a4a01-af59-4749-a00c-df56f14be605 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:28.140243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a4a01-af59-4749-a00c-df56f14be605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:28.140881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a4a01-af59-4749-a00c-df56f14be605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:28.141951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a4a01-af59-4749-a00c-df56f14be605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:28.143772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a4a01-af59-4749-a00c-df56f14be605 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:28.161962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1117/2244] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:16:28.163353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5395cab-473f-429e-8896-5d3e70cb2692 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:28.174777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5395cab-473f-429e-8896-5d3e70cb2692 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:28.183469 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919a2aa-f942-4af8-97e3-38111ff47357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:28.185057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919a2aa-f942-4af8-97e3-38111ff47357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:28.185355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919a2aa-f942-4af8-97e3-38111ff47357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:28.185735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919a2aa-f942-4af8-97e3-38111ff47357 admin admin] PATH_INFO: `/v3/projects/1b41e9e5b5ec45a2bbf9f1838300d516/users/25de631f900b4446bec0949363418938/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:28.209942 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919a2aa-f942-4af8-97e3-38111ff47357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b41e9e5b5ec45a2bbf9f1838300d516, user_id=25de631f900b4446bec0949363418938, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:28.213799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919a2aa-f942-4af8-97e3-38111ff47357 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:28.335676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1128/2245] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:16:28 2022] PUT /identity/v3/projects/1b41e9e5b5ec45a2bbf9f1838300d516/users/25de631f900b4446bec0949363418938/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:16:28.339703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a4a01-af59-4749-a00c-df56f14be605 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:28.350940 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a4a01-af59-4749-a00c-df56f14be605 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:28.420891 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224dde9-1926-4f90-a6c1-6c440ab9105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:28.421534 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224dde9-1926-4f90-a6c1-6c440ab9105c admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:28.421814 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224dde9-1926-4f90-a6c1-6c440ab9105c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:28.422101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224dde9-1926-4f90-a6c1-6c440ab9105c admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:28.422840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224dde9-1926-4f90-a6c1-6c440ab9105c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:28.424586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224dde9-1926-4f90-a6c1-6c440ab9105c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:28.441134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1118/2246] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:16:28.441222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919a2aa-f942-4af8-97e3-38111ff47357 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:28.452728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919a2aa-f942-4af8-97e3-38111ff47357 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:28.468205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0559a-c719-4302-9ca2-53725b8c4975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:28.468205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0559a-c719-4302-9ca2-53725b8c4975 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:28.468205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0559a-c719-4302-9ca2-53725b8c4975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:28.468205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0559a-c719-4302-9ca2-53725b8c4975 admin admin] PATH_INFO: `/v3/projects/1b41e9e5b5ec45a2bbf9f1838300d516/users/25de631f900b4446bec0949363418938/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:28.469825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0559a-c719-4302-9ca2-53725b8c4975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b41e9e5b5ec45a2bbf9f1838300d516, user_id=25de631f900b4446bec0949363418938, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:28.472573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0559a-c719-4302-9ca2-53725b8c4975 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:28.486735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1129/2247] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:16:28 2022] PUT /identity/v3/projects/1b41e9e5b5ec45a2bbf9f1838300d516/users/25de631f900b4446bec0949363418938/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:16:28.834039 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c079-6ab5-4838-bdb7-5e3d91991419 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:28.835029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c079-6ab5-4838-bdb7-5e3d91991419 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:28.835301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622c079-6ab5-4838-bdb7-5e3d91991419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:28.855866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b622c079-6ab5-4838-bdb7-5e3d91991419 None None] MFA Rules not processed for user `0ac9553e75a9408c80c0777f37c2b815`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:28.857275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b622c079-6ab5-4838-bdb7-5e3d91991419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:28.943828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1119/2248] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:16:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:34.808850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73507339-f75d-4615-ae04-616bf91f8626 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:34.812925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73507339-f75d-4615-ae04-616bf91f8626 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:34.813302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73507339-f75d-4615-ae04-616bf91f8626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:34.849090 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-73507339-f75d-4615-ae04-616bf91f8626 None None] MFA Rules not processed for user `25de631f900b4446bec0949363418938`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:34.850520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-73507339-f75d-4615-ae04-616bf91f8626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:34.972266 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1130/2249] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:16:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:34.979206 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c079-6ab5-4838-bdb7-5e3d91991419 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:34.980754 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b622c079-6ab5-4838-bdb7-5e3d91991419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:35.036312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:35.074783 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b622c079-6ab5-4838-bdb7-5e3d91991419 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:35.093509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ede522-cb23-4ac6-8f48-0a130aea19ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:35.094189 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ede522-cb23-4ac6-8f48-0a130aea19ec service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:35.094477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ede522-cb23-4ac6-8f48-0a130aea19ec service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:35.094753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ede522-cb23-4ac6-8f48-0a130aea19ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:35.165537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ede522-cb23-4ac6-8f48-0a130aea19ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:35.167232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ede522-cb23-4ac6-8f48-0a130aea19ec service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:35.177300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1120/2250] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:16:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:16:38.842829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be880b-efd3-4f37-8b71-df86e0e59593 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:38.843440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be880b-efd3-4f37-8b71-df86e0e59593 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:38.843440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be880b-efd3-4f37-8b71-df86e0e59593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:38.889833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-78be880b-efd3-4f37-8b71-df86e0e59593 None None] MFA Rules not processed for user `ebeab772bc3a42608af8215ee8264d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:38.891047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-78be880b-efd3-4f37-8b71-df86e0e59593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:38.912696 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1131/2251] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:16:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:45.415220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=39 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:48.863640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:16:51.954901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a50d23-c703-4a69-9819-8abc9deddff0 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:51.955377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a50d23-c703-4a69-9819-8abc9deddff0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:51.955515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a50d23-c703-4a69-9819-8abc9deddff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:51.974150 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-84a50d23-c703-4a69-9819-8abc9deddff0 None None] MFA Rules not processed for user `4e8df306f69246389ebd6505bfbd1d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:16:51.977717 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-84a50d23-c703-4a69-9819-8abc9deddff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:52.036053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1121/2252] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:16:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:16:59.483190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be880b-efd3-4f37-8b71-df86e0e59593 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:16:59.555743 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be880b-efd3-4f37-8b71-df86e0e59593 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:16:59.559548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157a372-f128-4e0c-9293-773d5aadde86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:16:59.560209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157a372-f128-4e0c-9293-773d5aadde86 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:16:59.560497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157a372-f128-4e0c-9293-773d5aadde86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:16:59.560771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157a372-f128-4e0c-9293-773d5aadde86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:16:59.563499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0157a372-f128-4e0c-9293-773d5aadde86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:16:59.647754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157a372-f128-4e0c-9293-773d5aadde86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:16:59.649394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157a372-f128-4e0c-9293-773d5aadde86 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:16:59.661416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1132/2253] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:00.553013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a50d23-c703-4a69-9819-8abc9deddff0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:00.556222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-84a50d23-c703-4a69-9819-8abc9deddff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:00.580656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a50d23-c703-4a69-9819-8abc9deddff0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:00.585340 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fbccc-3d8a-456b-8387-3ec4fd11aa90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:00.586410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fbccc-3d8a-456b-8387-3ec4fd11aa90 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:00.586854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fbccc-3d8a-456b-8387-3ec4fd11aa90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:00.587316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fbccc-3d8a-456b-8387-3ec4fd11aa90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:00.590133 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0d9fbccc-3d8a-456b-8387-3ec4fd11aa90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:00.606350 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fbccc-3d8a-456b-8387-3ec4fd11aa90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:00.607625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fbccc-3d8a-456b-8387-3ec4fd11aa90 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:00.622225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1122/2254] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:01.082759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa21a22-916a-47d0-aa15-9569eb204f0a None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:01.083698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa21a22-916a-47d0-aa15-9569eb204f0a None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:01.083975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa21a22-916a-47d0-aa15-9569eb204f0a None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:01.085419 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1133/2255] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:17:01.096380 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e81755-5c8c-4133-ba74-e92de2a4736a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:01.096865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e81755-5c8c-4133-ba74-e92de2a4736a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:01.097389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e81755-5c8c-4133-ba74-e92de2a4736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:01.135047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e7e81755-5c8c-4133-ba74-e92de2a4736a None None] MFA Rules not processed for user `69b5745bfb5d4e6ca172bb8fab229e58`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:01.136437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e7e81755-5c8c-4133-ba74-e92de2a4736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:01.200318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1123/2256] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:17:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:01.212043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa21a22-916a-47d0-aa15-9569eb204f0a None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:01.214072 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9fa21a22-916a-47d0-aa15-9569eb204f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:01.224585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e81755-5c8c-4133-ba74-e92de2a4736a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:01.226138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e7e81755-5c8c-4133-ba74-e92de2a4736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:01.237463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa21a22-916a-47d0-aa15-9569eb204f0a None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:01.240511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e81755-5c8c-4133-ba74-e92de2a4736a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:01.242515 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea508e3-fc3f-4bba-a844-d5343c260f4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b5745bfb5d4e6ca172bb8fab229e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:01.243168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea508e3-fc3f-4bba-a844-d5343c260f4a service placement] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:01.243453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea508e3-fc3f-4bba-a844-d5343c260f4a service placement] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:01.243731 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea508e3-fc3f-4bba-a844-d5343c260f4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:01.245270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:01.246143 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:01.246424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:01.246702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] PATH_INFO: `/v3/users/824c74155450401ba02db90ff00aa9e3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:01.247914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=824c74155450401ba02db90ff00aa9e3)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:01.249932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:01.253098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea508e3-fc3f-4bba-a844-d5343c260f4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:01.254691 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea508e3-fc3f-4bba-a844-d5343c260f4a service placement] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:01.265669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1134/2257] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:01.421952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '824c74155450401ba02db90ff00aa9e3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:01.433954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '824c74155450401ba02db90ff00aa9e3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:01.438111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:01.503114 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '824c74155450401ba02db90ff00aa9e3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:01.503756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '824c74155450401ba02db90ff00aa9e3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:01.504364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '824c74155450401ba02db90ff00aa9e3'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:01.517914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1124/2258] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:17:01 2022] DELETE /identity/v3/users/824c74155450401ba02db90ff00aa9e3 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:17:01.770976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea508e3-fc3f-4bba-a844-d5343c260f4a service placement] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:01.782109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea508e3-fc3f-4bba-a844-d5343c260f4a service placement] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:01.851493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:01.854276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:01.869773 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:01.870653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:01.870983 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:01.871267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b admin admin] PATH_INFO: `/v3/projects/52984a97d6634da18f17156d1617e384` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:01.873566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=52984a97d6634da18f17156d1617e384)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:01.877017 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:01.935787 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c403eb-50ea-4047-b597-7901616b92a5 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:01.940455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f70be8-0939-49a1-926f-6867110fdc57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:01.941098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f70be8-0939-49a1-926f-6867110fdc57 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:01.941384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f70be8-0939-49a1-926f-6867110fdc57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:01.941664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f70be8-0939-49a1-926f-6867110fdc57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:01.943512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-46f70be8-0939-49a1-926f-6867110fdc57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:02.032266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f70be8-0939-49a1-926f-6867110fdc57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:02.042243 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f70be8-0939-49a1-926f-6867110fdc57 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:02.043025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52984a97d6634da18f17156d1617e384', 'request_id': 'req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:02.044989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:02.052058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1125/2259] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:17:02.128616 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52984a97d6634da18f17156d1617e384', 'request_id': 'req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:02.136476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52984a97d6634da18f17156d1617e384', 'request_id': 'req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:02.155706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b admin admin] The token cache is being invalidate because project 52984a97d6634da18f17156d1617e384 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:17:02.157577 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:02.159098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fa4996c3-1a41-4bc2-8562-4fba6b6b4f8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:02.162080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1135/2260] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:17:01 2022] DELETE /identity/v3/projects/52984a97d6634da18f17156d1617e384 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:02.166307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad78670-a6e4-4909-b43e-bcee06763f61 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:02.166307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad78670-a6e4-4909-b43e-bcee06763f61 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:02.166581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad78670-a6e4-4909-b43e-bcee06763f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:02.188198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-dad78670-a6e4-4909-b43e-bcee06763f61 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:02.189539 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-dad78670-a6e4-4909-b43e-bcee06763f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:02.275631 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1126/2261] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:02.289013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1f842-070f-429c-a3a2-e04f0a283adc None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:02.289378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1f842-070f-429c-a3a2-e04f0a283adc None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:02.289726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1f842-070f-429c-a3a2-e04f0a283adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:02.310214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-a8e1f842-070f-429c-a3a2-e04f0a283adc None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:02.312096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-a8e1f842-070f-429c-a3a2-e04f0a283adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:02.320878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1136/2262] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:02.325193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad78670-a6e4-4909-b43e-bcee06763f61 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:02.345221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad78670-a6e4-4909-b43e-bcee06763f61 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:02.345221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d8c4e-b36c-49ae-8578-a9e0e990c42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:02.345221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d8c4e-b36c-49ae-8578-a9e0e990c42f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:02.345221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d8c4e-b36c-49ae-8578-a9e0e990c42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:02.345576 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d8c4e-b36c-49ae-8578-a9e0e990c42f admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:02.345576 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d8c4e-b36c-49ae-8578-a9e0e990c42f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:17:02.345576 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d8c4e-b36c-49ae-8578-a9e0e990c42f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:02.345871 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d8c4e-b36c-49ae-8578-a9e0e990c42f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:02.359803 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1127/2263] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:17:02.364550 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1f842-070f-429c-a3a2-e04f0a283adc None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:02.375970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1f842-070f-429c-a3a2-e04f0a283adc None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:02.381104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a25b5-8146-49e9-b189-7b4b98f86201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:02.381767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a25b5-8146-49e9-b189-7b4b98f86201 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:02.382052 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a25b5-8146-49e9-b189-7b4b98f86201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:02.382332 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a25b5-8146-49e9-b189-7b4b98f86201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:02.383036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a25b5-8146-49e9-b189-7b4b98f86201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:02.385079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a25b5-8146-49e9-b189-7b4b98f86201 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:02.486142 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1137/2264] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:17:02 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:17:02.490357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d8c4e-b36c-49ae-8578-a9e0e990c42f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:02.501970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d8c4e-b36c-49ae-8578-a9e0e990c42f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:02.526105 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:02.575796 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390acb5f-9067-409b-89b1-f258e085a8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:02.576714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390acb5f-9067-409b-89b1-f258e085a8ad admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:02.577059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390acb5f-9067-409b-89b1-f258e085a8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:02.577621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390acb5f-9067-409b-89b1-f258e085a8ad admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:02.578122 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390acb5f-9067-409b-89b1-f258e085a8ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:02.580246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390acb5f-9067-409b-89b1-f258e085a8ad admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:02.672711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1128/2265] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:17:02 2022] POST /identity/v3/users => generated 303 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:17:02.676847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a25b5-8146-49e9-b189-7b4b98f86201 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:02.687732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a25b5-8146-49e9-b189-7b4b98f86201 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:02.692265 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274482f-a2b1-4fdf-ab53-5e4308b79737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:02.692962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274482f-a2b1-4fdf-ab53-5e4308b79737 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:02.693253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274482f-a2b1-4fdf-ab53-5e4308b79737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:02.693524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274482f-a2b1-4fdf-ab53-5e4308b79737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:02.694262 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274482f-a2b1-4fdf-ab53-5e4308b79737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:02.695913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274482f-a2b1-4fdf-ab53-5e4308b79737 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:02.706897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1138/2266] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:17:02.710903 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390acb5f-9067-409b-89b1-f258e085a8ad admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:02.721262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390acb5f-9067-409b-89b1-f258e085a8ad admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:02.728048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f773e-cd6b-44f7-a46e-d35431f2d898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:02.728048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f773e-cd6b-44f7-a46e-d35431f2d898 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:02.728048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f773e-cd6b-44f7-a46e-d35431f2d898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:02.728048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f773e-cd6b-44f7-a46e-d35431f2d898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:02.728522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f773e-cd6b-44f7-a46e-d35431f2d898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:02.730168 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f773e-cd6b-44f7-a46e-d35431f2d898 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:02.743003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1129/2267] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:17:02.747483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274482f-a2b1-4fdf-ab53-5e4308b79737 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:02.758894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274482f-a2b1-4fdf-ab53-5e4308b79737 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:02.763977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af616bde-bea4-4f48-909f-7fdbc77e9849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:02.765079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af616bde-bea4-4f48-909f-7fdbc77e9849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:02.765366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af616bde-bea4-4f48-909f-7fdbc77e9849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:02.765716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af616bde-bea4-4f48-909f-7fdbc77e9849 admin admin] PATH_INFO: `/v3/projects/0d96d9c4101348b3ab91790ca6bbf25f/users/820797e6681640a2872f28ad30e7cc9d/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:02.781299 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af616bde-bea4-4f48-909f-7fdbc77e9849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d96d9c4101348b3ab91790ca6bbf25f, user_id=820797e6681640a2872f28ad30e7cc9d, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:02.783982 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af616bde-bea4-4f48-909f-7fdbc77e9849 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:02.878502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1139/2268] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:17:02 2022] PUT /identity/v3/projects/0d96d9c4101348b3ab91790ca6bbf25f/users/820797e6681640a2872f28ad30e7cc9d/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:02.886473 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ce93e-4040-4618-b185-ffaf564c6cec None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:02.886982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ce93e-4040-4618-b185-ffaf564c6cec None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:02.887087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ce93e-4040-4618-b185-ffaf564c6cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:02.906332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ca1ce93e-4040-4618-b185-ffaf564c6cec None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:02.907553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ca1ce93e-4040-4618-b185-ffaf564c6cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:02.964611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1130/2269] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:02.975144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af616bde-bea4-4f48-909f-7fdbc77e9849 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:02.976895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-af616bde-bea4-4f48-909f-7fdbc77e9849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:03.040908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af616bde-bea4-4f48-909f-7fdbc77e9849 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:03.047436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1ffe3-cab2-4880-87a5-2e0a4831c828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:03.048311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1ffe3-cab2-4880-87a5-2e0a4831c828 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:03.048777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1ffe3-cab2-4880-87a5-2e0a4831c828 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:03.049252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1ffe3-cab2-4880-87a5-2e0a4831c828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:03.062214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1ffe3-cab2-4880-87a5-2e0a4831c828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:03.064430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1ffe3-cab2-4880-87a5-2e0a4831c828 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:03.076272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1140/2270] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:04.482546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19637c62-9cde-47ae-9133-c6ae6e09c579 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:04.483596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19637c62-9cde-47ae-9133-c6ae6e09c579 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:04.483867 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19637c62-9cde-47ae-9133-c6ae6e09c579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:04.512282 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-19637c62-9cde-47ae-9133-c6ae6e09c579 None None] MFA Rules not processed for user `820797e6681640a2872f28ad30e7cc9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:04.514245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-19637c62-9cde-47ae-9133-c6ae6e09c579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:04.586810 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1131/2271] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:04.596993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1ffe3-cab2-4880-87a5-2e0a4831c828 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:04.619849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1ffe3-cab2-4880-87a5-2e0a4831c828 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:04.625414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19abe3-9c0c-4dd5-9647-41fba78c43cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:04.626296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19abe3-9c0c-4dd5-9647-41fba78c43cf admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:04.626589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19abe3-9c0c-4dd5-9647-41fba78c43cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:04.626867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19abe3-9c0c-4dd5-9647-41fba78c43cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:04.627586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19abe3-9c0c-4dd5-9647-41fba78c43cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:04.629692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19abe3-9c0c-4dd5-9647-41fba78c43cf admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:04.733747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1141/2272] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:17:04 2022] POST /identity/v3/projects => generated 405 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:17:04.735015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19637c62-9cde-47ae-9133-c6ae6e09c579 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:04.746923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19637c62-9cde-47ae-9133-c6ae6e09c579 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:04.772369 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:04.809918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8a9e1-ad28-4b43-ad6a-198529721c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:04.810878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8a9e1-ad28-4b43-ad6a-198529721c8c admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:04.811058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8a9e1-ad28-4b43-ad6a-198529721c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:04.811436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8a9e1-ad28-4b43-ad6a-198529721c8c admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:04.812615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8a9e1-ad28-4b43-ad6a-198529721c8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:04.814620 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8a9e1-ad28-4b43-ad6a-198529721c8c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:04.926875 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1132/2273] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:17:04 2022] POST /identity/v3/users => generated 309 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:17:04.939588 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19abe3-9c0c-4dd5-9647-41fba78c43cf admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:04.949995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19abe3-9c0c-4dd5-9647-41fba78c43cf admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:04.955205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1096f39-0a70-45dc-bd16-e67fba6139c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:04.955854 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1096f39-0a70-45dc-bd16-e67fba6139c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:04.956140 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1096f39-0a70-45dc-bd16-e67fba6139c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:04.956419 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1096f39-0a70-45dc-bd16-e67fba6139c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:04.957191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1096f39-0a70-45dc-bd16-e67fba6139c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:04.958825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1096f39-0a70-45dc-bd16-e67fba6139c9 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:04.970583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1142/2274] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:17:04.974898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8a9e1-ad28-4b43-ad6a-198529721c8c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:04.985262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8a9e1-ad28-4b43-ad6a-198529721c8c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:04.989971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bc152-f64e-43fb-b8ab-1950ce7d06aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:04.990850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc152-f64e-43fb-b8ab-1950ce7d06aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:04.991136 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc152-f64e-43fb-b8ab-1950ce7d06aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:04.991416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bc152-f64e-43fb-b8ab-1950ce7d06aa admin admin] PATH_INFO: `/v3/projects/703ce72713904bca8dfdeeb6a00880ca/users/4813f3a98ebc4998a1cbb00f47495913/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:05.006183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bc152-f64e-43fb-b8ab-1950ce7d06aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=703ce72713904bca8dfdeeb6a00880ca, user_id=4813f3a98ebc4998a1cbb00f47495913, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:05.008860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34bc152-f64e-43fb-b8ab-1950ce7d06aa admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:05.109083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1133/2275] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:17:04 2022] PUT /identity/v3/projects/703ce72713904bca8dfdeeb6a00880ca/users/4813f3a98ebc4998a1cbb00f47495913/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:17:05.113013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1096f39-0a70-45dc-bd16-e67fba6139c9 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:05.123206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1096f39-0a70-45dc-bd16-e67fba6139c9 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:05.155432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:05.180652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fa2c3-fa1f-4179-9bc3-20b69a409609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:05.181372 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa2c3-fa1f-4179-9bc3-20b69a409609 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:05.181657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa2c3-fa1f-4179-9bc3-20b69a409609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:05.181934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa2c3-fa1f-4179-9bc3-20b69a409609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:05.182661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fa2c3-fa1f-4179-9bc3-20b69a409609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:05.184268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fa2c3-fa1f-4179-9bc3-20b69a409609 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:05.194396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1143/2276] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:17:05.198517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bc152-f64e-43fb-b8ab-1950ce7d06aa admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:05.209525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34bc152-f64e-43fb-b8ab-1950ce7d06aa admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:05.214344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15b232-c38e-4f4d-99b5-a792351e1088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:05.215063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15b232-c38e-4f4d-99b5-a792351e1088 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:05.215347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15b232-c38e-4f4d-99b5-a792351e1088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:05.215627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15b232-c38e-4f4d-99b5-a792351e1088 admin admin] PATH_INFO: `/v3/projects/703ce72713904bca8dfdeeb6a00880ca/users/4813f3a98ebc4998a1cbb00f47495913/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:05.217713 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15b232-c38e-4f4d-99b5-a792351e1088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=703ce72713904bca8dfdeeb6a00880ca, user_id=4813f3a98ebc4998a1cbb00f47495913, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:05.220326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15b232-c38e-4f4d-99b5-a792351e1088 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:05.230724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1134/2277] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:17:05 2022] PUT /identity/v3/projects/703ce72713904bca8dfdeeb6a00880ca/users/4813f3a98ebc4998a1cbb00f47495913/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:06.684852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6c0ef-753d-4201-a434-9616dc3abb71 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:06.685384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6c0ef-753d-4201-a434-9616dc3abb71 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:06.685494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6c0ef-753d-4201-a434-9616dc3abb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:06.737428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-61a6c0ef-753d-4201-a434-9616dc3abb71 None None] MFA Rules not processed for user `4813f3a98ebc4998a1cbb00f47495913`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:06.738851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-61a6c0ef-753d-4201-a434-9616dc3abb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:06.844840 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1144/2278] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:06 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:08.864396 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15b232-c38e-4f4d-99b5-a792351e1088 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:08.932613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15b232-c38e-4f4d-99b5-a792351e1088 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:08.941954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:08.942899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:08.943221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:08.943539 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] PATH_INFO: `/v3/users/820797e6681640a2872f28ad30e7cc9d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:08.944794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820797e6681640a2872f28ad30e7cc9d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:08.947447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:09.172520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820797e6681640a2872f28ad30e7cc9d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:09.187547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820797e6681640a2872f28ad30e7cc9d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:09.288754 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820797e6681640a2872f28ad30e7cc9d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:09.289617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820797e6681640a2872f28ad30e7cc9d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:09.290359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820797e6681640a2872f28ad30e7cc9d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:09.298195 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:09.307338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1135/2279] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:17:08 2022] DELETE /identity/v3/users/820797e6681640a2872f28ad30e7cc9d => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:09.472634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6c0ef-753d-4201-a434-9616dc3abb71 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:09.529937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6c0ef-753d-4201-a434-9616dc3abb71 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:09.585326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa244dff-2ae3-4c28-9018-50342caffabe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:09.585987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa244dff-2ae3-4c28-9018-50342caffabe service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:09.586274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa244dff-2ae3-4c28-9018-50342caffabe service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:09.586557 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa244dff-2ae3-4c28-9018-50342caffabe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:09.588516 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fa244dff-2ae3-4c28-9018-50342caffabe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:09.616906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:09.634213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:09.635786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:09.673737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa244dff-2ae3-4c28-9018-50342caffabe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:09.675256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa244dff-2ae3-4c28-9018-50342caffabe service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:09.688529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1145/2280] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:09.723718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564089ef-513b-4f12-9367-71bf19e36e64 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:09.728569 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:09.729307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:09.729585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:09.729861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] PATH_INFO: `/v3/projects/0d96d9c4101348b3ab91790ca6bbf25f` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:09.731187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d96d9c4101348b3ab91790ca6bbf25f)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:09.734418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:09.835444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d96d9c4101348b3ab91790ca6bbf25f', 'request_id': 'req-a49d2bab-378c-426d-a489-35742d0c9888'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:09.926208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d96d9c4101348b3ab91790ca6bbf25f', 'request_id': 'req-a49d2bab-378c-426d-a489-35742d0c9888'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:09.933723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d96d9c4101348b3ab91790ca6bbf25f', 'request_id': 'req-a49d2bab-378c-426d-a489-35742d0c9888'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:09.953566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] The token cache is being invalidate because project 0d96d9c4101348b3ab91790ca6bbf25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:17:09.956038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:09.956038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:09.956929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1136/2281] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:17:09 2022] DELETE /identity/v3/projects/0d96d9c4101348b3ab91790ca6bbf25f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:09.960253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa244dff-2ae3-4c28-9018-50342caffabe service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:09.971995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa244dff-2ae3-4c28-9018-50342caffabe service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:10.031242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e08175-5de6-4000-8f72-5e6c59966695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:10.032147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08175-5de6-4000-8f72-5e6c59966695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:10.032431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08175-5de6-4000-8f72-5e6c59966695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:10.032711 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08175-5de6-4000-8f72-5e6c59966695 admin admin] PATH_INFO: `/v3/users/4813f3a98ebc4998a1cbb00f47495913` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:10.033959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e08175-5de6-4000-8f72-5e6c59966695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4813f3a98ebc4998a1cbb00f47495913)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:10.036184 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e08175-5de6-4000-8f72-5e6c59966695 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:10.210594 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f3e08175-5de6-4000-8f72-5e6c59966695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4813f3a98ebc4998a1cbb00f47495913'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:10.223336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f3e08175-5de6-4000-8f72-5e6c59966695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4813f3a98ebc4998a1cbb00f47495913'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:10.299933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f3e08175-5de6-4000-8f72-5e6c59966695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4813f3a98ebc4998a1cbb00f47495913'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:10.300652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f3e08175-5de6-4000-8f72-5e6c59966695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4813f3a98ebc4998a1cbb00f47495913'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:10.301211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f3e08175-5de6-4000-8f72-5e6c59966695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4813f3a98ebc4998a1cbb00f47495913'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:10.316189 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1146/2282] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:17:09 2022] DELETE /identity/v3/users/4813f3a98ebc4998a1cbb00f47495913 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:10.604483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:10.606142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:10.626426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d2bab-378c-426d-a489-35742d0c9888 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:10.693161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:10.693977 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:10.694267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:10.694550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5 admin admin] PATH_INFO: `/v3/projects/703ce72713904bca8dfdeeb6a00880ca` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:10.695811 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=703ce72713904bca8dfdeeb6a00880ca)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:10.697768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:10.788540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:10.806551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703ce72713904bca8dfdeeb6a00880ca', 'request_id': 'req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:10.886070 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703ce72713904bca8dfdeeb6a00880ca', 'request_id': 'req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:10.893204 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703ce72713904bca8dfdeeb6a00880ca', 'request_id': 'req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:10.904269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5 admin admin] The token cache is being invalidate because project 703ce72713904bca8dfdeeb6a00880ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:17:10.906726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:10.907009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d1fd2317-c6ea-4ce7-9696-00e32d3834b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:10.909018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1137/2283] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:17:10 2022] DELETE /identity/v3/projects/703ce72713904bca8dfdeeb6a00880ca => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:10.913740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1077a5-c9f4-468b-9019-9e9551b080f0 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:10.914233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1077a5-c9f4-468b-9019-9e9551b080f0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:10.914326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1077a5-c9f4-468b-9019-9e9551b080f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:10.933777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-0d1077a5-c9f4-468b-9019-9e9551b080f0 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:10.934978 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0d1077a5-c9f4-468b-9019-9e9551b080f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:10.971991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:10.997437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1147/2284] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:11.006434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e9a31-122f-4696-98d4-40418d9e4236 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:11.006951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e9a31-122f-4696-98d4-40418d9e4236 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:11.007155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60e9a31-122f-4696-98d4-40418d9e4236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:11.025980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f60e9a31-122f-4696-98d4-40418d9e4236 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:11.028606 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f60e9a31-122f-4696-98d4-40418d9e4236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:11.035762 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1138/2285] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:11.040289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1077a5-c9f4-468b-9019-9e9551b080f0 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:11.051640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1077a5-c9f4-468b-9019-9e9551b080f0 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:11.058002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692c445-a3ac-4128-8c2c-da8f9b29c694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:11.058825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692c445-a3ac-4128-8c2c-da8f9b29c694 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:11.059371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692c445-a3ac-4128-8c2c-da8f9b29c694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:11.063058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692c445-a3ac-4128-8c2c-da8f9b29c694 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:11.063058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692c445-a3ac-4128-8c2c-da8f9b29c694 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:17:11.063058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692c445-a3ac-4128-8c2c-da8f9b29c694 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:11.063538 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8692c445-a3ac-4128-8c2c-da8f9b29c694 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:11.075997 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1148/2286] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:17:11.081411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e9a31-122f-4696-98d4-40418d9e4236 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:11.090961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60e9a31-122f-4696-98d4-40418d9e4236 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:11.096302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316bb61-1917-40fd-bb70-08f3b6a960a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:11.096989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316bb61-1917-40fd-bb70-08f3b6a960a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:11.097275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316bb61-1917-40fd-bb70-08f3b6a960a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:11.097556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316bb61-1917-40fd-bb70-08f3b6a960a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:11.098266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316bb61-1917-40fd-bb70-08f3b6a960a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:11.100171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316bb61-1917-40fd-bb70-08f3b6a960a1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:11.202131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1139/2287] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:17:11 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:17:11.203457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692c445-a3ac-4128-8c2c-da8f9b29c694 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:11.214128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8692c445-a3ac-4128-8c2c-da8f9b29c694 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:11.276132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b6f3b-d374-475e-9a9c-5917cf68dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:11.277172 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b6f3b-d374-475e-9a9c-5917cf68dab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:11.277452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b6f3b-d374-475e-9a9c-5917cf68dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:11.277725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19b6f3b-d374-475e-9a9c-5917cf68dab6 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:11.278406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b6f3b-d374-475e-9a9c-5917cf68dab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:11.281508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19b6f3b-d374-475e-9a9c-5917cf68dab6 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:11.355395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1149/2288] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:17:11 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:17:11.360104 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316bb61-1917-40fd-bb70-08f3b6a960a1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:11.370551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316bb61-1917-40fd-bb70-08f3b6a960a1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:11.375427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316de16-1c2c-4fa5-9979-0256c911f051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:11.376079 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316de16-1c2c-4fa5-9979-0256c911f051 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:11.376512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316de16-1c2c-4fa5-9979-0256c911f051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:11.376751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316de16-1c2c-4fa5-9979-0256c911f051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:11.377511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316de16-1c2c-4fa5-9979-0256c911f051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:11.379101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316de16-1c2c-4fa5-9979-0256c911f051 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:11.389438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1140/2289] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:17:11.393540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b6f3b-d374-475e-9a9c-5917cf68dab6 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:11.403686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19b6f3b-d374-475e-9a9c-5917cf68dab6 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:11.409346 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43d0b6-84d7-4f7e-ab8d-a45d958a91c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:11.410014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43d0b6-84d7-4f7e-ab8d-a45d958a91c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:11.410347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43d0b6-84d7-4f7e-ab8d-a45d958a91c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:11.410619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43d0b6-84d7-4f7e-ab8d-a45d958a91c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:11.411351 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43d0b6-84d7-4f7e-ab8d-a45d958a91c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:11.412991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43d0b6-84d7-4f7e-ab8d-a45d958a91c7 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:11.423579 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1150/2290] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:17:11.427609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316de16-1c2c-4fa5-9979-0256c911f051 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:11.437648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316de16-1c2c-4fa5-9979-0256c911f051 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:11.442497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8238686-68b9-4d4b-82c0-a0e2923509c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:11.443378 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8238686-68b9-4d4b-82c0-a0e2923509c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:11.443664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8238686-68b9-4d4b-82c0-a0e2923509c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:11.443945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8238686-68b9-4d4b-82c0-a0e2923509c6 admin admin] PATH_INFO: `/v3/projects/20f8b2504e36444d93d9715f4543c590/users/1f8f5257b15246a7b691c2aa73baf71f/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:11.459878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8238686-68b9-4d4b-82c0-a0e2923509c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f8b2504e36444d93d9715f4543c590, user_id=1f8f5257b15246a7b691c2aa73baf71f, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:11.462581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8238686-68b9-4d4b-82c0-a0e2923509c6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:11.538093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1141/2291] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:17:11 2022] PUT /identity/v3/projects/20f8b2504e36444d93d9715f4543c590/users/1f8f5257b15246a7b691c2aa73baf71f/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:17:11.548352 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56321353-b5ba-4bed-9add-dac1451386a1 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:11.548687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56321353-b5ba-4bed-9add-dac1451386a1 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:11.548992 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56321353-b5ba-4bed-9add-dac1451386a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:11.576058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-56321353-b5ba-4bed-9add-dac1451386a1 None None] MFA Rules not processed for user `1f8f5257b15246a7b691c2aa73baf71f`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:11.578067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-56321353-b5ba-4bed-9add-dac1451386a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:11.645538 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1151/2292] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:11.650038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8238686-68b9-4d4b-82c0-a0e2923509c6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:11.715435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8238686-68b9-4d4b-82c0-a0e2923509c6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:11.721564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f52685-d48a-4c76-881f-51eaf5ebe971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:11.722232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f52685-d48a-4c76-881f-51eaf5ebe971 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:11.722513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f52685-d48a-4c76-881f-51eaf5ebe971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:11.722784 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f52685-d48a-4c76-881f-51eaf5ebe971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:11.723478 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f52685-d48a-4c76-881f-51eaf5ebe971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:11.725419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f52685-d48a-4c76-881f-51eaf5ebe971 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:11.847625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1142/2293] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:17:11 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:17:11.848934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56321353-b5ba-4bed-9add-dac1451386a1 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:11.860780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56321353-b5ba-4bed-9add-dac1451386a1 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:11.895728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:11.920161 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c160978-2585-4344-9dad-3405de93c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:11.920980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c160978-2585-4344-9dad-3405de93c5c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:11.921269 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c160978-2585-4344-9dad-3405de93c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:11.921582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c160978-2585-4344-9dad-3405de93c5c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:11.922279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c160978-2585-4344-9dad-3405de93c5c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:11.926669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c160978-2585-4344-9dad-3405de93c5c1 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:12.024380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1152/2294] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:17:11 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:17:12.029810 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f52685-d48a-4c76-881f-51eaf5ebe971 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:12.041324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f52685-d48a-4c76-881f-51eaf5ebe971 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:12.047514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f52d5-6e61-4864-b1f2-c3184ef278b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:12.048282 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f52d5-6e61-4864-b1f2-c3184ef278b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:12.051675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f52d5-6e61-4864-b1f2-c3184ef278b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:12.051675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f52d5-6e61-4864-b1f2-c3184ef278b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:12.051675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f52d5-6e61-4864-b1f2-c3184ef278b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:12.052214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f52d5-6e61-4864-b1f2-c3184ef278b6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:12.065125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1143/2295] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:17:12.069586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c160978-2585-4344-9dad-3405de93c5c1 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:12.083662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c160978-2585-4344-9dad-3405de93c5c1 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:12.088989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76075f5a-5679-45d0-98f2-827416445919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:12.090622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76075f5a-5679-45d0-98f2-827416445919 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:12.091343 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76075f5a-5679-45d0-98f2-827416445919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:12.091630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76075f5a-5679-45d0-98f2-827416445919 admin admin] PATH_INFO: `/v3/projects/84ec1c2aeb8d49fc8a986c1ec59232a2/users/f9e326d95f2b4757a05bc735fb441fea/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:12.109305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76075f5a-5679-45d0-98f2-827416445919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ec1c2aeb8d49fc8a986c1ec59232a2, user_id=f9e326d95f2b4757a05bc735fb441fea, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:12.112542 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76075f5a-5679-45d0-98f2-827416445919 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:12.218279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1153/2296] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:17:12 2022] PUT /identity/v3/projects/84ec1c2aeb8d49fc8a986c1ec59232a2/users/f9e326d95f2b4757a05bc735fb441fea/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:12.222048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f52d5-6e61-4864-b1f2-c3184ef278b6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:12.236113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f52d5-6e61-4864-b1f2-c3184ef278b6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:12.281948 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:12.343897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e6546-769d-4a4e-94b6-41317717015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:12.344590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e6546-769d-4a4e-94b6-41317717015e admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:12.344923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e6546-769d-4a4e-94b6-41317717015e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:12.345208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e6546-769d-4a4e-94b6-41317717015e admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:12.346275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e6546-769d-4a4e-94b6-41317717015e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:12.347942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e6546-769d-4a4e-94b6-41317717015e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:12.360873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1144/2297] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:17:12.363926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76075f5a-5679-45d0-98f2-827416445919 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:12.381349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76075f5a-5679-45d0-98f2-827416445919 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:12.386822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90792b-05f7-482d-b636-d7c5cbb1b0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:12.387884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90792b-05f7-482d-b636-d7c5cbb1b0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:12.388167 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90792b-05f7-482d-b636-d7c5cbb1b0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:12.388442 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90792b-05f7-482d-b636-d7c5cbb1b0eb admin admin] PATH_INFO: `/v3/projects/84ec1c2aeb8d49fc8a986c1ec59232a2/users/f9e326d95f2b4757a05bc735fb441fea/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:12.390897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90792b-05f7-482d-b636-d7c5cbb1b0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ec1c2aeb8d49fc8a986c1ec59232a2, user_id=f9e326d95f2b4757a05bc735fb441fea, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:12.393781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90792b-05f7-482d-b636-d7c5cbb1b0eb admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:12.406304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1154/2298] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:17:12 2022] PUT /identity/v3/projects/84ec1c2aeb8d49fc8a986c1ec59232a2/users/f9e326d95f2b4757a05bc735fb441fea/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:12.417373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2297-5791-4cbf-9624-85eb4773fed6 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:12.417779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2297-5791-4cbf-9624-85eb4773fed6 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:12.418073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2297-5791-4cbf-9624-85eb4773fed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:12.452763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-bcbd2297-5791-4cbf-9624-85eb4773fed6 None None] MFA Rules not processed for user `f9e326d95f2b4757a05bc735fb441fea`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:12.454073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bcbd2297-5791-4cbf-9624-85eb4773fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:12.542614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1145/2299] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:12.555440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90792b-05f7-482d-b636-d7c5cbb1b0eb admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:12.557408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fb90792b-05f7-482d-b636-d7c5cbb1b0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:12.659585 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90792b-05f7-482d-b636-d7c5cbb1b0eb admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:12.666938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a92ba-e3cf-441c-a413-313fce376b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:12.666938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a92ba-e3cf-441c-a413-313fce376b2a service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:12.666938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a92ba-e3cf-441c-a413-313fce376b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:12.667583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a92ba-e3cf-441c-a413-313fce376b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:12.687106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a92ba-e3cf-441c-a413-313fce376b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:12.688602 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a92ba-e3cf-441c-a413-313fce376b2a service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:12.702848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1155/2300] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:12.948759 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd2297-5791-4cbf-9624-85eb4773fed6 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:12.959126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd2297-5791-4cbf-9624-85eb4773fed6 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:12.962902 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba20e-a15a-494f-9c5c-36080bd25716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:12.963563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba20e-a15a-494f-9c5c-36080bd25716 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:12.963847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba20e-a15a-494f-9c5c-36080bd25716 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:12.964125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba20e-a15a-494f-9c5c-36080bd25716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:13.028264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfba20e-a15a-494f-9c5c-36080bd25716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:13.031125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfba20e-a15a-494f-9c5c-36080bd25716 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:13.044664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1146/2301] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:15.670742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a92ba-e3cf-441c-a413-313fce376b2a service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:15.672232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-503a92ba-e3cf-441c-a413-313fce376b2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:15.746207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a92ba-e3cf-441c-a413-313fce376b2a service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:15.752240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd969c-15d3-467d-9203-188063f4edc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:15.752905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd969c-15d3-467d-9203-188063f4edc8 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:15.753189 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd969c-15d3-467d-9203-188063f4edc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:15.753465 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd969c-15d3-467d-9203-188063f4edc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:15.755308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-62cd969c-15d3-467d-9203-188063f4edc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:15.761350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:15.814927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd969c-15d3-467d-9203-188063f4edc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:15.816571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd969c-15d3-467d-9203-188063f4edc8 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:15.826708 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1156/2302] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:23.038397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=79 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:23.116073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be2e6e-03fe-4abf-835c-0a0dd4e3e503 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:23.116366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be2e6e-03fe-4abf-835c-0a0dd4e3e503 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:23.116654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be2e6e-03fe-4abf-835c-0a0dd4e3e503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:23.133941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f1be2e6e-03fe-4abf-835c-0a0dd4e3e503 None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:23.135156 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f1be2e6e-03fe-4abf-835c-0a0dd4e3e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:23.195273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1147/2303] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:17:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:23.347785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd969c-15d3-467d-9203-188063f4edc8 service nova] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:23.349228 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-62cd969c-15d3-467d-9203-188063f4edc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:23.435008 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd969c-15d3-467d-9203-188063f4edc8 service nova] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:23.440705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae9f34-89c1-4058-b732-6928faffb75a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:23.441382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae9f34-89c1-4058-b732-6928faffb75a service swift] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:23.441671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae9f34-89c1-4058-b732-6928faffb75a service swift] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:23.441949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae9f34-89c1-4058-b732-6928faffb75a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:23.450253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae9f34-89c1-4058-b732-6928faffb75a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:23.455108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae9f34-89c1-4058-b732-6928faffb75a service swift] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:23.462175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1157/2304] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:17:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:17:33.191776 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=25 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:33.457566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=61 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:34.982506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be2e6e-03fe-4abf-835c-0a0dd4e3e503 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:34.984551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f1be2e6e-03fe-4abf-835c-0a0dd4e3e503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:35.044037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be2e6e-03fe-4abf-835c-0a0dd4e3e503 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:35.047825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdc2a0-3cd6-440c-b486-7098bf9720bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:35.048545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc2a0-3cd6-440c-b486-7098bf9720bc service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:35.048849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc2a0-3cd6-440c-b486-7098bf9720bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:35.049126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdc2a0-3cd6-440c-b486-7098bf9720bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:35.050885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-defdc2a0-3cd6-440c-b486-7098bf9720bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:35.060988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdc2a0-3cd6-440c-b486-7098bf9720bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:35.062442 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defdc2a0-3cd6-440c-b486-7098bf9720bc service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:35.071975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1148/2305] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:41.467763 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c8498-8e79-491f-b5f4-2f8324362cfd None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:41.470235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c8498-8e79-491f-b5f4-2f8324362cfd None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:41.470235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c8498-8e79-491f-b5f4-2f8324362cfd None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:41.470235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1158/2306] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:17:41.476144 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c9a64-e681-44f8-b8b5-8cb714f7026a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:41.476640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c9a64-e681-44f8-b8b5-8cb714f7026a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:41.476745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c9a64-e681-44f8-b8b5-8cb714f7026a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:41.496072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7f8c9a64-e681-44f8-b8b5-8cb714f7026a None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:41.497313 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7f8c9a64-e681-44f8-b8b5-8cb714f7026a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:41.510611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1149/2307] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:17:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:41.522940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c8498-8e79-491f-b5f4-2f8324362cfd None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:41.524663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-3e6c8498-8e79-491f-b5f4-2f8324362cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:41.586454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c8498-8e79-491f-b5f4-2f8324362cfd None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:41.590385 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473966b-d014-4e11-83f1-524551a7a19b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6832291d504cff9e787c0d791c70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:41.591041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473966b-d014-4e11-83f1-524551a7a19b service glance] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:41.591322 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473966b-d014-4e11-83f1-524551a7a19b service glance] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:41.591600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473966b-d014-4e11-83f1-524551a7a19b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:41.603585 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473966b-d014-4e11-83f1-524551a7a19b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:41.605096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473966b-d014-4e11-83f1-524551a7a19b service glance] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:41.617245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1159/2308] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:41.966550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853183c-5583-4b68-a5ce-86590d3e749b None None] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:41.966883 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853183c-5583-4b68-a5ce-86590d3e749b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:41.967168 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853183c-5583-4b68-a5ce-86590d3e749b None None] PATH_INFO: `/` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:41.968822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1150/2309] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:17:41.974484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7c490-3542-4825-9f35-148d429341f1 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:41.979421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7c490-3542-4825-9f35-148d429341f1 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:41.979421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7c490-3542-4825-9f35-148d429341f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:41.997989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-22d7c490-3542-4825-9f35-148d429341f1 None None] MFA Rules not processed for user `83858713769b41af800bab317602bf2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:42.001656 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-22d7c490-3542-4825-9f35-148d429341f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:42.009496 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1160/2310] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:17:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:42.021586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853183c-5583-4b68-a5ce-86590d3e749b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:42.035212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853183c-5583-4b68-a5ce-86590d3e749b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:42.039092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba1380-50da-493f-b4eb-ccef183d3818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:42.039787 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba1380-50da-493f-b4eb-ccef183d3818 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:42.040073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba1380-50da-493f-b4eb-ccef183d3818 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:42.040352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba1380-50da-493f-b4eb-ccef183d3818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:42.056782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba1380-50da-493f-b4eb-ccef183d3818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:42.056782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba1380-50da-493f-b4eb-ccef183d3818 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:42.065312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1151/2311] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:17:42.166768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb86c9-7514-4eaf-9684-e82ba736142b None None] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:42.168470 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb86c9-7514-4eaf-9684-e82ba736142b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:42.168470 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb86c9-7514-4eaf-9684-e82ba736142b None None] PATH_INFO: `/` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:42.169600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1161/2312] 10.222.0.16 () {54 vars in 921 bytes} [Thu Jun 23 13:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 13:17:42.175368 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddc9b7-8bfd-41e5-a0df-d2a7d25f5a9b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:42.176379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddc9b7-8bfd-41e5-a0df-d2a7d25f5a9b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:42.177576 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddc9b7-8bfd-41e5-a0df-d2a7d25f5a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:42.200025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f9ddc9b7-8bfd-41e5-a0df-d2a7d25f5a9b None None] MFA Rules not processed for user `703c2c40fe434402817a8824c2756ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:42.201393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f9ddc9b7-8bfd-41e5-a0df-d2a7d25f5a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:42.211938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1152/2313] 10.222.0.16 () {58 vars in 1018 bytes} [Thu Jun 23 13:17:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:42.222644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb86c9-7514-4eaf-9684-e82ba736142b None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:42.225150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6eeb86c9-7514-4eaf-9684-e82ba736142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:42.239823 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb86c9-7514-4eaf-9684-e82ba736142b None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:42.243997 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f01ef9-29a7-486a-a8ee-f88f8b29df69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:42.246770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f01ef9-29a7-486a-a8ee-f88f8b29df69 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:42.246770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f01ef9-29a7-486a-a8ee-f88f8b29df69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:42.246770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f01ef9-29a7-486a-a8ee-f88f8b29df69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:42.257245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f01ef9-29a7-486a-a8ee-f88f8b29df69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:42.258763 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f01ef9-29a7-486a-a8ee-f88f8b29df69 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:42.269647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1162/2314] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:42.340438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddc9b7-8bfd-41e5-a0df-d2a7d25f5a9b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:42.341866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f9ddc9b7-8bfd-41e5-a0df-d2a7d25f5a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:42.412758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddc9b7-8bfd-41e5-a0df-d2a7d25f5a9b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:42.422554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cddb78-64e0-4c29-ab1d-18bc437f95fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b5745bfb5d4e6ca172bb8fab229e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:42.423460 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cddb78-64e0-4c29-ab1d-18bc437f95fa service placement] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:42.423746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cddb78-64e0-4c29-ab1d-18bc437f95fa service placement] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:42.424024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cddb78-64e0-4c29-ab1d-18bc437f95fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:42.425847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-10cddb78-64e0-4c29-ab1d-18bc437f95fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:42.438744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cddb78-64e0-4c29-ab1d-18bc437f95fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:42.440512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cddb78-64e0-4c29-ab1d-18bc437f95fa service placement] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:42.451567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1153/2315] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:44.914235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f01ef9-29a7-486a-a8ee-f88f8b29df69 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:44.926571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f01ef9-29a7-486a-a8ee-f88f8b29df69 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:44.939247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad97bc-ca3a-4ca8-a188-ef89e0f7e3b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:44.940502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad97bc-ca3a-4ca8-a188-ef89e0f7e3b6 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:44.940502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad97bc-ca3a-4ca8-a188-ef89e0f7e3b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:44.940699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdad97bc-ca3a-4ca8-a188-ef89e0f7e3b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:44.942883 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fdad97bc-ca3a-4ca8-a188-ef89e0f7e3b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:44.957789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad97bc-ca3a-4ca8-a188-ef89e0f7e3b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:44.961081 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdad97bc-ca3a-4ca8-a188-ef89e0f7e3b6 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:44.976083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1163/2316] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:45.812860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df07e4c-6b05-4896-8b0b-23bf29c15dbe None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:45.813423 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df07e4c-6b05-4896-8b0b-23bf29c15dbe None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:45.813618 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df07e4c-6b05-4896-8b0b-23bf29c15dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:45.838789 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7df07e4c-6b05-4896-8b0b-23bf29c15dbe None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:45.840695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7df07e4c-6b05-4896-8b0b-23bf29c15dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:45.851329 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1154/2317] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:17:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:45.867295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad97bc-ca3a-4ca8-a188-ef89e0f7e3b6 service nova] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:45.886518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdad97bc-ca3a-4ca8-a188-ef89e0f7e3b6 service nova] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:45.895279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a90b489-4175-4b7b-a924-7467efa330c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:45.895279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b489-4175-4b7b-a924-7467efa330c4 service swift] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:45.895279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b489-4175-4b7b-a924-7467efa330c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:45.895279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a90b489-4175-4b7b-a924-7467efa330c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:45.908664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90b489-4175-4b7b-a924-7467efa330c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:45.910328 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a90b489-4175-4b7b-a924-7467efa330c4 service swift] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:45.923570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1164/2318] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:17:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:17:50.867274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df07e4c-6b05-4896-8b0b-23bf29c15dbe None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:50.885290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df07e4c-6b05-4896-8b0b-23bf29c15dbe None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:50.891949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f0dae-b493-47cb-82f6-9910fac83285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:50.892622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f0dae-b493-47cb-82f6-9910fac83285 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:50.892950 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f0dae-b493-47cb-82f6-9910fac83285 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:50.893232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f0dae-b493-47cb-82f6-9910fac83285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:50.895673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4a3f0dae-b493-47cb-82f6-9910fac83285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:50.980718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f0dae-b493-47cb-82f6-9910fac83285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:50.983134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f0dae-b493-47cb-82f6-9910fac83285 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:50.995763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:50.999177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1155/2319] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:51.826473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daacab-cf80-48c8-aa20-669e0c9d77e4 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:51.827036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daacab-cf80-48c8-aa20-669e0c9d77e4 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:51.827200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95daacab-cf80-48c8-aa20-669e0c9d77e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:51.849492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-95daacab-cf80-48c8-aa20-669e0c9d77e4 None None] MFA Rules not processed for user `0ac9553e75a9408c80c0777f37c2b815`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:51.867948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-95daacab-cf80-48c8-aa20-669e0c9d77e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:51.923082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1165/2320] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:52.314064 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f0dae-b493-47cb-82f6-9910fac83285 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:52.326840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f0dae-b493-47cb-82f6-9910fac83285 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:52.330569 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bcfd8-d6a6-4d84-90db-82455fbd5607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:52.331218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bcfd8-d6a6-4d84-90db-82455fbd5607 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:52.331504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bcfd8-d6a6-4d84-90db-82455fbd5607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:52.331781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bcfd8-d6a6-4d84-90db-82455fbd5607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:52.333587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-cf7bcfd8-d6a6-4d84-90db-82455fbd5607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:52.345436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bcfd8-d6a6-4d84-90db-82455fbd5607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:52.347119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bcfd8-d6a6-4d84-90db-82455fbd5607 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:52.358241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1156/2321] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:52.894626 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95daacab-cf80-48c8-aa20-669e0c9d77e4 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:53.034270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95daacab-cf80-48c8-aa20-669e0c9d77e4 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:53.039373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:53.040260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:53.040541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:53.040848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] PATH_INFO: `/v3/users/1f8f5257b15246a7b691c2aa73baf71f` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:53.042409 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8f5257b15246a7b691c2aa73baf71f)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:53.044775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:53.048057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:53.275162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8f5257b15246a7b691c2aa73baf71f'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:53.289100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8f5257b15246a7b691c2aa73baf71f'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:53.383181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8f5257b15246a7b691c2aa73baf71f'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:53.383181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8f5257b15246a7b691c2aa73baf71f'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:53.383181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8f5257b15246a7b691c2aa73baf71f'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:53.396894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1166/2322] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:17:52 2022] DELETE /identity/v3/users/1f8f5257b15246a7b691c2aa73baf71f => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:53.402522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cca970-0c68-49ed-9bf7-210ed72f204b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:53.403077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cca970-0c68-49ed-9bf7-210ed72f204b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:53.403234 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cca970-0c68-49ed-9bf7-210ed72f204b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:53.422177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f1cca970-0c68-49ed-9bf7-210ed72f204b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:53.423532 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f1cca970-0c68-49ed-9bf7-210ed72f204b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:53.490162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1157/2323] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:17:53.500513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:53.502098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:53.578957 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a95976-67bb-453d-91e3-f2f9c8c09d8e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:53.583759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a4653-61be-4f50-b868-8710db7100bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:53.585910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a4653-61be-4f50-b868-8710db7100bb service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:53.585910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a4653-61be-4f50-b868-8710db7100bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:53.586906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a4653-61be-4f50-b868-8710db7100bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:53.598290 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a4653-61be-4f50-b868-8710db7100bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:53.599330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a4653-61be-4f50-b868-8710db7100bb service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:53.610964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1167/2324] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:17:54.270993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cca970-0c68-49ed-9bf7-210ed72f204b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:54.273203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f1cca970-0c68-49ed-9bf7-210ed72f204b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:54.286205 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cca970-0c68-49ed-9bf7-210ed72f204b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:54.295668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:54.295668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:54.295668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:54.295668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] PATH_INFO: `/v3/projects/20f8b2504e36444d93d9715f4543c590` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:54.296371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f8b2504e36444d93d9715f4543c590)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:54.296477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:54.400658 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f8b2504e36444d93d9715f4543c590', 'request_id': 'req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:54.456988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f8b2504e36444d93d9715f4543c590', 'request_id': 'req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:54.463947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f8b2504e36444d93d9715f4543c590', 'request_id': 'req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:54.474179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] The token cache is being invalidate because project 20f8b2504e36444d93d9715f4543c590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:17:54.474468 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:54.475621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:54.477213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1158/2325] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:17:54 2022] DELETE /identity/v3/projects/20f8b2504e36444d93d9715f4543c590 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:17:54.481170 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a4653-61be-4f50-b868-8710db7100bb service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:54.491759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a4653-61be-4f50-b868-8710db7100bb service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:54.547759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de61a509-e568-42f0-9a06-a5ee8c219724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:54.548551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61a509-e568-42f0-9a06-a5ee8c219724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:54.548873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61a509-e568-42f0-9a06-a5ee8c219724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:54.549156 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61a509-e568-42f0-9a06-a5ee8c219724 admin admin] PATH_INFO: `/v3/users/f9e326d95f2b4757a05bc735fb441fea` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:54.550366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61a509-e568-42f0-9a06-a5ee8c219724 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e326d95f2b4757a05bc735fb441fea)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:54.552311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de61a509-e568-42f0-9a06-a5ee8c219724 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:54.664756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:54.785568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-de61a509-e568-42f0-9a06-a5ee8c219724 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e326d95f2b4757a05bc735fb441fea'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:54.797750 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-de61a509-e568-42f0-9a06-a5ee8c219724 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e326d95f2b4757a05bc735fb441fea'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:54.869067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-de61a509-e568-42f0-9a06-a5ee8c219724 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e326d95f2b4757a05bc735fb441fea'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:54.869698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-de61a509-e568-42f0-9a06-a5ee8c219724 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e326d95f2b4757a05bc735fb441fea'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:54.870314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-de61a509-e568-42f0-9a06-a5ee8c219724 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e326d95f2b4757a05bc735fb441fea'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:54.884719 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1168/2326] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:17:54 2022] DELETE /identity/v3/users/f9e326d95f2b4757a05bc735fb441fea => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:55.689391 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:55.690869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:55.704699 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f01fdf-0a59-4c6c-8752-1c77c84bc6d2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:55.771008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:55.772943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:55.773232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:55.773543 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63 admin admin] PATH_INFO: `/v3/projects/84ec1c2aeb8d49fc8a986c1ec59232a2` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:55.774822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ec1c2aeb8d49fc8a986c1ec59232a2)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:55.776789 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:55.788289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:55.937883 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ec1c2aeb8d49fc8a986c1ec59232a2', 'request_id': 'req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:56.024031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ec1c2aeb8d49fc8a986c1ec59232a2', 'request_id': 'req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:56.030931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ec1c2aeb8d49fc8a986c1ec59232a2', 'request_id': 'req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:56.041634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63 admin admin] The token cache is being invalidate because project 84ec1c2aeb8d49fc8a986c1ec59232a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:17:56.041920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:56.042560 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2079d94b-0d1a-41cc-a5eb-69a4dce12f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:56.044174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1159/2327] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:17:55 2022] DELETE /identity/v3/projects/84ec1c2aeb8d49fc8a986c1ec59232a2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:56.048939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5bb13-d360-4017-a082-f02e5fb5e98c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:56.049497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5bb13-d360-4017-a082-f02e5fb5e98c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:56.049497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5bb13-d360-4017-a082-f02e5fb5e98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:56.068430 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-22d5bb13-d360-4017-a082-f02e5fb5e98c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:56.070406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-22d5bb13-d360-4017-a082-f02e5fb5e98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:56.129686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1169/2328] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:56.138098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764259e-ce0a-4d86-a0d6-d05cfb052b09 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:56.138382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764259e-ce0a-4d86-a0d6-d05cfb052b09 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:56.138658 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764259e-ce0a-4d86-a0d6-d05cfb052b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:56.158536 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6764259e-ce0a-4d86-a0d6-d05cfb052b09 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:56.159742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6764259e-ce0a-4d86-a0d6-d05cfb052b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:56.168177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1160/2329] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:56.172422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5bb13-d360-4017-a082-f02e5fb5e98c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:56.182347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5bb13-d360-4017-a082-f02e5fb5e98c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:56.187071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182e79c-d5a8-4265-acf9-41a459bcbb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:56.187737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182e79c-d5a8-4265-acf9-41a459bcbb8a admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:56.188025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182e79c-d5a8-4265-acf9-41a459bcbb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:56.188310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182e79c-d5a8-4265-acf9-41a459bcbb8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:56.189110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182e79c-d5a8-4265-acf9-41a459bcbb8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:17:56.189441 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182e79c-d5a8-4265-acf9-41a459bcbb8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:56.191406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182e79c-d5a8-4265-acf9-41a459bcbb8a admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:56.214627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1170/2330] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:17:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:17:56.215747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764259e-ce0a-4d86-a0d6-d05cfb052b09 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:56.225648 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764259e-ce0a-4d86-a0d6-d05cfb052b09 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:56.230346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6b39f-6304-4195-ac5a-f6e746413e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:56.231000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6b39f-6304-4195-ac5a-f6e746413e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:56.231284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6b39f-6304-4195-ac5a-f6e746413e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:56.231566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6b39f-6304-4195-ac5a-f6e746413e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:56.232299 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6b39f-6304-4195-ac5a-f6e746413e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:56.234229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe6b39f-6304-4195-ac5a-f6e746413e69 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:56.329748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1161/2331] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:17:56 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:17:56.332543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182e79c-d5a8-4265-acf9-41a459bcbb8a admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:56.343008 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182e79c-d5a8-4265-acf9-41a459bcbb8a admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:56.400726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81b8d1-3d2f-4d9b-98a2-350e35a8f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:56.401487 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b8d1-3d2f-4d9b-98a2-350e35a8f5ba admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:56.401768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b8d1-3d2f-4d9b-98a2-350e35a8f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:56.402047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81b8d1-3d2f-4d9b-98a2-350e35a8f5ba admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:56.402954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81b8d1-3d2f-4d9b-98a2-350e35a8f5ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:56.404932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81b8d1-3d2f-4d9b-98a2-350e35a8f5ba admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:56.486101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1171/2332] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:17:56 2022] POST /identity/v3/users => generated 282 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:17:56.487613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6b39f-6304-4195-ac5a-f6e746413e69 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:56.498593 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6b39f-6304-4195-ac5a-f6e746413e69 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:56.503351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7b83d-6464-462e-a089-67835411699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:56.504059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7b83d-6464-462e-a089-67835411699a admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:56.504410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7b83d-6464-462e-a089-67835411699a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:56.504726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7b83d-6464-462e-a089-67835411699a admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:56.505593 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7b83d-6464-462e-a089-67835411699a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:56.507911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b7b83d-6464-462e-a089-67835411699a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:56.519004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1162/2333] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:17:56.523674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81b8d1-3d2f-4d9b-98a2-350e35a8f5ba admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:56.534247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81b8d1-3d2f-4d9b-98a2-350e35a8f5ba admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:56.539025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9997342-7b03-4885-ba69-0ea52ba496bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:56.539686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997342-7b03-4885-ba69-0ea52ba496bb admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:56.539975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997342-7b03-4885-ba69-0ea52ba496bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:56.540253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9997342-7b03-4885-ba69-0ea52ba496bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:56.541011 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9997342-7b03-4885-ba69-0ea52ba496bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:56.542629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9997342-7b03-4885-ba69-0ea52ba496bb admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:56.554478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1172/2334] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:17:56.558552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7b83d-6464-462e-a089-67835411699a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:56.569303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7b83d-6464-462e-a089-67835411699a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:56.574187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a891c2-e38b-48fb-9f16-ef6f31629934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:56.575076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a891c2-e38b-48fb-9f16-ef6f31629934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:56.575395 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a891c2-e38b-48fb-9f16-ef6f31629934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:56.575671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a891c2-e38b-48fb-9f16-ef6f31629934 admin admin] PATH_INFO: `/v3/projects/c2221db857c64804816c11ebaac4a1db/users/144b1e207a2941378ca867012a60351b/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:56.594097 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a891c2-e38b-48fb-9f16-ef6f31629934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2221db857c64804816c11ebaac4a1db, user_id=144b1e207a2941378ca867012a60351b, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:56.596690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a891c2-e38b-48fb-9f16-ef6f31629934 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:56.810681 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1163/2335] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:17:56 2022] PUT /identity/v3/projects/c2221db857c64804816c11ebaac4a1db/users/144b1e207a2941378ca867012a60351b/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:56.813976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50c2a9-6ee0-422d-99ed-366ab462cd9d None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:56.814272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50c2a9-6ee0-422d-99ed-366ab462cd9d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:56.814554 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50c2a9-6ee0-422d-99ed-366ab462cd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:56.842327 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:56.860846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-5a50c2a9-6ee0-422d-99ed-366ab462cd9d None None] MFA Rules not processed for user `144b1e207a2941378ca867012a60351b`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:56.860846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5a50c2a9-6ee0-422d-99ed-366ab462cd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:56.921958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1173/2336] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:56.926569 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a891c2-e38b-48fb-9f16-ef6f31629934 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:56.995139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a891c2-e38b-48fb-9f16-ef6f31629934 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:57.000386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7af0d5-a12a-4e96-8ab5-e1ca7d366759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:57.001279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7af0d5-a12a-4e96-8ab5-e1ca7d366759 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:57.001832 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7af0d5-a12a-4e96-8ab5-e1ca7d366759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:57.002113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7af0d5-a12a-4e96-8ab5-e1ca7d366759 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:57.002818 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7af0d5-a12a-4e96-8ab5-e1ca7d366759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:57.004845 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7af0d5-a12a-4e96-8ab5-e1ca7d366759 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:57.188261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1164/2337] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:17:56 2022] POST /identity/v3/projects => generated 363 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:17:57.189540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50c2a9-6ee0-422d-99ed-366ab462cd9d None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:57.200939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50c2a9-6ee0-422d-99ed-366ab462cd9d None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:57.260741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7624d-aa69-43a2-ab2d-4c79c66dd55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:57.261569 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7624d-aa69-43a2-ab2d-4c79c66dd55d admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:57.261908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7624d-aa69-43a2-ab2d-4c79c66dd55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:57.262217 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7624d-aa69-43a2-ab2d-4c79c66dd55d admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:57.262907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7624d-aa69-43a2-ab2d-4c79c66dd55d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:57.264892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7624d-aa69-43a2-ab2d-4c79c66dd55d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:57.375537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1174/2338] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:17:57 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:17:57.379669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7af0d5-a12a-4e96-8ab5-e1ca7d366759 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:57.390437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7af0d5-a12a-4e96-8ab5-e1ca7d366759 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:57.395060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4fada-8551-40e5-bf90-48641536b076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:57.396185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4fada-8551-40e5-bf90-48641536b076 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:57.396470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4fada-8551-40e5-bf90-48641536b076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:57.396986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4fada-8551-40e5-bf90-48641536b076 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:57.397701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4fada-8551-40e5-bf90-48641536b076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:57.399319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4fada-8551-40e5-bf90-48641536b076 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:57.415029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1165/2339] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:17:57.416224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7624d-aa69-43a2-ab2d-4c79c66dd55d admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:57.426268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7624d-aa69-43a2-ab2d-4c79c66dd55d admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:57.431708 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28691aeb-4f85-47c9-8052-08cb24674b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:57.433141 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28691aeb-4f85-47c9-8052-08cb24674b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:57.433141 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28691aeb-4f85-47c9-8052-08cb24674b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:57.441811 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28691aeb-4f85-47c9-8052-08cb24674b79 admin admin] PATH_INFO: `/v3/projects/d21198e0e1c34d448976f75267a5c2af/users/9bef714fda0642d9a405f661c060a799/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:57.450474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28691aeb-4f85-47c9-8052-08cb24674b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21198e0e1c34d448976f75267a5c2af, user_id=9bef714fda0642d9a405f661c060a799, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:57.453195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28691aeb-4f85-47c9-8052-08cb24674b79 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:57.527028 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1175/2340] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:17:57 2022] PUT /identity/v3/projects/d21198e0e1c34d448976f75267a5c2af/users/9bef714fda0642d9a405f661c060a799/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:57.531429 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4fada-8551-40e5-bf90-48641536b076 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:57.542976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4fada-8551-40e5-bf90-48641536b076 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:57.547874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:57.600005 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835cb59-8d3b-49d0-9c54-b38392be6074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:57.600685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835cb59-8d3b-49d0-9c54-b38392be6074 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:57.601071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835cb59-8d3b-49d0-9c54-b38392be6074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:57.601300 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835cb59-8d3b-49d0-9c54-b38392be6074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:57.602332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835cb59-8d3b-49d0-9c54-b38392be6074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:57.604649 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835cb59-8d3b-49d0-9c54-b38392be6074 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:57.615101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1166/2341] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:17:57.619894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28691aeb-4f85-47c9-8052-08cb24674b79 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:57.630293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28691aeb-4f85-47c9-8052-08cb24674b79 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:57.635555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc52e64-9164-4ddf-a8ec-42983dca9ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:57.636459 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc52e64-9164-4ddf-a8ec-42983dca9ed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:57.636738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc52e64-9164-4ddf-a8ec-42983dca9ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:57.637048 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc52e64-9164-4ddf-a8ec-42983dca9ed7 admin admin] PATH_INFO: `/v3/projects/d21198e0e1c34d448976f75267a5c2af/users/9bef714fda0642d9a405f661c060a799/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:57.639010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc52e64-9164-4ddf-a8ec-42983dca9ed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d21198e0e1c34d448976f75267a5c2af, user_id=9bef714fda0642d9a405f661c060a799, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:57.641776 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc52e64-9164-4ddf-a8ec-42983dca9ed7 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:57.652919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1176/2342] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:17:57 2022] PUT /identity/v3/projects/d21198e0e1c34d448976f75267a5c2af/users/9bef714fda0642d9a405f661c060a799/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:57.666903 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab1220-4989-44b3-8621-6b2cd6156bee None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:57.667226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab1220-4989-44b3-8621-6b2cd6156bee None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:57.667512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab1220-4989-44b3-8621-6b2cd6156bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:57.695462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1dab1220-4989-44b3-8621-6b2cd6156bee None None] MFA Rules not processed for user `9bef714fda0642d9a405f661c060a799`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:57.698968 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1dab1220-4989-44b3-8621-6b2cd6156bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:57.819296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1167/2343] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:57 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:57.836693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc52e64-9164-4ddf-a8ec-42983dca9ed7 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:57.839979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4dc52e64-9164-4ddf-a8ec-42983dca9ed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:57.947768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc52e64-9164-4ddf-a8ec-42983dca9ed7 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:57.951958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae4911-e9b6-4003-aea0-f0baebc4a566 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:57.952630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae4911-e9b6-4003-aea0-f0baebc4a566 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:57.952947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae4911-e9b6-4003-aea0-f0baebc4a566 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:57.953238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae4911-e9b6-4003-aea0-f0baebc4a566 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:57.961194 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:57.975878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae4911-e9b6-4003-aea0-f0baebc4a566 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:57.978105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae4911-e9b6-4003-aea0-f0baebc4a566 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:57.992029 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1177/2344] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:57 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:58.532540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab1220-4989-44b3-8621-6b2cd6156bee None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:58.535198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1dab1220-4989-44b3-8621-6b2cd6156bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:58.625497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab1220-4989-44b3-8621-6b2cd6156bee None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:58.632034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab4323-6113-4934-a113-21d3ea9542b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:58.632716 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab4323-6113-4934-a113-21d3ea9542b1 service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:58.633200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab4323-6113-4934-a113-21d3ea9542b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:58.640847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab4323-6113-4934-a113-21d3ea9542b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:58.646697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ddab4323-6113-4934-a113-21d3ea9542b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:58.674742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab4323-6113-4934-a113-21d3ea9542b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:58.674742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab4323-6113-4934-a113-21d3ea9542b1 service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:58.688263 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1168/2345] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:17:59.140067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae4911-e9b6-4003-aea0-f0baebc4a566 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:59.235354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab4323-6113-4934-a113-21d3ea9542b1 service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:59.237928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ddab4323-6113-4934-a113-21d3ea9542b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:59.258505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae4911-e9b6-4003-aea0-f0baebc4a566 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:59.267705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab4323-6113-4934-a113-21d3ea9542b1 service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:59.270725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:59.271648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.272698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.272995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] PATH_INFO: `/v3/users/144b1e207a2941378ca867012a60351b` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.274295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144b1e207a2941378ca867012a60351b)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:59.279453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:59.279573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04117a79-de5d-449c-82f8-c4e548a65e8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:59.280387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04117a79-de5d-449c-82f8-c4e548a65e8e service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.280680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04117a79-de5d-449c-82f8-c4e548a65e8e service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.281018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04117a79-de5d-449c-82f8-c4e548a65e8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.283067 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-04117a79-de5d-449c-82f8-c4e548a65e8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:59.308158 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04117a79-de5d-449c-82f8-c4e548a65e8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:59.310571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04117a79-de5d-449c-82f8-c4e548a65e8e service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:59.324410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1169/2346] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:17:59.520104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144b1e207a2941378ca867012a60351b'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:59.532172 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144b1e207a2941378ca867012a60351b'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:59.601280 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144b1e207a2941378ca867012a60351b'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:59.601897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144b1e207a2941378ca867012a60351b'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:59.602505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144b1e207a2941378ca867012a60351b'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:17:59.616502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1178/2347] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:17:59 2022] DELETE /identity/v3/users/144b1e207a2941378ca867012a60351b => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:17:59.621223 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af1a69-5bbe-4801-8b8f-2f7aa711f1fb None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.625327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af1a69-5bbe-4801-8b8f-2f7aa711f1fb None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.625327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af1a69-5bbe-4801-8b8f-2f7aa711f1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.627541 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:17:59.639493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-36af1a69-5bbe-4801-8b8f-2f7aa711f1fb None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:17:59.640698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-36af1a69-5bbe-4801-8b8f-2f7aa711f1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:59.702298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1170/2348] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:17:59.712481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:17:59.714150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:17:59.796130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d6aa8-2522-4ae4-b652-63737054f4e2 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:17:59.799792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44421d2d-f109-4bbe-b71d-c9d72ced23e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:17:59.800709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44421d2d-f109-4bbe-b71d-c9d72ced23e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:17:59.800709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44421d2d-f109-4bbe-b71d-c9d72ced23e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:17:59.801437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44421d2d-f109-4bbe-b71d-c9d72ced23e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:17:59.811871 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44421d2d-f109-4bbe-b71d-c9d72ced23e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:17:59.815605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44421d2d-f109-4bbe-b71d-c9d72ced23e4 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:17:59.823817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1179/2349] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:00.362571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af1a69-5bbe-4801-8b8f-2f7aa711f1fb None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:00.364062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-36af1a69-5bbe-4801-8b8f-2f7aa711f1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:00.376842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af1a69-5bbe-4801-8b8f-2f7aa711f1fb None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:00.383475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defebfe4-b001-4a4f-9eef-942dce2bd4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:00.394074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defebfe4-b001-4a4f-9eef-942dce2bd4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:00.394074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defebfe4-b001-4a4f-9eef-942dce2bd4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:00.394074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defebfe4-b001-4a4f-9eef-942dce2bd4e2 admin admin] PATH_INFO: `/v3/projects/c2221db857c64804816c11ebaac4a1db` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:00.394074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defebfe4-b001-4a4f-9eef-942dce2bd4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2221db857c64804816c11ebaac4a1db)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:00.394074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defebfe4-b001-4a4f-9eef-942dce2bd4e2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:00.540895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-defebfe4-b001-4a4f-9eef-942dce2bd4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2221db857c64804816c11ebaac4a1db', 'request_id': 'req-defebfe4-b001-4a4f-9eef-942dce2bd4e2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:00.659420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-defebfe4-b001-4a4f-9eef-942dce2bd4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2221db857c64804816c11ebaac4a1db', 'request_id': 'req-defebfe4-b001-4a4f-9eef-942dce2bd4e2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:00.666627 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-defebfe4-b001-4a4f-9eef-942dce2bd4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2221db857c64804816c11ebaac4a1db', 'request_id': 'req-defebfe4-b001-4a4f-9eef-942dce2bd4e2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:00.677971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-defebfe4-b001-4a4f-9eef-942dce2bd4e2 admin admin] The token cache is being invalidate because project c2221db857c64804816c11ebaac4a1db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:00.678461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-defebfe4-b001-4a4f-9eef-942dce2bd4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:00.678922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-defebfe4-b001-4a4f-9eef-942dce2bd4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:00.680461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1171/2350] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:00 2022] DELETE /identity/v3/projects/c2221db857c64804816c11ebaac4a1db => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:00.684567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44421d2d-f109-4bbe-b71d-c9d72ced23e4 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:00.695127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44421d2d-f109-4bbe-b71d-c9d72ced23e4 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:00.708330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:00.755018 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:00.756634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:00.757302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:00.757584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] PATH_INFO: `/v3/users/9bef714fda0642d9a405f661c060a799` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:00.758787 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bef714fda0642d9a405f661c060a799)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:00.760722 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:01.034474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bef714fda0642d9a405f661c060a799'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:01.046281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bef714fda0642d9a405f661c060a799'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:01.114386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bef714fda0642d9a405f661c060a799'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:01.115054 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bef714fda0642d9a405f661c060a799'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:01.115698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bef714fda0642d9a405f661c060a799'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:01.129326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1180/2351] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:18:00 2022] DELETE /identity/v3/users/9bef714fda0642d9a405f661c060a799 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:18:01.212536 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c269350-e516-4ff5-b5d2-668f8e48a708 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:01.212909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c269350-e516-4ff5-b5d2-668f8e48a708 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:01.213190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c269350-e516-4ff5-b5d2-668f8e48a708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:01.239220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7c269350-e516-4ff5-b5d2-668f8e48a708 None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:01.240451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7c269350-e516-4ff5-b5d2-668f8e48a708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:01.298869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1172/2352] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jun 23 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:01.310982 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:01.312392 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:01.392865 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6e5db-2cef-4795-bffd-075095d68713 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:01.398267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a5cc8-197a-4b70-b078-95fc769a0235 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:01.399497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5cc8-197a-4b70-b078-95fc769a0235 service swift] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:01.399925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5cc8-197a-4b70-b078-95fc769a0235 service swift] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:01.400207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a5cc8-197a-4b70-b078-95fc769a0235 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:01.411817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a5cc8-197a-4b70-b078-95fc769a0235 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:01.418381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a5cc8-197a-4b70-b078-95fc769a0235 service swift] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:01.425522 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1181/2353] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:18:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:18:01.615935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c269350-e516-4ff5-b5d2-668f8e48a708 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:01.618166 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7c269350-e516-4ff5-b5d2-668f8e48a708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:01.705209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:01.741967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c269350-e516-4ff5-b5d2-668f8e48a708 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:01.750173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1233a53-19b3-47f3-93c8-1d1659a5561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:01.751184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1233a53-19b3-47f3-93c8-1d1659a5561b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:01.751609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1233a53-19b3-47f3-93c8-1d1659a5561b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:01.752029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1233a53-19b3-47f3-93c8-1d1659a5561b admin admin] PATH_INFO: `/v3/projects/d21198e0e1c34d448976f75267a5c2af` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:01.753587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1233a53-19b3-47f3-93c8-1d1659a5561b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d21198e0e1c34d448976f75267a5c2af)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:01.755621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1233a53-19b3-47f3-93c8-1d1659a5561b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:01.869638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c1233a53-19b3-47f3-93c8-1d1659a5561b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd21198e0e1c34d448976f75267a5c2af', 'request_id': 'req-c1233a53-19b3-47f3-93c8-1d1659a5561b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:01.964312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c1233a53-19b3-47f3-93c8-1d1659a5561b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd21198e0e1c34d448976f75267a5c2af', 'request_id': 'req-c1233a53-19b3-47f3-93c8-1d1659a5561b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:01.972709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c1233a53-19b3-47f3-93c8-1d1659a5561b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd21198e0e1c34d448976f75267a5c2af', 'request_id': 'req-c1233a53-19b3-47f3-93c8-1d1659a5561b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:01.985112 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c1233a53-19b3-47f3-93c8-1d1659a5561b admin admin] The token cache is being invalidate because project d21198e0e1c34d448976f75267a5c2af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:01.985400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c1233a53-19b3-47f3-93c8-1d1659a5561b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:01.986059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-c1233a53-19b3-47f3-93c8-1d1659a5561b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:01.990958 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1173/2354] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:01 2022] DELETE /identity/v3/projects/d21198e0e1c34d448976f75267a5c2af => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:01.993207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c815dda-09c1-4f46-ab21-4bdb7b19d498 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:01.993803 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c815dda-09c1-4f46-ab21-4bdb7b19d498 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:01.994122 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c815dda-09c1-4f46-ab21-4bdb7b19d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:02.014282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-2c815dda-09c1-4f46-ab21-4bdb7b19d498 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:02.018286 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2c815dda-09c1-4f46-ab21-4bdb7b19d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:02.040434 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:02.097730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1182/2355] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:02.106827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d98c5-24c7-4b55-8da6-41466a3e3f1a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:02.107433 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d98c5-24c7-4b55-8da6-41466a3e3f1a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:02.107924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d98c5-24c7-4b55-8da6-41466a3e3f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:02.131726 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-5d6d98c5-24c7-4b55-8da6-41466a3e3f1a None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:02.133921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5d6d98c5-24c7-4b55-8da6-41466a3e3f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:02.149879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1174/2356] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:02.155669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c815dda-09c1-4f46-ab21-4bdb7b19d498 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:02.165674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c815dda-09c1-4f46-ab21-4bdb7b19d498 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:02.170586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aaf6f-23e4-42ad-ac2f-b07024a2516e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:02.171241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aaf6f-23e4-42ad-ac2f-b07024a2516e admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:02.171520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aaf6f-23e4-42ad-ac2f-b07024a2516e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:02.171793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aaf6f-23e4-42ad-ac2f-b07024a2516e admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:02.172655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26aaf6f-23e4-42ad-ac2f-b07024a2516e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:18:02.172991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26aaf6f-23e4-42ad-ac2f-b07024a2516e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:02.174639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26aaf6f-23e4-42ad-ac2f-b07024a2516e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:02.188186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1183/2357] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:18:02.192670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d98c5-24c7-4b55-8da6-41466a3e3f1a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:02.202676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d98c5-24c7-4b55-8da6-41466a3e3f1a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:02.207376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45383f25-f8ac-41b6-a480-14d2c351dd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:02.208026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45383f25-f8ac-41b6-a480-14d2c351dd77 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:02.208312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45383f25-f8ac-41b6-a480-14d2c351dd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:02.208592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45383f25-f8ac-41b6-a480-14d2c351dd77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:02.209328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45383f25-f8ac-41b6-a480-14d2c351dd77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:02.211732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45383f25-f8ac-41b6-a480-14d2c351dd77 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:02.296855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1175/2358] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:02 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:02.300849 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aaf6f-23e4-42ad-ac2f-b07024a2516e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:02.311684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aaf6f-23e4-42ad-ac2f-b07024a2516e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:02.370787 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58afb3b-dedc-4e29-999b-fa34f42f6698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:02.371460 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58afb3b-dedc-4e29-999b-fa34f42f6698 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:02.371747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58afb3b-dedc-4e29-999b-fa34f42f6698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:02.372027 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58afb3b-dedc-4e29-999b-fa34f42f6698 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:02.372742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58afb3b-dedc-4e29-999b-fa34f42f6698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:02.374737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58afb3b-dedc-4e29-999b-fa34f42f6698 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:02.472345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1184/2359] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:02 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:18:02.476473 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45383f25-f8ac-41b6-a480-14d2c351dd77 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:02.488081 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45383f25-f8ac-41b6-a480-14d2c351dd77 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:02.494141 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352381b-d6a8-4585-81c9-591ec44c4ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:02.494913 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352381b-d6a8-4585-81c9-591ec44c4ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:02.495256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352381b-d6a8-4585-81c9-591ec44c4ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:02.498291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352381b-d6a8-4585-81c9-591ec44c4ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:02.498291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352381b-d6a8-4585-81c9-591ec44c4ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:02.498291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352381b-d6a8-4585-81c9-591ec44c4ebc admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:02.511662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1176/2360] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:18:02.516438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58afb3b-dedc-4e29-999b-fa34f42f6698 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:02.527934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58afb3b-dedc-4e29-999b-fa34f42f6698 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:02.533117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb06f0-eff3-439f-85be-cfa3114e991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:02.533858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb06f0-eff3-439f-85be-cfa3114e991b admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:02.534207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb06f0-eff3-439f-85be-cfa3114e991b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:02.534546 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb06f0-eff3-439f-85be-cfa3114e991b admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:02.535408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb06f0-eff3-439f-85be-cfa3114e991b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:02.537117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb06f0-eff3-439f-85be-cfa3114e991b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:02.550706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1185/2361] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:18:02.556645 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352381b-d6a8-4585-81c9-591ec44c4ebc admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:02.568007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352381b-d6a8-4585-81c9-591ec44c4ebc admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:02.572924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6e476-41cb-4256-b76b-26a07c6a0d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:02.577980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6e476-41cb-4256-b76b-26a07c6a0d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:02.577980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6e476-41cb-4256-b76b-26a07c6a0d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:02.577980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6e476-41cb-4256-b76b-26a07c6a0d2b admin admin] PATH_INFO: `/v3/projects/a3522eac5d454a80ab663649c27052a2/users/88ebad2738354d8fa4f985c1aa7445bf/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:02.590777 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6e476-41cb-4256-b76b-26a07c6a0d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3522eac5d454a80ab663649c27052a2, user_id=88ebad2738354d8fa4f985c1aa7445bf, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:02.593777 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a6e476-41cb-4256-b76b-26a07c6a0d2b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:02.741469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1177/2362] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:02 2022] PUT /identity/v3/projects/a3522eac5d454a80ab663649c27052a2/users/88ebad2738354d8fa4f985c1aa7445bf/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:02.754056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b2134-5189-480d-a688-fdd96bd30298 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:02.754891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b2134-5189-480d-a688-fdd96bd30298 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:02.754891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b2134-5189-480d-a688-fdd96bd30298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:02.816564 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ba7b2134-5189-480d-a688-fdd96bd30298 None None] MFA Rules not processed for user `88ebad2738354d8fa4f985c1aa7445bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:02.816564 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ba7b2134-5189-480d-a688-fdd96bd30298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:02.915956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1186/2363] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:02.920555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6e476-41cb-4256-b76b-26a07c6a0d2b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:02.998768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:03.012017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6e476-41cb-4256-b76b-26a07c6a0d2b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:03.018954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa643db-fe8f-462d-b751-2486b8e2dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:03.019645 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa643db-fe8f-462d-b751-2486b8e2dd05 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:03.020028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa643db-fe8f-462d-b751-2486b8e2dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:03.020311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa643db-fe8f-462d-b751-2486b8e2dd05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:03.021250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa643db-fe8f-462d-b751-2486b8e2dd05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:03.024915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa643db-fe8f-462d-b751-2486b8e2dd05 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:03.135253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1178/2364] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:02 2022] POST /identity/v3/projects => generated 367 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:03.138511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b2134-5189-480d-a688-fdd96bd30298 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:03.150603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b2134-5189-480d-a688-fdd96bd30298 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:03.168347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:03.209540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9781a0b-7f8d-410a-a0dc-3fd3302be09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:03.210390 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9781a0b-7f8d-410a-a0dc-3fd3302be09d admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:03.210680 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9781a0b-7f8d-410a-a0dc-3fd3302be09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:03.211482 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9781a0b-7f8d-410a-a0dc-3fd3302be09d admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:03.212195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9781a0b-7f8d-410a-a0dc-3fd3302be09d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:03.214169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9781a0b-7f8d-410a-a0dc-3fd3302be09d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:03.333835 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1187/2365] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:03 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:03.338454 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa643db-fe8f-462d-b751-2486b8e2dd05 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:03.349343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa643db-fe8f-462d-b751-2486b8e2dd05 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:03.354082 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26369492-36cf-432a-ab76-4d4d4d16580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:03.354739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26369492-36cf-432a-ab76-4d4d4d16580e admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:03.355024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26369492-36cf-432a-ab76-4d4d4d16580e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:03.355302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26369492-36cf-432a-ab76-4d4d4d16580e admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:03.356022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26369492-36cf-432a-ab76-4d4d4d16580e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:03.357659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26369492-36cf-432a-ab76-4d4d4d16580e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:03.367996 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1179/2366] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:18:03.371963 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9781a0b-7f8d-410a-a0dc-3fd3302be09d admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:03.381782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9781a0b-7f8d-410a-a0dc-3fd3302be09d admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:03.386928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b27c-84f6-4822-a36f-fc42b176dd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:03.387870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b27c-84f6-4822-a36f-fc42b176dd50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:03.388158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b27c-84f6-4822-a36f-fc42b176dd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:03.388434 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc6b27c-84f6-4822-a36f-fc42b176dd50 admin admin] PATH_INFO: `/v3/projects/d3bb98a124dd4728ac6d56a93fc31d18/users/4aee88f8f08841a6b284d25eb096d22e/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:03.409225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6b27c-84f6-4822-a36f-fc42b176dd50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3bb98a124dd4728ac6d56a93fc31d18, user_id=4aee88f8f08841a6b284d25eb096d22e, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:03.412248 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc6b27c-84f6-4822-a36f-fc42b176dd50 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:03.505717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1188/2367] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:03 2022] PUT /identity/v3/projects/d3bb98a124dd4728ac6d56a93fc31d18/users/4aee88f8f08841a6b284d25eb096d22e/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:03.509940 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26369492-36cf-432a-ab76-4d4d4d16580e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:03.520344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26369492-36cf-432a-ab76-4d4d4d16580e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:03.580562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52acf3-94cf-4136-a849-7516d5c00e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:03.582012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52acf3-94cf-4136-a849-7516d5c00e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:03.582512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52acf3-94cf-4136-a849-7516d5c00e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:03.582963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52acf3-94cf-4136-a849-7516d5c00e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:03.584234 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52acf3-94cf-4136-a849-7516d5c00e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:03.585991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52acf3-94cf-4136-a849-7516d5c00e75 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:03.597417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1180/2368] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:03.602338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b27c-84f6-4822-a36f-fc42b176dd50 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:03.617149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc6b27c-84f6-4822-a36f-fc42b176dd50 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:03.623567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcd6b1-9ef5-437f-bf0d-41517289339e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:03.630267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcd6b1-9ef5-437f-bf0d-41517289339e admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:03.630267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcd6b1-9ef5-437f-bf0d-41517289339e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:03.630267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcd6b1-9ef5-437f-bf0d-41517289339e admin admin] PATH_INFO: `/v3/projects/d3bb98a124dd4728ac6d56a93fc31d18/users/4aee88f8f08841a6b284d25eb096d22e/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:03.630267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcd6b1-9ef5-437f-bf0d-41517289339e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3bb98a124dd4728ac6d56a93fc31d18, user_id=4aee88f8f08841a6b284d25eb096d22e, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:03.632557 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbcd6b1-9ef5-437f-bf0d-41517289339e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:03.644202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1189/2369] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:03 2022] PUT /identity/v3/projects/d3bb98a124dd4728ac6d56a93fc31d18/users/4aee88f8f08841a6b284d25eb096d22e/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:18:03.655752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cd898-848e-4ede-9c31-5bfb84cbea65 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:03.656037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cd898-848e-4ede-9c31-5bfb84cbea65 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:03.656311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cd898-848e-4ede-9c31-5bfb84cbea65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:03.683779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-198cd898-848e-4ede-9c31-5bfb84cbea65 None None] MFA Rules not processed for user `4aee88f8f08841a6b284d25eb096d22e`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:03.685049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-198cd898-848e-4ede-9c31-5bfb84cbea65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:03.762801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1181/2370] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:03.773481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcd6b1-9ef5-437f-bf0d-41517289339e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:03.775276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-8dbcd6b1-9ef5-437f-bf0d-41517289339e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:03.841053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbcd6b1-9ef5-437f-bf0d-41517289339e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:03.844830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64409b0e-135e-40d0-935b-9e8fee10f81c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:03.845527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64409b0e-135e-40d0-935b-9e8fee10f81c service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:03.845808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64409b0e-135e-40d0-935b-9e8fee10f81c service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:03.846092 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64409b0e-135e-40d0-935b-9e8fee10f81c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:03.856415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64409b0e-135e-40d0-935b-9e8fee10f81c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:03.857882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64409b0e-135e-40d0-935b-9e8fee10f81c service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:03.869033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1190/2371] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:06.945393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cd898-848e-4ede-9c31-5bfb84cbea65 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:06.999016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:07.011412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cd898-848e-4ede-9c31-5bfb84cbea65 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:07.016015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:07.016921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:07.017202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:07.017477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] PATH_INFO: `/v3/users/88ebad2738354d8fa4f985c1aa7445bf` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:07.018764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88ebad2738354d8fa4f985c1aa7445bf)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:07.020667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:07.276377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88ebad2738354d8fa4f985c1aa7445bf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:07.288468 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88ebad2738354d8fa4f985c1aa7445bf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:07.368449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88ebad2738354d8fa4f985c1aa7445bf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:07.369097 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88ebad2738354d8fa4f985c1aa7445bf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:07.369705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88ebad2738354d8fa4f985c1aa7445bf'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:07.382268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1182/2372] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:18:06 2022] DELETE /identity/v3/users/88ebad2738354d8fa4f985c1aa7445bf => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:07.386821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e152745-4cd3-403a-8465-1d71db63e6fe None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:07.387287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e152745-4cd3-403a-8465-1d71db63e6fe None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:07.387405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e152745-4cd3-403a-8465-1d71db63e6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:07.406111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-0e152745-4cd3-403a-8465-1d71db63e6fe None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:07.407295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0e152745-4cd3-403a-8465-1d71db63e6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:07.465112 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1191/2373] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:07.474799 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:07.476302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:07.556426 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f111d6-30dc-4ddd-a5f1-480a84d1b188 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:07.560750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b59a46-e2b4-4b3d-81fc-8b83b52bc74d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:07.566721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b59a46-e2b4-4b3d-81fc-8b83b52bc74d service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:07.566721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b59a46-e2b4-4b3d-81fc-8b83b52bc74d service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:07.566721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b59a46-e2b4-4b3d-81fc-8b83b52bc74d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:07.572193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b59a46-e2b4-4b3d-81fc-8b83b52bc74d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:07.573703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b59a46-e2b4-4b3d-81fc-8b83b52bc74d service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:07.583733 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1183/2374] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:08.130183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e152745-4cd3-403a-8465-1d71db63e6fe None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:08.131921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0e152745-4cd3-403a-8465-1d71db63e6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:08.155755 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e152745-4cd3-403a-8465-1d71db63e6fe None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:08.163586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:08.165336 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:08.165810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:08.166468 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] PATH_INFO: `/v3/projects/a3522eac5d454a80ab663649c27052a2` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:08.169047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3522eac5d454a80ab663649c27052a2)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:08.172753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:08.185495 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:08.306583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3522eac5d454a80ab663649c27052a2', 'request_id': 'req-d2d0816c-ddc5-492d-a712-650e4f887047'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:08.419576 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3522eac5d454a80ab663649c27052a2', 'request_id': 'req-d2d0816c-ddc5-492d-a712-650e4f887047'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:08.426551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3522eac5d454a80ab663649c27052a2', 'request_id': 'req-d2d0816c-ddc5-492d-a712-650e4f887047'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:08.438647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] The token cache is being invalidate because project a3522eac5d454a80ab663649c27052a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:08.438936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:08.439629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:08.441530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1192/2375] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:08 2022] DELETE /identity/v3/projects/a3522eac5d454a80ab663649c27052a2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:18:08.445320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b59a46-e2b4-4b3d-81fc-8b83b52bc74d service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:08.456071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b59a46-e2b4-4b3d-81fc-8b83b52bc74d service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:08.516189 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75311788-9eff-403b-9de5-a94d1ba0430f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:08.517135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75311788-9eff-403b-9de5-a94d1ba0430f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:08.517422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75311788-9eff-403b-9de5-a94d1ba0430f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:08.517730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75311788-9eff-403b-9de5-a94d1ba0430f admin admin] PATH_INFO: `/v3/users/4aee88f8f08841a6b284d25eb096d22e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:08.519431 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75311788-9eff-403b-9de5-a94d1ba0430f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aee88f8f08841a6b284d25eb096d22e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:08.521397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75311788-9eff-403b-9de5-a94d1ba0430f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:08.538232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:08.696947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-75311788-9eff-403b-9de5-a94d1ba0430f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aee88f8f08841a6b284d25eb096d22e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:08.711225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-75311788-9eff-403b-9de5-a94d1ba0430f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aee88f8f08841a6b284d25eb096d22e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:08.808315 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-75311788-9eff-403b-9de5-a94d1ba0430f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aee88f8f08841a6b284d25eb096d22e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:08.809113 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-75311788-9eff-403b-9de5-a94d1ba0430f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aee88f8f08841a6b284d25eb096d22e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:08.809849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-75311788-9eff-403b-9de5-a94d1ba0430f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aee88f8f08841a6b284d25eb096d22e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:08.823191 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1184/2376] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:18:08 2022] DELETE /identity/v3/users/4aee88f8f08841a6b284d25eb096d22e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:09.284037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:09.285879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:09.302772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0816c-ddc5-492d-a712-650e4f887047 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:09.366451 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:09.367362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:09.367622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:09.368537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3 admin admin] PATH_INFO: `/v3/projects/d3bb98a124dd4728ac6d56a93fc31d18` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:09.369814 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3bb98a124dd4728ac6d56a93fc31d18)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:09.371756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:09.491553 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3bb98a124dd4728ac6d56a93fc31d18', 'request_id': 'req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:09.585243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3bb98a124dd4728ac6d56a93fc31d18', 'request_id': 'req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:09.594790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3bb98a124dd4728ac6d56a93fc31d18', 'request_id': 'req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:09.614529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3 admin admin] The token cache is being invalidate because project d3bb98a124dd4728ac6d56a93fc31d18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:09.615007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:09.615846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-ec0bdfe0-2792-4c79-8c63-7d65e3802ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:09.619193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1193/2377] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:09 2022] DELETE /identity/v3/projects/d3bb98a124dd4728ac6d56a93fc31d18 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:09.625109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcce85d-591c-43d0-98d1-7d2598fc0cec None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:09.626007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcce85d-591c-43d0-98d1-7d2598fc0cec None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:09.626708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcce85d-591c-43d0-98d1-7d2598fc0cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:09.648741 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-efcce85d-591c-43d0-98d1-7d2598fc0cec None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:09.650605 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-efcce85d-591c-43d0-98d1-7d2598fc0cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:09.728894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1185/2378] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:09.732316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694e3a-d114-4cd1-8c01-708bcee8c613 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:09.732689 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694e3a-d114-4cd1-8c01-708bcee8c613 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:09.733450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694e3a-d114-4cd1-8c01-708bcee8c613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:09.761586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-95694e3a-d114-4cd1-8c01-708bcee8c613 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:09.762839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-95694e3a-d114-4cd1-8c01-708bcee8c613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:09.771391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1194/2379] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:18:09.776411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcce85d-591c-43d0-98d1-7d2598fc0cec None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:09.789506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcce85d-591c-43d0-98d1-7d2598fc0cec None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:09.795539 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac6ef9-4f73-4c18-88e9-34c0d52a68fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:09.797611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac6ef9-4f73-4c18-88e9-34c0d52a68fd admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:09.797611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac6ef9-4f73-4c18-88e9-34c0d52a68fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:09.797611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac6ef9-4f73-4c18-88e9-34c0d52a68fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:09.797611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac6ef9-4f73-4c18-88e9-34c0d52a68fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:18:09.797994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac6ef9-4f73-4c18-88e9-34c0d52a68fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:09.799686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac6ef9-4f73-4c18-88e9-34c0d52a68fd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:09.812848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1186/2380] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:18:09.817321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694e3a-d114-4cd1-8c01-708bcee8c613 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:09.829118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694e3a-d114-4cd1-8c01-708bcee8c613 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:09.833522 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32309-1a59-4f45-a17f-308dc86011d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:09.834186 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32309-1a59-4f45-a17f-308dc86011d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:09.834526 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32309-1a59-4f45-a17f-308dc86011d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:09.834815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32309-1a59-4f45-a17f-308dc86011d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:09.835506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b32309-1a59-4f45-a17f-308dc86011d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:09.837996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b32309-1a59-4f45-a17f-308dc86011d8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:09.864764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:09.959830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1195/2381] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:09 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:09.961308 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac6ef9-4f73-4c18-88e9-34c0d52a68fd admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:09.972452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac6ef9-4f73-4c18-88e9-34c0d52a68fd admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:10.033028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530fa98-1ecb-4e1b-acc5-4dc5028497bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:10.033711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530fa98-1ecb-4e1b-acc5-4dc5028497bb admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:10.033994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530fa98-1ecb-4e1b-acc5-4dc5028497bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:10.034272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2530fa98-1ecb-4e1b-acc5-4dc5028497bb admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:10.034975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530fa98-1ecb-4e1b-acc5-4dc5028497bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:10.036942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2530fa98-1ecb-4e1b-acc5-4dc5028497bb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:10.123387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1187/2382] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:09 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:10.127393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32309-1a59-4f45-a17f-308dc86011d8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:10.139326 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32309-1a59-4f45-a17f-308dc86011d8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:10.144260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dafd1e-7d11-4acf-91a3-740efc22a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:10.144994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dafd1e-7d11-4acf-91a3-740efc22a93b admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:10.145282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dafd1e-7d11-4acf-91a3-740efc22a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:10.145731 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dafd1e-7d11-4acf-91a3-740efc22a93b admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:10.146504 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dafd1e-7d11-4acf-91a3-740efc22a93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:10.148301 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dafd1e-7d11-4acf-91a3-740efc22a93b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:10.160661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1196/2383] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:10.164864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530fa98-1ecb-4e1b-acc5-4dc5028497bb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:10.178108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2530fa98-1ecb-4e1b-acc5-4dc5028497bb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:10.183409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23baef8-17b7-4f4c-867b-20db62ecb9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:10.184119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23baef8-17b7-4f4c-867b-20db62ecb9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:10.184406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23baef8-17b7-4f4c-867b-20db62ecb9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:10.184682 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23baef8-17b7-4f4c-867b-20db62ecb9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:10.185454 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23baef8-17b7-4f4c-867b-20db62ecb9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:10.187055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23baef8-17b7-4f4c-867b-20db62ecb9fe admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:10.193909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:10.200314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1188/2384] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:10.204417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dafd1e-7d11-4acf-91a3-740efc22a93b admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:10.215648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dafd1e-7d11-4acf-91a3-740efc22a93b admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:10.220829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded93c2-34c5-4c49-aef8-d539547ed5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:10.221850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded93c2-34c5-4c49-aef8-d539547ed5f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:10.222185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded93c2-34c5-4c49-aef8-d539547ed5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:10.222646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded93c2-34c5-4c49-aef8-d539547ed5f2 admin admin] PATH_INFO: `/v3/projects/fa01fc75ead44673b1387629aba8fd0e/users/9b184d15ebea4ba0b911d2c7cf3bbd31/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:10.239095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded93c2-34c5-4c49-aef8-d539547ed5f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa01fc75ead44673b1387629aba8fd0e, user_id=9b184d15ebea4ba0b911d2c7cf3bbd31, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:10.241958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded93c2-34c5-4c49-aef8-d539547ed5f2 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:10.326750 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1197/2385] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:10 2022] PUT /identity/v3/projects/fa01fc75ead44673b1387629aba8fd0e/users/9b184d15ebea4ba0b911d2c7cf3bbd31/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:10.337256 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0803ff-07d0-4ec0-aa1c-684c1593a5d1 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:10.337637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0803ff-07d0-4ec0-aa1c-684c1593a5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:10.337920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0803ff-07d0-4ec0-aa1c-684c1593a5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:10.369273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6d0803ff-07d0-4ec0-aa1c-684c1593a5d1 None None] MFA Rules not processed for user `9b184d15ebea4ba0b911d2c7cf3bbd31`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:10.370371 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6d0803ff-07d0-4ec0-aa1c-684c1593a5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:10.464581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1189/2386] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:10.467187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded93c2-34c5-4c49-aef8-d539547ed5f2 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:10.529608 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded93c2-34c5-4c49-aef8-d539547ed5f2 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:10.534207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae40ac-35cc-4a0c-89de-134110352955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:10.534852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae40ac-35cc-4a0c-89de-134110352955 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:10.535133 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae40ac-35cc-4a0c-89de-134110352955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:10.535416 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae40ac-35cc-4a0c-89de-134110352955 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:10.536096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae40ac-35cc-4a0c-89de-134110352955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:10.538065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae40ac-35cc-4a0c-89de-134110352955 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:10.665556 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1198/2387] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:10 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:10.669553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0803ff-07d0-4ec0-aa1c-684c1593a5d1 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:10.682138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0803ff-07d0-4ec0-aa1c-684c1593a5d1 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:10.739349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c58c1-5005-4588-be27-c677eabeeddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:10.740022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c58c1-5005-4588-be27-c677eabeeddd admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:10.740306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c58c1-5005-4588-be27-c677eabeeddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:10.740584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c58c1-5005-4588-be27-c677eabeeddd admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:10.741314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c58c1-5005-4588-be27-c677eabeeddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:10.743408 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c58c1-5005-4588-be27-c677eabeeddd admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:10.878824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1190/2388] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:10 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:10.882809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae40ac-35cc-4a0c-89de-134110352955 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:10.894133 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae40ac-35cc-4a0c-89de-134110352955 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:10.899804 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bec05-7b7e-49e8-9e4a-c988773da640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:10.900654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bec05-7b7e-49e8-9e4a-c988773da640 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:10.900972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bec05-7b7e-49e8-9e4a-c988773da640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:10.901350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bec05-7b7e-49e8-9e4a-c988773da640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:10.902085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bec05-7b7e-49e8-9e4a-c988773da640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:10.904056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bec05-7b7e-49e8-9e4a-c988773da640 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:10.915588 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1199/2389] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:10.919666 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c58c1-5005-4588-be27-c677eabeeddd admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:10.930357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c58c1-5005-4588-be27-c677eabeeddd admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:10.935075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bed17c-2c5b-4489-aa79-254f883a8fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:10.935955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bed17c-2c5b-4489-aa79-254f883a8fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:10.936270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bed17c-2c5b-4489-aa79-254f883a8fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:10.936550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bed17c-2c5b-4489-aa79-254f883a8fa3 admin admin] PATH_INFO: `/v3/projects/4d2922bdb0aa4190815e8507e36597f1/users/7043fdb06e7041008b67ad390fde3178/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:10.952030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bed17c-2c5b-4489-aa79-254f883a8fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d2922bdb0aa4190815e8507e36597f1, user_id=7043fdb06e7041008b67ad390fde3178, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:10.955003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bed17c-2c5b-4489-aa79-254f883a8fa3 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:11.042077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1191/2390] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:10 2022] PUT /identity/v3/projects/4d2922bdb0aa4190815e8507e36597f1/users/7043fdb06e7041008b67ad390fde3178/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:11.045936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bec05-7b7e-49e8-9e4a-c988773da640 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:11.056222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bec05-7b7e-49e8-9e4a-c988773da640 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:11.111265 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088492e0-cc82-427b-a3b0-d362096f9702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:11.111920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088492e0-cc82-427b-a3b0-d362096f9702 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:11.112206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088492e0-cc82-427b-a3b0-d362096f9702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:11.112485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088492e0-cc82-427b-a3b0-d362096f9702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:11.113238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088492e0-cc82-427b-a3b0-d362096f9702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:11.114862 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088492e0-cc82-427b-a3b0-d362096f9702 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:11.124860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1200/2391] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:11.129280 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bed17c-2c5b-4489-aa79-254f883a8fa3 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:11.140081 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bed17c-2c5b-4489-aa79-254f883a8fa3 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:11.144614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812106c-094f-4da6-acda-74a33c6d2fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:11.145533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812106c-094f-4da6-acda-74a33c6d2fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:11.145841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812106c-094f-4da6-acda-74a33c6d2fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:11.146116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812106c-094f-4da6-acda-74a33c6d2fe8 admin admin] PATH_INFO: `/v3/projects/4d2922bdb0aa4190815e8507e36597f1/users/7043fdb06e7041008b67ad390fde3178/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:11.148085 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812106c-094f-4da6-acda-74a33c6d2fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d2922bdb0aa4190815e8507e36597f1, user_id=7043fdb06e7041008b67ad390fde3178, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:11.151404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8812106c-094f-4da6-acda-74a33c6d2fe8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:11.161801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1192/2392] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:11 2022] PUT /identity/v3/projects/4d2922bdb0aa4190815e8507e36597f1/users/7043fdb06e7041008b67ad390fde3178/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:11.171938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737bebe-ecfa-4021-b9f4-c71a5894cc4a None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:11.172231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737bebe-ecfa-4021-b9f4-c71a5894cc4a None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:11.172572 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e737bebe-ecfa-4021-b9f4-c71a5894cc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:11.199847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e737bebe-ecfa-4021-b9f4-c71a5894cc4a None None] MFA Rules not processed for user `7043fdb06e7041008b67ad390fde3178`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:11.201083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e737bebe-ecfa-4021-b9f4-c71a5894cc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:11.213482 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:11.268928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1201/2393] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:11.281296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812106c-094f-4da6-acda-74a33c6d2fe8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:11.283077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8812106c-094f-4da6-acda-74a33c6d2fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:11.330040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:11.341718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812106c-094f-4da6-acda-74a33c6d2fe8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:11.345567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d41f3-ea10-4319-af8b-340405318c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:11.346285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d41f3-ea10-4319-af8b-340405318c53 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:11.346568 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d41f3-ea10-4319-af8b-340405318c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:11.346845 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d41f3-ea10-4319-af8b-340405318c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:11.356656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d41f3-ea10-4319-af8b-340405318c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:11.358097 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d41f3-ea10-4319-af8b-340405318c53 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:11.367659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1193/2394] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:12.330623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737bebe-ecfa-4021-b9f4-c71a5894cc4a None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:12.340862 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e737bebe-ecfa-4021-b9f4-c71a5894cc4a None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:12.345523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc841e4-527d-4b2a-ae06-75c7df5f8e2b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7043fdb06e7041008b67ad390fde3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2922bdb0aa4190815e8507e36597f1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:12.346197 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc841e4-527d-4b2a-ae06-75c7df5f8e2b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:12.346480 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc841e4-527d-4b2a-ae06-75c7df5f8e2b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:12.346758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc841e4-527d-4b2a-ae06-75c7df5f8e2b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:12.347482 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc841e4-527d-4b2a-ae06-75c7df5f8e2b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:18:12.347788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc841e4-527d-4b2a-ae06-75c7df5f8e2b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:12.349426 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc841e4-527d-4b2a-ae06-75c7df5f8e2b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:12.361527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1202/2395] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:18:12.365709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d41f3-ea10-4319-af8b-340405318c53 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:12.374874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d41f3-ea10-4319-af8b-340405318c53 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:12.379545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8465a4-847b-4414-ae59-cc8c98cf816b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7043fdb06e7041008b67ad390fde3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2922bdb0aa4190815e8507e36597f1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:12.380222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8465a4-847b-4414-ae59-cc8c98cf816b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:12.380513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8465a4-847b-4414-ae59-cc8c98cf816b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:12.380797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8465a4-847b-4414-ae59-cc8c98cf816b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:12.381526 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8465a4-847b-4414-ae59-cc8c98cf816b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:12.383422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8465a4-847b-4414-ae59-cc8c98cf816b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:12.523818 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1194/2396] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:12 2022] POST /identity/v3/projects => generated 355 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:12.528888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc841e4-527d-4b2a-ae06-75c7df5f8e2b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:12.538825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc841e4-527d-4b2a-ae06-75c7df5f8e2b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:12.594835 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff19a68-230e-4644-8db1-ebbc0ab0b1d3 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7043fdb06e7041008b67ad390fde3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2922bdb0aa4190815e8507e36597f1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:12.595520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff19a68-230e-4644-8db1-ebbc0ab0b1d3 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:12.595813 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff19a68-230e-4644-8db1-ebbc0ab0b1d3 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:12.596092 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff19a68-230e-4644-8db1-ebbc0ab0b1d3 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:12.596830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff19a68-230e-4644-8db1-ebbc0ab0b1d3 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:18:12.597158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff19a68-230e-4644-8db1-ebbc0ab0b1d3 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:12.598768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff19a68-230e-4644-8db1-ebbc0ab0b1d3 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:12.610369 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1203/2397] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:18:12.647118 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8465a4-847b-4414-ae59-cc8c98cf816b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:12.657552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8465a4-847b-4414-ae59-cc8c98cf816b tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:12.662123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac4fd7-c041-4166-9079-782f13543aa2 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7043fdb06e7041008b67ad390fde3178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d2922bdb0aa4190815e8507e36597f1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:12.662979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac4fd7-c041-4166-9079-782f13543aa2 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:12.663265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac4fd7-c041-4166-9079-782f13543aa2 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:12.663547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac4fd7-c041-4166-9079-782f13543aa2 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] PATH_INFO: `/v3/projects/569d37869e064504a149219bd123ceb4` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:12.664718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac4fd7-c041-4166-9079-782f13543aa2 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: Authorizing `identity:delete_project(project_id=569d37869e064504a149219bd123ceb4)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:12.666905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac4fd7-c041-4166-9079-782f13543aa2 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:12.789068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02ac4fd7-c041-4166-9079-782f13543aa2 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569d37869e064504a149219bd123ceb4', 'request_id': 'req-02ac4fd7-c041-4166-9079-782f13543aa2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:12.874797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02ac4fd7-c041-4166-9079-782f13543aa2 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569d37869e064504a149219bd123ceb4', 'request_id': 'req-02ac4fd7-c041-4166-9079-782f13543aa2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:12.881820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02ac4fd7-c041-4166-9079-782f13543aa2 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569d37869e064504a149219bd123ceb4', 'request_id': 'req-02ac4fd7-c041-4166-9079-782f13543aa2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:12.893116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02ac4fd7-c041-4166-9079-782f13543aa2 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] The token cache is being invalidate because project 569d37869e064504a149219bd123ceb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:12.893403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02ac4fd7-c041-4166-9079-782f13543aa2 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:12.894052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02ac4fd7-c041-4166-9079-782f13543aa2 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:12.895595 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1195/2398] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:12 2022] DELETE /identity/v3/projects/569d37869e064504a149219bd123ceb4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:13.549312 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff19a68-230e-4644-8db1-ebbc0ab0b1d3 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:13.551126 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1ff19a68-230e-4644-8db1-ebbc0ab0b1d3 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:13.618364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff19a68-230e-4644-8db1-ebbc0ab0b1d3 tempest-VolumeQuotaClassesTest-1197463469 tempest-VolumeQuotaClassesTest-1197463469-project-admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:13.657657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:13.675550 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:13.676414 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:13.676696 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:13.677010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] PATH_INFO: `/v3/users/9b184d15ebea4ba0b911d2c7cf3bbd31` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:13.678212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b184d15ebea4ba0b911d2c7cf3bbd31)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:13.680139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:13.951220 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b184d15ebea4ba0b911d2c7cf3bbd31'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:13.963990 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b184d15ebea4ba0b911d2c7cf3bbd31'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:14.036579 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b184d15ebea4ba0b911d2c7cf3bbd31'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:14.037298 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b184d15ebea4ba0b911d2c7cf3bbd31'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:14.038119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b184d15ebea4ba0b911d2c7cf3bbd31'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:14.059619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1204/2399] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:18:13 2022] DELETE /identity/v3/users/9b184d15ebea4ba0b911d2c7cf3bbd31 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:14.064121 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cef257-21eb-484b-b101-d9c54c3d2e59 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:14.070102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cef257-21eb-484b-b101-d9c54c3d2e59 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:14.070102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cef257-21eb-484b-b101-d9c54c3d2e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:14.085087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b7cef257-21eb-484b-b101-d9c54c3d2e59 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:14.086325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b7cef257-21eb-484b-b101-d9c54c3d2e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:14.170169 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1196/2400] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:14.185146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:14.186886 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:14.289645 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c5a98-a04f-4ceb-b5e7-ae6a634deb74 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:14.295883 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12b086-35c0-492d-b512-e5a2a83a33ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:14.296559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12b086-35c0-492d-b512-e5a2a83a33ae service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:14.296955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12b086-35c0-492d-b512-e5a2a83a33ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:14.297203 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12b086-35c0-492d-b512-e5a2a83a33ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:14.311333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12b086-35c0-492d-b512-e5a2a83a33ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:14.313754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12b086-35c0-492d-b512-e5a2a83a33ae service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:14.326728 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1205/2401] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:14.787070 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cef257-21eb-484b-b101-d9c54c3d2e59 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:14.789333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b7cef257-21eb-484b-b101-d9c54c3d2e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:14.803676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cef257-21eb-484b-b101-d9c54c3d2e59 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:14.809329 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:14.810252 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:14.810617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:14.810903 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] PATH_INFO: `/v3/projects/fa01fc75ead44673b1387629aba8fd0e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:14.812158 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa01fc75ead44673b1387629aba8fd0e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:14.814186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:14.934566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:14.940917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa01fc75ead44673b1387629aba8fd0e', 'request_id': 'req-03d18db4-644e-4dae-827e-456452f80851'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:15.032061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa01fc75ead44673b1387629aba8fd0e', 'request_id': 'req-03d18db4-644e-4dae-827e-456452f80851'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:15.040192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa01fc75ead44673b1387629aba8fd0e', 'request_id': 'req-03d18db4-644e-4dae-827e-456452f80851'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:15.052439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] The token cache is being invalidate because project fa01fc75ead44673b1387629aba8fd0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:15.052826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:15.053550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:15.056842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1197/2402] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:14 2022] DELETE /identity/v3/projects/fa01fc75ead44673b1387629aba8fd0e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:15.060115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12b086-35c0-492d-b512-e5a2a83a33ae service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:15.070826 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12b086-35c0-492d-b512-e5a2a83a33ae service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:15.140376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028abed-7444-4d6c-bb29-ff95e706811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:15.140969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028abed-7444-4d6c-bb29-ff95e706811d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:15.141534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028abed-7444-4d6c-bb29-ff95e706811d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:15.141534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028abed-7444-4d6c-bb29-ff95e706811d admin admin] PATH_INFO: `/v3/users/7043fdb06e7041008b67ad390fde3178` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:15.142699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028abed-7444-4d6c-bb29-ff95e706811d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7043fdb06e7041008b67ad390fde3178)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:15.144727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028abed-7444-4d6c-bb29-ff95e706811d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:15.147443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:15.465787 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f028abed-7444-4d6c-bb29-ff95e706811d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7043fdb06e7041008b67ad390fde3178'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:15.477211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f028abed-7444-4d6c-bb29-ff95e706811d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7043fdb06e7041008b67ad390fde3178'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:15.589023 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f028abed-7444-4d6c-bb29-ff95e706811d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7043fdb06e7041008b67ad390fde3178'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:15.589615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f028abed-7444-4d6c-bb29-ff95e706811d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7043fdb06e7041008b67ad390fde3178'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:15.590226 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f028abed-7444-4d6c-bb29-ff95e706811d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7043fdb06e7041008b67ad390fde3178'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:15.603382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1206/2403] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:18:15 2022] DELETE /identity/v3/users/7043fdb06e7041008b67ad390fde3178 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:18:16.140954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:16.142596 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:16.157810 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d18db4-644e-4dae-827e-456452f80851 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:16.224096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:16.225102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:16.225951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:16.226236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2 admin admin] PATH_INFO: `/v3/projects/4d2922bdb0aa4190815e8507e36597f1` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:16.227459 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d2922bdb0aa4190815e8507e36597f1)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:16.230197 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:16.394312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d2922bdb0aa4190815e8507e36597f1', 'request_id': 'req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:16.499479 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d2922bdb0aa4190815e8507e36597f1', 'request_id': 'req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:16.506314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d2922bdb0aa4190815e8507e36597f1', 'request_id': 'req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:16.517602 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2 admin admin] The token cache is being invalidate because project 4d2922bdb0aa4190815e8507e36597f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:16.517907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:16.518623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-fffeb45e-9867-4f4a-b19e-39ba2cd062d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:16.523146 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1198/2404] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:16 2022] DELETE /identity/v3/projects/4d2922bdb0aa4190815e8507e36597f1 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:16.525980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacb4cf-5ae2-454b-9f2f-f8f7e735ec69 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:16.526432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacb4cf-5ae2-454b-9f2f-f8f7e735ec69 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:16.526733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacb4cf-5ae2-454b-9f2f-f8f7e735ec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:16.545595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-1dacb4cf-5ae2-454b-9f2f-f8f7e735ec69 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:16.546907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1dacb4cf-5ae2-454b-9f2f-f8f7e735ec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:16.606407 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1207/2405] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:16.615335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022689c7-76f6-44df-82e2-4364fea0fcba None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:16.615822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022689c7-76f6-44df-82e2-4364fea0fcba None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:16.616104 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022689c7-76f6-44df-82e2-4364fea0fcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:16.636578 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-022689c7-76f6-44df-82e2-4364fea0fcba None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:16.637816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-022689c7-76f6-44df-82e2-4364fea0fcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:16.646165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1199/2406] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:16.650777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacb4cf-5ae2-454b-9f2f-f8f7e735ec69 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:16.661280 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacb4cf-5ae2-454b-9f2f-f8f7e735ec69 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:16.665977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5359af-4b0f-42a6-a46c-ed8793f77dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:16.667221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5359af-4b0f-42a6-a46c-ed8793f77dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:16.667504 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5359af-4b0f-42a6-a46c-ed8793f77dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:16.667781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5359af-4b0f-42a6-a46c-ed8793f77dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:16.668511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5359af-4b0f-42a6-a46c-ed8793f77dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:18:16.668845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5359af-4b0f-42a6-a46c-ed8793f77dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:16.670633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5359af-4b0f-42a6-a46c-ed8793f77dd8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:16.682816 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1208/2407] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:18:16.687242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022689c7-76f6-44df-82e2-4364fea0fcba None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:16.696415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022689c7-76f6-44df-82e2-4364fea0fcba None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:16.701199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de862c53-7b71-458a-ae39-620be1e5a86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:16.701849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de862c53-7b71-458a-ae39-620be1e5a86f admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:16.702133 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de862c53-7b71-458a-ae39-620be1e5a86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:16.702410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de862c53-7b71-458a-ae39-620be1e5a86f admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:16.703094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de862c53-7b71-458a-ae39-620be1e5a86f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:16.705036 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de862c53-7b71-458a-ae39-620be1e5a86f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:16.801505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1200/2408] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:16 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:16.805951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5359af-4b0f-42a6-a46c-ed8793f77dd8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:16.816201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5359af-4b0f-42a6-a46c-ed8793f77dd8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:16.872601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef620d84-84e1-4f9c-8162-e0bb1ca14137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:16.873348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef620d84-84e1-4f9c-8162-e0bb1ca14137 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:16.873630 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef620d84-84e1-4f9c-8162-e0bb1ca14137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:16.873905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef620d84-84e1-4f9c-8162-e0bb1ca14137 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:16.874605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef620d84-84e1-4f9c-8162-e0bb1ca14137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:16.876540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef620d84-84e1-4f9c-8162-e0bb1ca14137 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:17.000615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:17.006755 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1209/2409] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:16 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:17.011409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de862c53-7b71-458a-ae39-620be1e5a86f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:17.022153 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de862c53-7b71-458a-ae39-620be1e5a86f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:17.027846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2bfc8-1856-4372-871d-83b711cb2abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:17.028534 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2bfc8-1856-4372-871d-83b711cb2abb admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:17.028832 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2bfc8-1856-4372-871d-83b711cb2abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:17.029117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2bfc8-1856-4372-871d-83b711cb2abb admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:17.029872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2bfc8-1856-4372-871d-83b711cb2abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:17.031452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2bfc8-1856-4372-871d-83b711cb2abb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:17.042778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1201/2410] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:17.046465 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef620d84-84e1-4f9c-8162-e0bb1ca14137 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:17.056834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef620d84-84e1-4f9c-8162-e0bb1ca14137 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:17.061795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffef5d4-a828-4866-b043-769ce41e54ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:17.065485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffef5d4-a828-4866-b043-769ce41e54ff admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:17.065485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffef5d4-a828-4866-b043-769ce41e54ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:17.065485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffef5d4-a828-4866-b043-769ce41e54ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:17.065485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffef5d4-a828-4866-b043-769ce41e54ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:17.065485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffef5d4-a828-4866-b043-769ce41e54ff admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:17.077508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1210/2411] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:17.081693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2bfc8-1856-4372-871d-83b711cb2abb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:17.092562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2bfc8-1856-4372-871d-83b711cb2abb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:17.097109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03082eda-8c1f-48bc-8e61-eb190a78e23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:17.097967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082eda-8c1f-48bc-8e61-eb190a78e23a admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:17.098247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082eda-8c1f-48bc-8e61-eb190a78e23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:17.098515 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082eda-8c1f-48bc-8e61-eb190a78e23a admin admin] PATH_INFO: `/v3/projects/ffb568d5b76e407ea5ac699b89e46f31/users/4fd43a6cbc8f4389948869470d70fde2/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:17.113236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03082eda-8c1f-48bc-8e61-eb190a78e23a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb568d5b76e407ea5ac699b89e46f31, user_id=4fd43a6cbc8f4389948869470d70fde2, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:17.115949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03082eda-8c1f-48bc-8e61-eb190a78e23a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:17.119602 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:17.205745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1202/2412] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:17 2022] PUT /identity/v3/projects/ffb568d5b76e407ea5ac699b89e46f31/users/4fd43a6cbc8f4389948869470d70fde2/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:17.216498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5ba8f-3a18-42c9-8a15-69f18b05a044 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:17.216790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5ba8f-3a18-42c9-8a15-69f18b05a044 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:17.217097 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5ba8f-3a18-42c9-8a15-69f18b05a044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:17.243541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-8cb5ba8f-3a18-42c9-8a15-69f18b05a044 None None] MFA Rules not processed for user `4fd43a6cbc8f4389948869470d70fde2`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:17.245404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-8cb5ba8f-3a18-42c9-8a15-69f18b05a044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:17.310138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1211/2413] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:17.314750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03082eda-8c1f-48bc-8e61-eb190a78e23a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:17.376366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03082eda-8c1f-48bc-8e61-eb190a78e23a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:17.381034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23399ea-bd73-4ddf-9e59-fcfa414180ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:17.381694 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23399ea-bd73-4ddf-9e59-fcfa414180ed admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:17.381986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23399ea-bd73-4ddf-9e59-fcfa414180ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:17.382267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23399ea-bd73-4ddf-9e59-fcfa414180ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:17.382975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23399ea-bd73-4ddf-9e59-fcfa414180ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:17.385583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23399ea-bd73-4ddf-9e59-fcfa414180ed admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:17.475387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1203/2414] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:17 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:17.480024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5ba8f-3a18-42c9-8a15-69f18b05a044 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:17.490894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5ba8f-3a18-42c9-8a15-69f18b05a044 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:17.547648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436e77b-d2ba-4226-961f-0df89434d8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:17.548319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436e77b-d2ba-4226-961f-0df89434d8aa admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:17.548607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436e77b-d2ba-4226-961f-0df89434d8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:17.548924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a436e77b-d2ba-4226-961f-0df89434d8aa admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:17.549634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436e77b-d2ba-4226-961f-0df89434d8aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:17.551578 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a436e77b-d2ba-4226-961f-0df89434d8aa admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:17.636134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1212/2415] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:17 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:17.640198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23399ea-bd73-4ddf-9e59-fcfa414180ed admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:17.650683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23399ea-bd73-4ddf-9e59-fcfa414180ed admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:17.655645 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe00fd4-89e6-4fc8-a22e-c2f1742acd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:17.656310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00fd4-89e6-4fc8-a22e-c2f1742acd68 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:17.656603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00fd4-89e6-4fc8-a22e-c2f1742acd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:17.656938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe00fd4-89e6-4fc8-a22e-c2f1742acd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:17.657842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe00fd4-89e6-4fc8-a22e-c2f1742acd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:17.659393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe00fd4-89e6-4fc8-a22e-c2f1742acd68 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:17.674238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1204/2416] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:17.675334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436e77b-d2ba-4226-961f-0df89434d8aa admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:17.687076 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a436e77b-d2ba-4226-961f-0df89434d8aa admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:17.691914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64863995-e65a-4d9b-96fe-62301592c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:17.692790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64863995-e65a-4d9b-96fe-62301592c831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:17.693098 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64863995-e65a-4d9b-96fe-62301592c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:17.693375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64863995-e65a-4d9b-96fe-62301592c831 admin admin] PATH_INFO: `/v3/projects/deccb0ae5b3f4a16bdae82ad0ac8d69a/users/0c9f54d7ebcd4e909d2e545cdbf73a75/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:17.708960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64863995-e65a-4d9b-96fe-62301592c831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deccb0ae5b3f4a16bdae82ad0ac8d69a, user_id=0c9f54d7ebcd4e909d2e545cdbf73a75, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:17.711617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64863995-e65a-4d9b-96fe-62301592c831 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:17.854402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1213/2417] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:17 2022] PUT /identity/v3/projects/deccb0ae5b3f4a16bdae82ad0ac8d69a/users/0c9f54d7ebcd4e909d2e545cdbf73a75/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:17.859129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe00fd4-89e6-4fc8-a22e-c2f1742acd68 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:17.872922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe00fd4-89e6-4fc8-a22e-c2f1742acd68 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:17.928016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3a0dc-2b54-4184-bf6b-818885ee80d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:17.928617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3a0dc-2b54-4184-bf6b-818885ee80d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:17.928940 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3a0dc-2b54-4184-bf6b-818885ee80d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:17.929224 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3a0dc-2b54-4184-bf6b-818885ee80d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:17.929952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3a0dc-2b54-4184-bf6b-818885ee80d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:17.931588 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3a0dc-2b54-4184-bf6b-818885ee80d4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:17.941181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1205/2418] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:17.945364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64863995-e65a-4d9b-96fe-62301592c831 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:17.956468 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64863995-e65a-4d9b-96fe-62301592c831 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:17.961540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3aa04-f356-44f4-80b9-7f7ee7b12e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:17.962429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3aa04-f356-44f4-80b9-7f7ee7b12e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:17.963215 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3aa04-f356-44f4-80b9-7f7ee7b12e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:17.963517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3aa04-f356-44f4-80b9-7f7ee7b12e12 admin admin] PATH_INFO: `/v3/projects/deccb0ae5b3f4a16bdae82ad0ac8d69a/users/0c9f54d7ebcd4e909d2e545cdbf73a75/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:17.965809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3aa04-f356-44f4-80b9-7f7ee7b12e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deccb0ae5b3f4a16bdae82ad0ac8d69a, user_id=0c9f54d7ebcd4e909d2e545cdbf73a75, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:17.968513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3aa04-f356-44f4-80b9-7f7ee7b12e12 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:17.980499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1214/2419] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:17 2022] PUT /identity/v3/projects/deccb0ae5b3f4a16bdae82ad0ac8d69a/users/0c9f54d7ebcd4e909d2e545cdbf73a75/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:17.991729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8708ba1-8dc9-4276-9074-f916a5cc231f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:17.992064 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8708ba1-8dc9-4276-9074-f916a5cc231f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:17.992309 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8708ba1-8dc9-4276-9074-f916a5cc231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:18.018356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b8708ba1-8dc9-4276-9074-f916a5cc231f None None] MFA Rules not processed for user `0c9f54d7ebcd4e909d2e545cdbf73a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:18.019556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b8708ba1-8dc9-4276-9074-f916a5cc231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:18.072175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:18.091307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1206/2420] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:18.102123 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3aa04-f356-44f4-80b9-7f7ee7b12e12 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:18.104733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-63c3aa04-f356-44f4-80b9-7f7ee7b12e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:18.140452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:18.167694 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3aa04-f356-44f4-80b9-7f7ee7b12e12 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:18.171381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f9432-4f35-46ec-a733-f718c2bfba09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:18.172022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f9432-4f35-46ec-a733-f718c2bfba09 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:18.172307 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f9432-4f35-46ec-a733-f718c2bfba09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:18.172586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f9432-4f35-46ec-a733-f718c2bfba09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:18.181806 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f9432-4f35-46ec-a733-f718c2bfba09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:18.183207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f9432-4f35-46ec-a733-f718c2bfba09 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:18.192709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1215/2421] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:18.814093 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8708ba1-8dc9-4276-9074-f916a5cc231f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:18.897615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8708ba1-8dc9-4276-9074-f916a5cc231f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:18.903432 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:18.904325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:18.904613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:18.904923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] PATH_INFO: `/v3/users/4fd43a6cbc8f4389948869470d70fde2` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:18.906142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fd43a6cbc8f4389948869470d70fde2)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:18.908078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:19.055988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fd43a6cbc8f4389948869470d70fde2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:19.075577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fd43a6cbc8f4389948869470d70fde2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:19.154350 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fd43a6cbc8f4389948869470d70fde2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:19.155019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fd43a6cbc8f4389948869470d70fde2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:19.155942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fd43a6cbc8f4389948869470d70fde2'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:19.171618 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1207/2422] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:18:18 2022] DELETE /identity/v3/users/4fd43a6cbc8f4389948869470d70fde2 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:19.176358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52190d1f-bfea-403f-8a3f-f135329c3b10 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:19.176872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52190d1f-bfea-403f-8a3f-f135329c3b10 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:19.176993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52190d1f-bfea-403f-8a3f-f135329c3b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:19.203130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-52190d1f-bfea-403f-8a3f-f135329c3b10 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:19.204535 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-52190d1f-bfea-403f-8a3f-f135329c3b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:19.278425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1216/2423] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:19.289035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:19.291114 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:19.363306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054d741-d69f-44ce-82f9-48767d350676 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:19.367159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f11324-c66d-4bc7-bf5b-f0328cbb9efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:19.367819 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f11324-c66d-4bc7-bf5b-f0328cbb9efb service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:19.368109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f11324-c66d-4bc7-bf5b-f0328cbb9efb service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:19.368440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f11324-c66d-4bc7-bf5b-f0328cbb9efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:19.383962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f11324-c66d-4bc7-bf5b-f0328cbb9efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:19.386960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f11324-c66d-4bc7-bf5b-f0328cbb9efb service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:19.397873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1208/2424] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:19.868000 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52190d1f-bfea-403f-8a3f-f135329c3b10 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:19.869522 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-52190d1f-bfea-403f-8a3f-f135329c3b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:19.882051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52190d1f-bfea-403f-8a3f-f135329c3b10 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:19.887368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:19.888263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:19.888549 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:19.888856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] PATH_INFO: `/v3/projects/ffb568d5b76e407ea5ac699b89e46f31` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:19.890050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb568d5b76e407ea5ac699b89e46f31)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:19.892004 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:19.999292 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb568d5b76e407ea5ac699b89e46f31', 'request_id': 'req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:20.088078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb568d5b76e407ea5ac699b89e46f31', 'request_id': 'req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:20.095782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb568d5b76e407ea5ac699b89e46f31', 'request_id': 'req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:20.107070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] The token cache is being invalidate because project ffb568d5b76e407ea5ac699b89e46f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:20.107356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:20.107994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:20.109582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1217/2425] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:19 2022] DELETE /identity/v3/projects/ffb568d5b76e407ea5ac699b89e46f31 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:20.113579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f11324-c66d-4bc7-bf5b-f0328cbb9efb service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:20.127127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f11324-c66d-4bc7-bf5b-f0328cbb9efb service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:20.133189 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:20.181085 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:20.181991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:20.182344 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:20.182621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] PATH_INFO: `/v3/users/0c9f54d7ebcd4e909d2e545cdbf73a75` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:20.183812 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c9f54d7ebcd4e909d2e545cdbf73a75)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:20.185761 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:20.356657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9f54d7ebcd4e909d2e545cdbf73a75'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:20.368687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9f54d7ebcd4e909d2e545cdbf73a75'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:20.434411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9f54d7ebcd4e909d2e545cdbf73a75'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:20.435075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9f54d7ebcd4e909d2e545cdbf73a75'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:20.435710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9f54d7ebcd4e909d2e545cdbf73a75'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:20.451635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1209/2426] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:18:20 2022] DELETE /identity/v3/users/0c9f54d7ebcd4e909d2e545cdbf73a75 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:20.521160 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:20.522684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:20.581279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26f9ba-ac73-4c5d-a0b7-72edce53dae8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:20.589239 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:20.629891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701a15c-d382-438e-9d35-577127f91943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:20.630543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701a15c-d382-438e-9d35-577127f91943 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:20.630825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701a15c-d382-438e-9d35-577127f91943 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:20.631103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701a15c-d382-438e-9d35-577127f91943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:20.632929 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e701a15c-d382-438e-9d35-577127f91943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:20.704615 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701a15c-d382-438e-9d35-577127f91943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:20.706120 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701a15c-d382-438e-9d35-577127f91943 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:20.717074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1218/2427] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:20.881974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:20.883600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:20.897484 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fadebbf-5a24-45aa-a505-1ac405765559 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:20.903385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81104781-5c25-4842-8ffd-144cd6c15164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:20.904163 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81104781-5c25-4842-8ffd-144cd6c15164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:20.904438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81104781-5c25-4842-8ffd-144cd6c15164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:20.904715 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81104781-5c25-4842-8ffd-144cd6c15164 admin admin] PATH_INFO: `/v3/projects/deccb0ae5b3f4a16bdae82ad0ac8d69a` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:20.905974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81104781-5c25-4842-8ffd-144cd6c15164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deccb0ae5b3f4a16bdae82ad0ac8d69a)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:20.907918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81104781-5c25-4842-8ffd-144cd6c15164 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:21.012009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-81104781-5c25-4842-8ffd-144cd6c15164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deccb0ae5b3f4a16bdae82ad0ac8d69a', 'request_id': 'req-81104781-5c25-4842-8ffd-144cd6c15164'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:21.075229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-81104781-5c25-4842-8ffd-144cd6c15164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deccb0ae5b3f4a16bdae82ad0ac8d69a', 'request_id': 'req-81104781-5c25-4842-8ffd-144cd6c15164'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:21.082214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-81104781-5c25-4842-8ffd-144cd6c15164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deccb0ae5b3f4a16bdae82ad0ac8d69a', 'request_id': 'req-81104781-5c25-4842-8ffd-144cd6c15164'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:21.093685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-81104781-5c25-4842-8ffd-144cd6c15164 admin admin] The token cache is being invalidate because project deccb0ae5b3f4a16bdae82ad0ac8d69a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:21.093972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-81104781-5c25-4842-8ffd-144cd6c15164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:21.094612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-81104781-5c25-4842-8ffd-144cd6c15164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:21.096214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1210/2428] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:20 2022] DELETE /identity/v3/projects/deccb0ae5b3f4a16bdae82ad0ac8d69a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:21.101224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62ee46-c131-4300-b6df-883b09e7aac5 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:21.104960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62ee46-c131-4300-b6df-883b09e7aac5 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:21.104960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62ee46-c131-4300-b6df-883b09e7aac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:21.120661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-aa62ee46-c131-4300-b6df-883b09e7aac5 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:21.122088 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-aa62ee46-c131-4300-b6df-883b09e7aac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:21.186665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1219/2429] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:18:21.194265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceea93-c935-49ed-8d07-10a27aaac7bc None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:21.194750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceea93-c935-49ed-8d07-10a27aaac7bc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:21.194864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddceea93-c935-49ed-8d07-10a27aaac7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:21.215289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ddceea93-c935-49ed-8d07-10a27aaac7bc None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:21.216487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ddceea93-c935-49ed-8d07-10a27aaac7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:21.224528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1211/2430] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:21.229176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62ee46-c131-4300-b6df-883b09e7aac5 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:21.238977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62ee46-c131-4300-b6df-883b09e7aac5 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:21.243521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077b3cc-6c86-411d-845e-cae757301996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:21.244171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077b3cc-6c86-411d-845e-cae757301996 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:21.244542 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077b3cc-6c86-411d-845e-cae757301996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:21.244880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077b3cc-6c86-411d-845e-cae757301996 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:21.245587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077b3cc-6c86-411d-845e-cae757301996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:18:21.245896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077b3cc-6c86-411d-845e-cae757301996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:21.247729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077b3cc-6c86-411d-845e-cae757301996 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:21.261643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1220/2431] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:18:21.266114 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddceea93-c935-49ed-8d07-10a27aaac7bc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:21.275397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddceea93-c935-49ed-8d07-10a27aaac7bc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:21.281236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef9a40-c04f-4d95-b7ed-00cb6a1e685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:21.281901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef9a40-c04f-4d95-b7ed-00cb6a1e685d admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:21.282187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef9a40-c04f-4d95-b7ed-00cb6a1e685d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:21.282465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef9a40-c04f-4d95-b7ed-00cb6a1e685d admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:21.283286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef9a40-c04f-4d95-b7ed-00cb6a1e685d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:21.285218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef9a40-c04f-4d95-b7ed-00cb6a1e685d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:21.289432 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:21.514029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1212/2432] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:21 2022] POST /identity/v3/projects => generated 371 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:18:21.524697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077b3cc-6c86-411d-845e-cae757301996 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:21.528878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077b3cc-6c86-411d-845e-cae757301996 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:21.575113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:21.586551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a889f-4e8d-4637-8333-b06279189fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:21.587484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a889f-4e8d-4637-8333-b06279189fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:21.587737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a889f-4e8d-4637-8333-b06279189fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:21.587875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a889f-4e8d-4637-8333-b06279189fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:21.589246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a889f-4e8d-4637-8333-b06279189fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:21.591245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a889f-4e8d-4637-8333-b06279189fc1 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:21.711655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1221/2433] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:21 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:21.716045 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef9a40-c04f-4d95-b7ed-00cb6a1e685d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:21.726593 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef9a40-c04f-4d95-b7ed-00cb6a1e685d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:21.731285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d4efa-b7a0-451b-aa49-67638d2fc61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:21.731943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d4efa-b7a0-451b-aa49-67638d2fc61d admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:21.732335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d4efa-b7a0-451b-aa49-67638d2fc61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:21.732618 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d4efa-b7a0-451b-aa49-67638d2fc61d admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:21.733381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d4efa-b7a0-451b-aa49-67638d2fc61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:21.734965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d4efa-b7a0-451b-aa49-67638d2fc61d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:21.745973 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1213/2434] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:18:21.749989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a889f-4e8d-4637-8333-b06279189fc1 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:21.759869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a889f-4e8d-4637-8333-b06279189fc1 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:21.765260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda79835-e893-4c6c-a291-6c54541a35f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:21.765903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda79835-e893-4c6c-a291-6c54541a35f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:21.766182 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda79835-e893-4c6c-a291-6c54541a35f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:21.766554 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda79835-e893-4c6c-a291-6c54541a35f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:21.767282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda79835-e893-4c6c-a291-6c54541a35f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:21.768933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda79835-e893-4c6c-a291-6c54541a35f0 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:21.781200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1222/2435] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:18:21.783881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d4efa-b7a0-451b-aa49-67638d2fc61d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:21.794082 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d4efa-b7a0-451b-aa49-67638d2fc61d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:21.798650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059668a5-8057-48e2-b598-6ec3a87e72e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:21.799570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059668a5-8057-48e2-b598-6ec3a87e72e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:21.799874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059668a5-8057-48e2-b598-6ec3a87e72e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:21.800253 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059668a5-8057-48e2-b598-6ec3a87e72e3 admin admin] PATH_INFO: `/v3/projects/c5f9be3ad4984e25aeac906e13fd0387/users/5836583c9aed46e09297c0f32cbb7520/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:21.820665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059668a5-8057-48e2-b598-6ec3a87e72e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5f9be3ad4984e25aeac906e13fd0387, user_id=5836583c9aed46e09297c0f32cbb7520, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:21.824057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059668a5-8057-48e2-b598-6ec3a87e72e3 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:21.955900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1214/2436] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:21 2022] PUT /identity/v3/projects/c5f9be3ad4984e25aeac906e13fd0387/users/5836583c9aed46e09297c0f32cbb7520/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:18:21.961461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107298fa-8c24-48a6-a692-130786509f8d None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:21.961759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107298fa-8c24-48a6-a692-130786509f8d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:21.962047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107298fa-8c24-48a6-a692-130786509f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:21.982529 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-107298fa-8c24-48a6-a692-130786509f8d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:21.983773 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-107298fa-8c24-48a6-a692-130786509f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:22.049277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1223/2437] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:22.059485 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059668a5-8057-48e2-b598-6ec3a87e72e3 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:22.061222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-059668a5-8057-48e2-b598-6ec3a87e72e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:22.119024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059668a5-8057-48e2-b598-6ec3a87e72e3 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:22.128938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38c5e4-cee9-4664-890a-eb379b92605f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:22.129618 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38c5e4-cee9-4664-890a-eb379b92605f service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:22.129904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38c5e4-cee9-4664-890a-eb379b92605f service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:22.130184 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c38c5e4-cee9-4664-890a-eb379b92605f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:22.140545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38c5e4-cee9-4664-890a-eb379b92605f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:22.142024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c38c5e4-cee9-4664-890a-eb379b92605f service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:22.152427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1215/2438] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:23.864115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252afb7f-3600-47f8-8ffd-1829c51de119 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:23.864115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252afb7f-3600-47f8-8ffd-1829c51de119 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:23.864115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252afb7f-3600-47f8-8ffd-1829c51de119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:23.898105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-252afb7f-3600-47f8-8ffd-1829c51de119 None None] MFA Rules not processed for user `5836583c9aed46e09297c0f32cbb7520`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:23.899394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-252afb7f-3600-47f8-8ffd-1829c51de119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:23.967374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1224/2439] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:23.971716 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38c5e4-cee9-4664-890a-eb379b92605f service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:23.981706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c38c5e4-cee9-4664-890a-eb379b92605f service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:23.986360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7b621-d6db-419a-aa07-d41d8e2ccb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:23.987019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7b621-d6db-419a-aa07-d41d8e2ccb14 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:23.987297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7b621-d6db-419a-aa07-d41d8e2ccb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:23.987569 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7b621-d6db-419a-aa07-d41d8e2ccb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:23.988268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7b621-d6db-419a-aa07-d41d8e2ccb14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:23.990415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7b621-d6db-419a-aa07-d41d8e2ccb14 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:24.118341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1216/2440] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:23 2022] POST /identity/v3/projects => generated 371 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:24.123848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252afb7f-3600-47f8-8ffd-1829c51de119 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:24.137432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252afb7f-3600-47f8-8ffd-1829c51de119 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:24.207496 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:24.213581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc233e-3ede-4b02-8721-e59b1f1dbce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:24.214537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc233e-3ede-4b02-8721-e59b1f1dbce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:24.214762 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc233e-3ede-4b02-8721-e59b1f1dbce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:24.215016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc233e-3ede-4b02-8721-e59b1f1dbce8 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:24.215739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc233e-3ede-4b02-8721-e59b1f1dbce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:24.217946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc233e-3ede-4b02-8721-e59b1f1dbce8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:24.313260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1225/2441] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:24 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:18:24.318354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7b621-d6db-419a-aa07-d41d8e2ccb14 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:24.330100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7b621-d6db-419a-aa07-d41d8e2ccb14 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:24.335290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4301eaa-650b-4f4c-a00f-d1dc6d719514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:24.335975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4301eaa-650b-4f4c-a00f-d1dc6d719514 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:24.336255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4301eaa-650b-4f4c-a00f-d1dc6d719514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:24.336544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4301eaa-650b-4f4c-a00f-d1dc6d719514 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:24.337326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4301eaa-650b-4f4c-a00f-d1dc6d719514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:24.338961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4301eaa-650b-4f4c-a00f-d1dc6d719514 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:24.350123 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1217/2442] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:24.355067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc233e-3ede-4b02-8721-e59b1f1dbce8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:24.365079 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc233e-3ede-4b02-8721-e59b1f1dbce8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:24.370496 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94791-e3d1-40c5-9e50-2e648719e822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:24.371282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94791-e3d1-40c5-9e50-2e648719e822 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:24.371587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94791-e3d1-40c5-9e50-2e648719e822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:24.371911 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94791-e3d1-40c5-9e50-2e648719e822 admin admin] PATH_INFO: `/v3/projects/ec56d0dccd8e4492a2b510c9396fc80a/users/14c717047e034b069cb80ff531b7d487/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:24.389509 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f94791-e3d1-40c5-9e50-2e648719e822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec56d0dccd8e4492a2b510c9396fc80a, user_id=14c717047e034b069cb80ff531b7d487, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:24.390925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f94791-e3d1-40c5-9e50-2e648719e822 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:24.476311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1226/2443] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:24 2022] PUT /identity/v3/projects/ec56d0dccd8e4492a2b510c9396fc80a/users/14c717047e034b069cb80ff531b7d487/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:24.485406 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4301eaa-650b-4f4c-a00f-d1dc6d719514 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:24.501688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4301eaa-650b-4f4c-a00f-d1dc6d719514 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:24.587500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2094fb-24e2-4538-b922-c2de5c12ead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:24.589945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2094fb-24e2-4538-b922-c2de5c12ead8 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:24.590239 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2094fb-24e2-4538-b922-c2de5c12ead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:24.590911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2094fb-24e2-4538-b922-c2de5c12ead8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:24.591281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2094fb-24e2-4538-b922-c2de5c12ead8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:24.592916 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2094fb-24e2-4538-b922-c2de5c12ead8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:24.603450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1218/2444] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:24.608473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94791-e3d1-40c5-9e50-2e648719e822 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:24.628729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94791-e3d1-40c5-9e50-2e648719e822 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:24.633725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa96d-a3fa-47db-a95a-a77614178ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:24.634610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa96d-a3fa-47db-a95a-a77614178ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:24.634898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa96d-a3fa-47db-a95a-a77614178ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:24.635205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37aa96d-a3fa-47db-a95a-a77614178ae1 admin admin] PATH_INFO: `/v3/projects/ec56d0dccd8e4492a2b510c9396fc80a/users/14c717047e034b069cb80ff531b7d487/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:24.637228 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa96d-a3fa-47db-a95a-a77614178ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec56d0dccd8e4492a2b510c9396fc80a, user_id=14c717047e034b069cb80ff531b7d487, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:24.639880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37aa96d-a3fa-47db-a95a-a77614178ae1 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:24.650489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1227/2445] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:24 2022] PUT /identity/v3/projects/ec56d0dccd8e4492a2b510c9396fc80a/users/14c717047e034b069cb80ff531b7d487/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:24.760120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2094fb-24e2-4538-b922-c2de5c12ead8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:24.761983 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4e2094fb-24e2-4538-b922-c2de5c12ead8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:24.779032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2094fb-24e2-4538-b922-c2de5c12ead8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:24.793390 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:24.838924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa45a6-54d8-41c3-9d2f-485a3d9519c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:24.849279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa45a6-54d8-41c3-9d2f-485a3d9519c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:24.849279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa45a6-54d8-41c3-9d2f-485a3d9519c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:24.849279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa45a6-54d8-41c3-9d2f-485a3d9519c1 admin admin] PATH_INFO: `/v3/users/4e8df306f69246389ebd6505bfbd1d76` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:24.849279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa45a6-54d8-41c3-9d2f-485a3d9519c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8df306f69246389ebd6505bfbd1d76)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:24.849279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa45a6-54d8-41c3-9d2f-485a3d9519c1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:25.094695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-41aa45a6-54d8-41c3-9d2f-485a3d9519c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8df306f69246389ebd6505bfbd1d76'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:25.106839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-41aa45a6-54d8-41c3-9d2f-485a3d9519c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8df306f69246389ebd6505bfbd1d76'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:25.188687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-41aa45a6-54d8-41c3-9d2f-485a3d9519c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8df306f69246389ebd6505bfbd1d76'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:25.189346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-41aa45a6-54d8-41c3-9d2f-485a3d9519c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8df306f69246389ebd6505bfbd1d76'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:25.189960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-41aa45a6-54d8-41c3-9d2f-485a3d9519c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8df306f69246389ebd6505bfbd1d76'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:25.204921 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1219/2446] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:18:24 2022] DELETE /identity/v3/users/4e8df306f69246389ebd6505bfbd1d76 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:25.586754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa96d-a3fa-47db-a95a-a77614178ae1 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:25.586754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c37aa96d-a3fa-47db-a95a-a77614178ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:25.601757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37aa96d-a3fa-47db-a95a-a77614178ae1 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:25.665097 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf686c5-a4f6-4e9e-84ec-b98c5339822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:25.665969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf686c5-a4f6-4e9e-84ec-b98c5339822e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:25.666510 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf686c5-a4f6-4e9e-84ec-b98c5339822e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:25.666789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf686c5-a4f6-4e9e-84ec-b98c5339822e admin admin] PATH_INFO: `/v3/projects/aa453b2676664cb1b1df9709dd347ae9` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:25.668786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf686c5-a4f6-4e9e-84ec-b98c5339822e admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa453b2676664cb1b1df9709dd347ae9)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:25.672874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf686c5-a4f6-4e9e-84ec-b98c5339822e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:25.800459 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-daf686c5-a4f6-4e9e-84ec-b98c5339822e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa453b2676664cb1b1df9709dd347ae9', 'request_id': 'req-daf686c5-a4f6-4e9e-84ec-b98c5339822e'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:25.888687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-daf686c5-a4f6-4e9e-84ec-b98c5339822e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa453b2676664cb1b1df9709dd347ae9', 'request_id': 'req-daf686c5-a4f6-4e9e-84ec-b98c5339822e'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:25.894180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-daf686c5-a4f6-4e9e-84ec-b98c5339822e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa453b2676664cb1b1df9709dd347ae9', 'request_id': 'req-daf686c5-a4f6-4e9e-84ec-b98c5339822e'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:25.907812 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-daf686c5-a4f6-4e9e-84ec-b98c5339822e admin admin] The token cache is being invalidate because project aa453b2676664cb1b1df9709dd347ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:25.908192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-daf686c5-a4f6-4e9e-84ec-b98c5339822e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:25.908975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-daf686c5-a4f6-4e9e-84ec-b98c5339822e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:25.911187 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1228/2447] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:25 2022] DELETE /identity/v3/projects/aa453b2676664cb1b1df9709dd347ae9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:25.916884 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c00ab6-3f79-4b15-b9da-9a0bf911020d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:25.917260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c00ab6-3f79-4b15-b9da-9a0bf911020d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:25.917634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c00ab6-3f79-4b15-b9da-9a0bf911020d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:25.938075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-46c00ab6-3f79-4b15-b9da-9a0bf911020d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:25.939269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-46c00ab6-3f79-4b15-b9da-9a0bf911020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:26.016411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1220/2448] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:26.018131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e501-5590-439b-adc3-c03f3dee94fb None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.018427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e501-5590-439b-adc3-c03f3dee94fb None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.018710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95e501-5590-439b-adc3-c03f3dee94fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.019230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25242b7b-9ea5-47f6-9d7c-197633e654be None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.020055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25242b7b-9ea5-47f6-9d7c-197633e654be None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.020055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25242b7b-9ea5-47f6-9d7c-197633e654be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.039756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-4f95e501-5590-439b-adc3-c03f3dee94fb None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:26.040998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4f95e501-5590-439b-adc3-c03f3dee94fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:26.048988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-25242b7b-9ea5-47f6-9d7c-197633e654be None None] MFA Rules not processed for user `14c717047e034b069cb80ff531b7d487`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:26.049623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1229/2449] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:26.050712 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-25242b7b-9ea5-47f6-9d7c-197633e654be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:26.053944 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95e501-5590-439b-adc3-c03f3dee94fb None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:26.068334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95e501-5590-439b-adc3-c03f3dee94fb None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:26.074261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee632f49-e1e8-418b-b449-f2fdafcf0de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:26.075132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee632f49-e1e8-418b-b449-f2fdafcf0de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.075429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee632f49-e1e8-418b-b449-f2fdafcf0de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.075709 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee632f49-e1e8-418b-b449-f2fdafcf0de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.076447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee632f49-e1e8-418b-b449-f2fdafcf0de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:18:26.076756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee632f49-e1e8-418b-b449-f2fdafcf0de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:26.078543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee632f49-e1e8-418b-b449-f2fdafcf0de3 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:26.083668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:26.092560 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1230/2450] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:18:26.096286 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee632f49-e1e8-418b-b449-f2fdafcf0de3 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:26.107195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee632f49-e1e8-418b-b449-f2fdafcf0de3 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:26.112174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0691a-0602-4461-85d0-a12f69299c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:26.112884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0691a-0602-4461-85d0-a12f69299c01 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.113171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0691a-0602-4461-85d0-a12f69299c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.113449 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0691a-0602-4461-85d0-a12f69299c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.114142 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0691a-0602-4461-85d0-a12f69299c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:26.116071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0691a-0602-4461-85d0-a12f69299c01 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:26.134902 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1221/2451] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:26.145781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034853e-d9ab-4fb2-9322-52dabe836849 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.146072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034853e-d9ab-4fb2-9322-52dabe836849 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.146356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034853e-d9ab-4fb2-9322-52dabe836849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.165404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e034853e-d9ab-4fb2-9322-52dabe836849 None None] MFA Rules not processed for user `5836583c9aed46e09297c0f32cbb7520`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:26.167409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e034853e-d9ab-4fb2-9322-52dabe836849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:26.195848 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:26.207053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1231/2452] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:26 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:18:26.211970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0691a-0602-4461-85d0-a12f69299c01 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:26.235143 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1222/2453] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:18:26.245161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034853e-d9ab-4fb2-9322-52dabe836849 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:26.246722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e034853e-d9ab-4fb2-9322-52dabe836849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:26.295890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0691a-0602-4461-85d0-a12f69299c01 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:26.302457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac058b-0cd3-4bac-8cbd-141e87b13910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:26.303131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac058b-0cd3-4bac-8cbd-141e87b13910 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.303415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac058b-0cd3-4bac-8cbd-141e87b13910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.303744 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aac058b-0cd3-4bac-8cbd-141e87b13910 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.304376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac058b-0cd3-4bac-8cbd-141e87b13910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:26.306541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aac058b-0cd3-4bac-8cbd-141e87b13910 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:26.323464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034853e-d9ab-4fb2-9322-52dabe836849 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:26.388970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab1c2-be14-4342-8523-a99a282fa2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:26.389547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab1c2-be14-4342-8523-a99a282fa2cd service nova] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.389832 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab1c2-be14-4342-8523-a99a282fa2cd service nova] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.390110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab1c2-be14-4342-8523-a99a282fa2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.391888 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fbcab1c2-be14-4342-8523-a99a282fa2cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:26.425518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1232/2454] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:26 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:26.429277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac058b-0cd3-4bac-8cbd-141e87b13910 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:26.439342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aac058b-0cd3-4bac-8cbd-141e87b13910 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:26.443989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3c98c-b7a7-4156-90b9-09929f9af87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:26.444634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3c98c-b7a7-4156-90b9-09929f9af87c admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.444950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3c98c-b7a7-4156-90b9-09929f9af87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.445224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3c98c-b7a7-4156-90b9-09929f9af87c admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.445951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3c98c-b7a7-4156-90b9-09929f9af87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:26.448254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3c98c-b7a7-4156-90b9-09929f9af87c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:26.449665 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcab1c2-be14-4342-8523-a99a282fa2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:26.451273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcab1c2-be14-4342-8523-a99a282fa2cd service nova] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:26.459946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1233/2455] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:18:26.460500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1223/2456] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:18:26.466503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3c98c-b7a7-4156-90b9-09929f9af87c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:26.476379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3c98c-b7a7-4156-90b9-09929f9af87c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:26.481905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fabf9-14ab-4829-8bae-6746d12877e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:26.482558 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fabf9-14ab-4829-8bae-6746d12877e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.482842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fabf9-14ab-4829-8bae-6746d12877e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.483116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fabf9-14ab-4829-8bae-6746d12877e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.483912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fabf9-14ab-4829-8bae-6746d12877e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:26.489967 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fabf9-14ab-4829-8bae-6746d12877e5 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:26.498683 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1234/2457] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:18:26.502945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab1c2-be14-4342-8523-a99a282fa2cd service nova] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:26.513706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab1c2-be14-4342-8523-a99a282fa2cd service nova] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:26.518528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79387d43-9861-457e-984a-18a11077758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:26.519434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79387d43-9861-457e-984a-18a11077758e admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.519750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79387d43-9861-457e-984a-18a11077758e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.520030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79387d43-9861-457e-984a-18a11077758e admin admin] PATH_INFO: `/v3/projects/8e6e41f4d7b0479b80a1d534b23434a0/users/fc122ab46aae40c89696492304e91260/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.535558 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79387d43-9861-457e-984a-18a11077758e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6e41f4d7b0479b80a1d534b23434a0, user_id=fc122ab46aae40c89696492304e91260, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:26.538265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79387d43-9861-457e-984a-18a11077758e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:26.652020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1224/2458] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:26 2022] PUT /identity/v3/projects/8e6e41f4d7b0479b80a1d534b23434a0/users/fc122ab46aae40c89696492304e91260/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:18:26.663165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74975d91-b2f0-4380-a1f5-66299c55642e None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.663699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74975d91-b2f0-4380-a1f5-66299c55642e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.663699 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74975d91-b2f0-4380-a1f5-66299c55642e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.691398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-74975d91-b2f0-4380-a1f5-66299c55642e None None] MFA Rules not processed for user `fc122ab46aae40c89696492304e91260`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:26.697132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-74975d91-b2f0-4380-a1f5-66299c55642e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:26.697262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79387d43-9861-457e-984a-18a11077758e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:26.697262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-79387d43-9861-457e-984a-18a11077758e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:26.755109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79387d43-9861-457e-984a-18a11077758e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:26.756812 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1235/2459] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:26.759655 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e503669-69b4-4a59-ad7c-f060a9588730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:26.760494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e503669-69b4-4a59-ad7c-f060a9588730 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.760785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e503669-69b4-4a59-ad7c-f060a9588730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.761353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e503669-69b4-4a59-ad7c-f060a9588730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.763212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4e503669-69b4-4a59-ad7c-f060a9588730 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:26.768295 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74975d91-b2f0-4380-a1f5-66299c55642e None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:26.769671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-74975d91-b2f0-4380-a1f5-66299c55642e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:26.773356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e503669-69b4-4a59-ad7c-f060a9588730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:26.774793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e503669-69b4-4a59-ad7c-f060a9588730 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:26.783635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1225/2460] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:18:26.845863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74975d91-b2f0-4380-a1f5-66299c55642e None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:26.851717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e1b59-4217-491e-8fce-3fe4c647bbc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:26.852362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1b59-4217-491e-8fce-3fe4c647bbc4 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:26.852647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1b59-4217-491e-8fce-3fe4c647bbc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:26.854801 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e1b59-4217-491e-8fce-3fe4c647bbc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:26.862165 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e1b59-4217-491e-8fce-3fe4c647bbc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:26.863781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e1b59-4217-491e-8fce-3fe4c647bbc4 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:26.876209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1236/2461] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:18:26.945368 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:27.001188 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:33.263017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e503669-69b4-4a59-ad7c-f060a9588730 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:33.326066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e503669-69b4-4a59-ad7c-f060a9588730 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:33.330598 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:33.331466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:33.331748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:33.332030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] PATH_INFO: `/v3/users/fc122ab46aae40c89696492304e91260` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:33.333242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc122ab46aae40c89696492304e91260)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:33.335163 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:33.357456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:33.581293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc122ab46aae40c89696492304e91260'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:33.594126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc122ab46aae40c89696492304e91260'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:33.674315 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc122ab46aae40c89696492304e91260'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:33.674939 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc122ab46aae40c89696492304e91260'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:33.675547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc122ab46aae40c89696492304e91260'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:33.689781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1226/2462] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:18:33 2022] DELETE /identity/v3/users/fc122ab46aae40c89696492304e91260 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:33.694584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51fb2d-16c9-4b97-ad67-798240328770 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:33.695063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51fb2d-16c9-4b97-ad67-798240328770 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:33.695301 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51fb2d-16c9-4b97-ad67-798240328770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:33.712604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-5b51fb2d-16c9-4b97-ad67-798240328770 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:33.714455 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5b51fb2d-16c9-4b97-ad67-798240328770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:33.774717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1237/2463] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:33.785137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:33.786547 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:33.845349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d96cc0-89a4-4e38-a931-015322e3616d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:33.848889 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867786d7-9ab3-4f81-abf2-4e3dc43f671c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:33.849538 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867786d7-9ab3-4f81-abf2-4e3dc43f671c service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:33.849826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867786d7-9ab3-4f81-abf2-4e3dc43f671c service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:33.850110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867786d7-9ab3-4f81-abf2-4e3dc43f671c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:33.859858 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867786d7-9ab3-4f81-abf2-4e3dc43f671c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:33.861347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867786d7-9ab3-4f81-abf2-4e3dc43f671c service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:33.871461 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1227/2464] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:34.575761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51fb2d-16c9-4b97-ad67-798240328770 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:34.578024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5b51fb2d-16c9-4b97-ad67-798240328770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:34.597356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51fb2d-16c9-4b97-ad67-798240328770 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:34.609617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44cf10-f714-450d-a8a4-269ea988f823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:34.610753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44cf10-f714-450d-a8a4-269ea988f823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:34.610753 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44cf10-f714-450d-a8a4-269ea988f823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:34.611044 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44cf10-f714-450d-a8a4-269ea988f823 admin admin] PATH_INFO: `/v3/projects/8e6e41f4d7b0479b80a1d534b23434a0` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:34.612261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44cf10-f714-450d-a8a4-269ea988f823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6e41f4d7b0479b80a1d534b23434a0)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:34.614236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44cf10-f714-450d-a8a4-269ea988f823 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:34.726764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-de44cf10-f714-450d-a8a4-269ea988f823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6e41f4d7b0479b80a1d534b23434a0', 'request_id': 'req-de44cf10-f714-450d-a8a4-269ea988f823'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:34.813255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-de44cf10-f714-450d-a8a4-269ea988f823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6e41f4d7b0479b80a1d534b23434a0', 'request_id': 'req-de44cf10-f714-450d-a8a4-269ea988f823'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:34.820052 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-de44cf10-f714-450d-a8a4-269ea988f823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6e41f4d7b0479b80a1d534b23434a0', 'request_id': 'req-de44cf10-f714-450d-a8a4-269ea988f823'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:34.831831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-de44cf10-f714-450d-a8a4-269ea988f823 admin admin] The token cache is being invalidate because project 8e6e41f4d7b0479b80a1d534b23434a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:34.832121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-de44cf10-f714-450d-a8a4-269ea988f823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:34.832785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-de44cf10-f714-450d-a8a4-269ea988f823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:34.834353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1238/2465] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:34 2022] DELETE /identity/v3/projects/8e6e41f4d7b0479b80a1d534b23434a0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:34.840483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106788f-3a20-4345-ab27-22fea4ab8f2b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:34.840983 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106788f-3a20-4345-ab27-22fea4ab8f2b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:34.841197 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106788f-3a20-4345-ab27-22fea4ab8f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:34.863449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2106788f-3a20-4345-ab27-22fea4ab8f2b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:34.863449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2106788f-3a20-4345-ab27-22fea4ab8f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:34.922657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1228/2466] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:34.930462 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81e270-b263-4ef6-8d72-98157bd96237 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:34.930754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81e270-b263-4ef6-8d72-98157bd96237 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:34.931039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81e270-b263-4ef6-8d72-98157bd96237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:34.949825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-4b81e270-b263-4ef6-8d72-98157bd96237 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:34.951010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4b81e270-b263-4ef6-8d72-98157bd96237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:34.958879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1239/2467] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:34.963060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106788f-3a20-4345-ab27-22fea4ab8f2b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:34.973462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106788f-3a20-4345-ab27-22fea4ab8f2b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:34.978264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3cf09-66e6-46f2-bee8-b6532bcae6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:34.978961 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3cf09-66e6-46f2-bee8-b6532bcae6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:34.979386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3cf09-66e6-46f2-bee8-b6532bcae6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:34.979855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3cf09-66e6-46f2-bee8-b6532bcae6b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:34.980617 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3cf09-66e6-46f2-bee8-b6532bcae6b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:18:34.980972 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3cf09-66e6-46f2-bee8-b6532bcae6b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:34.982578 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3cf09-66e6-46f2-bee8-b6532bcae6b0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:34.994120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1229/2468] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:18:34.998504 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81e270-b263-4ef6-8d72-98157bd96237 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:35.007751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b81e270-b263-4ef6-8d72-98157bd96237 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:35.013343 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0d714-1745-455c-9336-995d3a941d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:35.013996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0d714-1745-455c-9336-995d3a941d61 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:35.014279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0d714-1745-455c-9336-995d3a941d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:35.014555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0d714-1745-455c-9336-995d3a941d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:35.015243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0d714-1745-455c-9336-995d3a941d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:35.017202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0d714-1745-455c-9336-995d3a941d61 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:35.158578 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1240/2469] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:34 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:35.162742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3cf09-66e6-46f2-bee8-b6532bcae6b0 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:35.173540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3cf09-66e6-46f2-bee8-b6532bcae6b0 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:35.204131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:35.231587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d9fb5-6eaa-45a5-84cb-2e5d17b8826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:35.232279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d9fb5-6eaa-45a5-84cb-2e5d17b8826e admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:35.232564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d9fb5-6eaa-45a5-84cb-2e5d17b8826e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:35.232868 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d9fb5-6eaa-45a5-84cb-2e5d17b8826e admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:35.233571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d9fb5-6eaa-45a5-84cb-2e5d17b8826e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:35.235549 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d9fb5-6eaa-45a5-84cb-2e5d17b8826e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:35.314458 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1230/2470] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:35 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:35.315871 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0d714-1745-455c-9336-995d3a941d61 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:35.327340 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0d714-1745-455c-9336-995d3a941d61 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:35.332223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842262d-1a46-4d99-8a8d-912a96c99b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:35.332988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842262d-1a46-4d99-8a8d-912a96c99b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:35.333278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842262d-1a46-4d99-8a8d-912a96c99b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:35.333604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842262d-1a46-4d99-8a8d-912a96c99b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:35.334331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842262d-1a46-4d99-8a8d-912a96c99b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:35.335977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842262d-1a46-4d99-8a8d-912a96c99b4f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:35.347284 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1241/2471] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:35.351266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d9fb5-6eaa-45a5-84cb-2e5d17b8826e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:35.361330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d9fb5-6eaa-45a5-84cb-2e5d17b8826e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:35.365988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b0524-7260-465b-95f4-72fd1a6b7e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:35.366654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b0524-7260-465b-95f4-72fd1a6b7e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:35.366938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b0524-7260-465b-95f4-72fd1a6b7e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:35.367304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b0524-7260-465b-95f4-72fd1a6b7e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:35.368039 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b0524-7260-465b-95f4-72fd1a6b7e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:35.370316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b0524-7260-465b-95f4-72fd1a6b7e55 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:35.383616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1231/2472] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:35.384931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842262d-1a46-4d99-8a8d-912a96c99b4f admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:35.396234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842262d-1a46-4d99-8a8d-912a96c99b4f admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:35.401371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28937ad-bd25-4438-bd7f-6818e554b27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:35.402331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28937ad-bd25-4438-bd7f-6818e554b27b admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:35.402616 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28937ad-bd25-4438-bd7f-6818e554b27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:35.403158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28937ad-bd25-4438-bd7f-6818e554b27b admin admin] PATH_INFO: `/v3/projects/6eb7f5bda0984355ad7e186551ac24de/users/5d8c0ec25acb433abbbeee4b9f18f4c1/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:35.418606 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28937ad-bd25-4438-bd7f-6818e554b27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb7f5bda0984355ad7e186551ac24de, user_id=5d8c0ec25acb433abbbeee4b9f18f4c1, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:35.421305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28937ad-bd25-4438-bd7f-6818e554b27b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:35.477401 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:35.483429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1242/2473] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:35 2022] PUT /identity/v3/projects/6eb7f5bda0984355ad7e186551ac24de/users/5d8c0ec25acb433abbbeee4b9f18f4c1/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:35.493761 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6bb6e-c2e5-4c27-9465-fe29ed4eea82 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:35.494054 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6bb6e-c2e5-4c27-9465-fe29ed4eea82 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:35.494337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6bb6e-c2e5-4c27-9465-fe29ed4eea82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:35.520879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-2fe6bb6e-c2e5-4c27-9465-fe29ed4eea82 None None] MFA Rules not processed for user `5d8c0ec25acb433abbbeee4b9f18f4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:35.522100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2fe6bb6e-c2e5-4c27-9465-fe29ed4eea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:35.585010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1232/2474] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:35.595551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28937ad-bd25-4438-bd7f-6818e554b27b admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:35.597270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-a28937ad-bd25-4438-bd7f-6818e554b27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:35.653866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28937ad-bd25-4438-bd7f-6818e554b27b admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:35.657573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b237da2-b5b7-4622-87cb-f19e8fe1dd15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:35.658210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b237da2-b5b7-4622-87cb-f19e8fe1dd15 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:35.658496 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b237da2-b5b7-4622-87cb-f19e8fe1dd15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:35.658774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b237da2-b5b7-4622-87cb-f19e8fe1dd15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:35.667571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b237da2-b5b7-4622-87cb-f19e8fe1dd15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:35.669100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b237da2-b5b7-4622-87cb-f19e8fe1dd15 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:35.677823 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1243/2475] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:42.762508 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6bb6e-c2e5-4c27-9465-fe29ed4eea82 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:42.763981 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2fe6bb6e-c2e5-4c27-9465-fe29ed4eea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:42.776607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe6bb6e-c2e5-4c27-9465-fe29ed4eea82 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:42.780393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edfb92-8470-4887-9817-98edc562f102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:42.781061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edfb92-8470-4887-9817-98edc562f102 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:42.781340 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edfb92-8470-4887-9817-98edc562f102 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:42.781767 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59edfb92-8470-4887-9817-98edc562f102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:42.783494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-59edfb92-8470-4887-9817-98edc562f102 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:42.851436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edfb92-8470-4887-9817-98edc562f102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:42.852976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59edfb92-8470-4887-9817-98edc562f102 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:42.862852 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1233/2476] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:45.193954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b237da2-b5b7-4622-87cb-f19e8fe1dd15 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:45.195488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4b237da2-b5b7-4622-87cb-f19e8fe1dd15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:45.274527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b237da2-b5b7-4622-87cb-f19e8fe1dd15 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:45.280682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a2a35-c7f1-4797-ab01-f1bacaa58cc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '703c2c40fe434402817a8824c2756ee7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:45.281365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a2a35-c7f1-4797-ab01-f1bacaa58cc4 service nova] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:45.282485 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a2a35-c7f1-4797-ab01-f1bacaa58cc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:45.282793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a2a35-c7f1-4797-ab01-f1bacaa58cc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:45.284901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-336a2a35-c7f1-4797-ab01-f1bacaa58cc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:45.348738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a2a35-c7f1-4797-ab01-f1bacaa58cc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:45.350388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a2a35-c7f1-4797-ab01-f1bacaa58cc4 service nova] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:45.360144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1244/2477] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:45.723214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edfb92-8470-4887-9817-98edc562f102 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:45.724917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-59edfb92-8470-4887-9817-98edc562f102 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:45.761908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:45.785306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59edfb92-8470-4887-9817-98edc562f102 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:45.789611 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea12ae-3bd3-42b7-b394-70149000ea34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:45.790345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea12ae-3bd3-42b7-b394-70149000ea34 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:45.790634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea12ae-3bd3-42b7-b394-70149000ea34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:45.790916 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea12ae-3bd3-42b7-b394-70149000ea34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:45.793546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c7ea12ae-3bd3-42b7-b394-70149000ea34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:45.799858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a2a35-c7f1-4797-ab01-f1bacaa58cc4 service nova] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:45.852507 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:45.876265 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a2a35-c7f1-4797-ab01-f1bacaa58cc4 service nova] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:45.881736 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:45.882687 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:45.882970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:45.883246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] PATH_INFO: `/v3/users/5d8c0ec25acb433abbbeee4b9f18f4c1` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:45.884446 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d8c0ec25acb433abbbeee4b9f18f4c1)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:45.885052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea12ae-3bd3-42b7-b394-70149000ea34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:45.887913 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ea12ae-3bd3-42b7-b394-70149000ea34 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:45.888120 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:45.898237 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1234/2478] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:46.148205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d8c0ec25acb433abbbeee4b9f18f4c1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:46.164532 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d8c0ec25acb433abbbeee4b9f18f4c1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:46.259237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d8c0ec25acb433abbbeee4b9f18f4c1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:46.260294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d8c0ec25acb433abbbeee4b9f18f4c1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:46.261947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d8c0ec25acb433abbbeee4b9f18f4c1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:46.279839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1245/2479] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:18:45 2022] DELETE /identity/v3/users/5d8c0ec25acb433abbbeee4b9f18f4c1 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:18:46.281698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15172f2d-159b-4224-a2b1-59190b18780d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:46.282059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15172f2d-159b-4224-a2b1-59190b18780d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:46.282410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15172f2d-159b-4224-a2b1-59190b18780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:46.299629 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-15172f2d-159b-4224-a2b1-59190b18780d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:46.300900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-15172f2d-159b-4224-a2b1-59190b18780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:46.370397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1235/2480] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:46.387759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:46.389671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:46.456733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d6d14b-e5ab-4f36-93b3-9b4503b53d7d admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:46.460720 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60816dac-19f1-4b64-80e7-204588e37507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:46.461450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60816dac-19f1-4b64-80e7-204588e37507 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:46.461754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60816dac-19f1-4b64-80e7-204588e37507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:46.462031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60816dac-19f1-4b64-80e7-204588e37507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:46.472473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60816dac-19f1-4b64-80e7-204588e37507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:46.473958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60816dac-19f1-4b64-80e7-204588e37507 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:46.487191 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1246/2481] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:46.937031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15172f2d-159b-4224-a2b1-59190b18780d None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:46.939215 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-15172f2d-159b-4224-a2b1-59190b18780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:46.957858 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15172f2d-159b-4224-a2b1-59190b18780d None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:46.965343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:46.966865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:46.967891 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:46.969138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db admin admin] PATH_INFO: `/v3/projects/6eb7f5bda0984355ad7e186551ac24de` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:46.970869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb7f5bda0984355ad7e186551ac24de)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:46.974027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:47.133503 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb7f5bda0984355ad7e186551ac24de', 'request_id': 'req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:47.207534 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb7f5bda0984355ad7e186551ac24de', 'request_id': 'req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:47.215669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb7f5bda0984355ad7e186551ac24de', 'request_id': 'req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:47.228108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db admin admin] The token cache is being invalidate because project 6eb7f5bda0984355ad7e186551ac24de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:47.228623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:47.229739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-dd49ee5f-0afd-4adc-bf0c-fa195d6e27db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:47.231779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1236/2482] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:46 2022] DELETE /identity/v3/projects/6eb7f5bda0984355ad7e186551ac24de => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:47.236994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d87fd-6cff-4772-ac1b-9d030de910aa None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:47.237288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d87fd-6cff-4772-ac1b-9d030de910aa None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:47.237571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d87fd-6cff-4772-ac1b-9d030de910aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:47.257156 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-bb6d87fd-6cff-4772-ac1b-9d030de910aa None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:47.258379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-bb6d87fd-6cff-4772-ac1b-9d030de910aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:47.322484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1247/2483] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:47.332005 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e03e6-4555-41f6-a701-0463fd9d81d4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:47.332307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e03e6-4555-41f6-a701-0463fd9d81d4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:47.332591 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e03e6-4555-41f6-a701-0463fd9d81d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:47.345540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:47.352196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f86e03e6-4555-41f6-a701-0463fd9d81d4 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:47.353446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f86e03e6-4555-41f6-a701-0463fd9d81d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:47.362551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1237/2484] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:47.366939 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d87fd-6cff-4772-ac1b-9d030de910aa None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:47.372538 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:47.378198 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d87fd-6cff-4772-ac1b-9d030de910aa None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:47.383147 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36596a3-5fa9-4985-8278-3295c2bcc2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:47.383716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36596a3-5fa9-4985-8278-3295c2bcc2ab admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:47.383996 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36596a3-5fa9-4985-8278-3295c2bcc2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:47.384274 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36596a3-5fa9-4985-8278-3295c2bcc2ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:47.385023 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36596a3-5fa9-4985-8278-3295c2bcc2ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:18:47.385331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36596a3-5fa9-4985-8278-3295c2bcc2ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:47.388258 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36596a3-5fa9-4985-8278-3295c2bcc2ab admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:47.402038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1248/2485] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:18:47.406791 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e03e6-4555-41f6-a701-0463fd9d81d4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:47.416209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e03e6-4555-41f6-a701-0463fd9d81d4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:47.421768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032d88c-47f9-47c6-a2f7-0fb1aa6d0592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:47.422435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032d88c-47f9-47c6-a2f7-0fb1aa6d0592 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:47.422740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032d88c-47f9-47c6-a2f7-0fb1aa6d0592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:47.429737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032d88c-47f9-47c6-a2f7-0fb1aa6d0592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:47.429737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032d88c-47f9-47c6-a2f7-0fb1aa6d0592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:47.429737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032d88c-47f9-47c6-a2f7-0fb1aa6d0592 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:47.506964 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1238/2486] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:47 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:18:47.511272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36596a3-5fa9-4985-8278-3295c2bcc2ab admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:47.531041 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36596a3-5fa9-4985-8278-3295c2bcc2ab admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:47.596639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e91304-0f9c-4137-a502-96e600586254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:47.597372 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e91304-0f9c-4137-a502-96e600586254 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:47.597777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e91304-0f9c-4137-a502-96e600586254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:47.598078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e91304-0f9c-4137-a502-96e600586254 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:47.598799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e91304-0f9c-4137-a502-96e600586254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:47.601087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e91304-0f9c-4137-a502-96e600586254 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:47.723118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1249/2487] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:47 2022] POST /identity/v3/users => generated 286 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:47.727218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032d88c-47f9-47c6-a2f7-0fb1aa6d0592 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:47.740728 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032d88c-47f9-47c6-a2f7-0fb1aa6d0592 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:47.746759 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b8b70-02e4-4c6f-a86a-8648ec0f4187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:47.747710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b8b70-02e4-4c6f-a86a-8648ec0f4187 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:47.748156 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b8b70-02e4-4c6f-a86a-8648ec0f4187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:47.748621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b8b70-02e4-4c6f-a86a-8648ec0f4187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:47.749437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b8b70-02e4-4c6f-a86a-8648ec0f4187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:47.751313 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1b8b70-02e4-4c6f-a86a-8648ec0f4187 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:47.765208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1239/2488] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:47.769402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e91304-0f9c-4137-a502-96e600586254 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:47.781770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e91304-0f9c-4137-a502-96e600586254 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:47.787437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065776b-4ca9-482b-82c0-d1ea66b40070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:47.787956 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065776b-4ca9-482b-82c0-d1ea66b40070 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:47.788243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065776b-4ca9-482b-82c0-d1ea66b40070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:47.788521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065776b-4ca9-482b-82c0-d1ea66b40070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:47.789652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065776b-4ca9-482b-82c0-d1ea66b40070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:47.790989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065776b-4ca9-482b-82c0-d1ea66b40070 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:47.806544 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1250/2489] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:47.808125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b8b70-02e4-4c6f-a86a-8648ec0f4187 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:47.819900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b8b70-02e4-4c6f-a86a-8648ec0f4187 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:47.826549 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540a113-56ee-4d15-bc66-0388d42933ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:47.827473 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540a113-56ee-4d15-bc66-0388d42933ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:47.827836 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540a113-56ee-4d15-bc66-0388d42933ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:47.828183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540a113-56ee-4d15-bc66-0388d42933ce admin admin] PATH_INFO: `/v3/projects/93900e3b95894800a887d9efadda2dcf/users/8ce2a0e9fb234051a5fbe8916a4fa356/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:47.854692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540a113-56ee-4d15-bc66-0388d42933ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=93900e3b95894800a887d9efadda2dcf, user_id=8ce2a0e9fb234051a5fbe8916a4fa356, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:47.854692 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c540a113-56ee-4d15-bc66-0388d42933ce admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:47.958150 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1240/2490] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:47 2022] PUT /identity/v3/projects/93900e3b95894800a887d9efadda2dcf/users/8ce2a0e9fb234051a5fbe8916a4fa356/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:47.969304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a4616-c31b-46b5-9bec-96d24546e47b None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:47.970016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a4616-c31b-46b5-9bec-96d24546e47b None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:47.970308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a4616-c31b-46b5-9bec-96d24546e47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:48.033923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-c18a4616-c31b-46b5-9bec-96d24546e47b None None] MFA Rules not processed for user `8ce2a0e9fb234051a5fbe8916a4fa356`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:48.035314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c18a4616-c31b-46b5-9bec-96d24546e47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:48.131539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1251/2491] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:48.144688 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540a113-56ee-4d15-bc66-0388d42933ce admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:48.146619 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c540a113-56ee-4d15-bc66-0388d42933ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:48.228744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c540a113-56ee-4d15-bc66-0388d42933ce admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:48.232597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6a0f6-bf74-4401-b51e-f017477176ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6832291d504cff9e787c0d791c70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:48.233314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6a0f6-bf74-4401-b51e-f017477176ab service glance] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:48.233604 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6a0f6-bf74-4401-b51e-f017477176ab service glance] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:48.233888 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6a0f6-bf74-4401-b51e-f017477176ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:48.242998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6a0f6-bf74-4401-b51e-f017477176ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:48.244534 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6a0f6-bf74-4401-b51e-f017477176ab service glance] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:48.253807 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1241/2492] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:49.860160 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a4616-c31b-46b5-9bec-96d24546e47b None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:49.861701 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c18a4616-c31b-46b5-9bec-96d24546e47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:49.938583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:49.943244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a4616-c31b-46b5-9bec-96d24546e47b None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:49.949497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede4453-ceef-4f6b-9c9a-361c0619b20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:49.950251 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4453-ceef-4f6b-9c9a-361c0619b20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:49.950537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4453-ceef-4f6b-9c9a-361c0619b20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:49.950825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede4453-ceef-4f6b-9c9a-361c0619b20c admin admin] PATH_INFO: `/v3/users/f7d95bfecf5d4d82b51094e0bf9fbedf` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:49.952038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede4453-ceef-4f6b-9c9a-361c0619b20c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d95bfecf5d4d82b51094e0bf9fbedf)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:49.954043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede4453-ceef-4f6b-9c9a-361c0619b20c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:50.171740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1ede4453-ceef-4f6b-9c9a-361c0619b20c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d95bfecf5d4d82b51094e0bf9fbedf'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:50.189491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1ede4453-ceef-4f6b-9c9a-361c0619b20c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d95bfecf5d4d82b51094e0bf9fbedf'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:50.297670 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1ede4453-ceef-4f6b-9c9a-361c0619b20c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d95bfecf5d4d82b51094e0bf9fbedf'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:50.298541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1ede4453-ceef-4f6b-9c9a-361c0619b20c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d95bfecf5d4d82b51094e0bf9fbedf'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:50.299218 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1ede4453-ceef-4f6b-9c9a-361c0619b20c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d95bfecf5d4d82b51094e0bf9fbedf'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:50.320443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1252/2493] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:18:49 2022] DELETE /identity/v3/users/f7d95bfecf5d4d82b51094e0bf9fbedf => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:50.615702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6a0f6-bf74-4401-b51e-f017477176ab service glance] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:50.629811 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6a0f6-bf74-4401-b51e-f017477176ab service glance] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:50.692742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d4342-71e9-4f16-9f6e-fbeb610eb117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:50.693651 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d4342-71e9-4f16-9f6e-fbeb610eb117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:50.693935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d4342-71e9-4f16-9f6e-fbeb610eb117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:50.694213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d4342-71e9-4f16-9f6e-fbeb610eb117 admin admin] PATH_INFO: `/v3/projects/e388fe87f8c04d45a8442115c3ff6393` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:50.695415 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d4342-71e9-4f16-9f6e-fbeb610eb117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e388fe87f8c04d45a8442115c3ff6393)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:50.697499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d4342-71e9-4f16-9f6e-fbeb610eb117 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:50.810290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:50.815793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-225d4342-71e9-4f16-9f6e-fbeb610eb117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e388fe87f8c04d45a8442115c3ff6393', 'request_id': 'req-225d4342-71e9-4f16-9f6e-fbeb610eb117'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:50.920932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-225d4342-71e9-4f16-9f6e-fbeb610eb117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e388fe87f8c04d45a8442115c3ff6393', 'request_id': 'req-225d4342-71e9-4f16-9f6e-fbeb610eb117'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:50.928574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-225d4342-71e9-4f16-9f6e-fbeb610eb117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e388fe87f8c04d45a8442115c3ff6393', 'request_id': 'req-225d4342-71e9-4f16-9f6e-fbeb610eb117'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:50.942910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-225d4342-71e9-4f16-9f6e-fbeb610eb117 admin admin] The token cache is being invalidate because project e388fe87f8c04d45a8442115c3ff6393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:18:50.943199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-225d4342-71e9-4f16-9f6e-fbeb610eb117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:50.943889 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-225d4342-71e9-4f16-9f6e-fbeb610eb117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:18:50.945502 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1242/2494] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:18:50 2022] DELETE /identity/v3/projects/e388fe87f8c04d45a8442115c3ff6393 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:50.950568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76009f4a-6de3-4b6c-9b6c-2f89088b8c9c None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:50.951070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76009f4a-6de3-4b6c-9b6c-2f89088b8c9c None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:50.951173 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76009f4a-6de3-4b6c-9b6c-2f89088b8c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:50.969870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-76009f4a-6de3-4b6c-9b6c-2f89088b8c9c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:50.971080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-76009f4a-6de3-4b6c-9b6c-2f89088b8c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:51.034826 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1253/2495] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:51.043220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc8edf-14fb-4c1a-b375-f666d8aa8701 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:51.043502 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc8edf-14fb-4c1a-b375-f666d8aa8701 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:51.043782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc8edf-14fb-4c1a-b375-f666d8aa8701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:51.062404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-59dc8edf-14fb-4c1a-b375-f666d8aa8701 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:51.063629 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-59dc8edf-14fb-4c1a-b375-f666d8aa8701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:51.071705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1243/2496] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:51.076413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76009f4a-6de3-4b6c-9b6c-2f89088b8c9c None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:51.086662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76009f4a-6de3-4b6c-9b6c-2f89088b8c9c None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:51.092712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e165d5-1752-4587-87a5-65d2c9c94614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:51.093394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e165d5-1752-4587-87a5-65d2c9c94614 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:51.093675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e165d5-1752-4587-87a5-65d2c9c94614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:51.093949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e165d5-1752-4587-87a5-65d2c9c94614 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:51.094705 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e165d5-1752-4587-87a5-65d2c9c94614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:18:51.095026 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e165d5-1752-4587-87a5-65d2c9c94614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:51.096827 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e165d5-1752-4587-87a5-65d2c9c94614 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:51.109976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1254/2497] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:18:51.114333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc8edf-14fb-4c1a-b375-f666d8aa8701 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:51.124009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc8edf-14fb-4c1a-b375-f666d8aa8701 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:51.128710 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc114d3-8d39-4537-8381-5a1c3ea10e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:51.129537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc114d3-8d39-4537-8381-5a1c3ea10e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:51.129824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc114d3-8d39-4537-8381-5a1c3ea10e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:51.130104 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc114d3-8d39-4537-8381-5a1c3ea10e06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:51.130808 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc114d3-8d39-4537-8381-5a1c3ea10e06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:51.132703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc114d3-8d39-4537-8381-5a1c3ea10e06 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:51.223110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1244/2498] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:51 2022] POST /identity/v3/projects => generated 355 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:51.227033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e165d5-1752-4587-87a5-65d2c9c94614 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:51.238633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e165d5-1752-4587-87a5-65d2c9c94614 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:51.310716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fff97c-0688-49d2-bda0-68a5f6383572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:51.311469 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fff97c-0688-49d2-bda0-68a5f6383572 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:51.311808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fff97c-0688-49d2-bda0-68a5f6383572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:51.312026 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fff97c-0688-49d2-bda0-68a5f6383572 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:51.312726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fff97c-0688-49d2-bda0-68a5f6383572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:51.314927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fff97c-0688-49d2-bda0-68a5f6383572 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:51.325584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:51.413912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1255/2499] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:51 2022] POST /identity/v3/users => generated 278 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:51.418504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc114d3-8d39-4537-8381-5a1c3ea10e06 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:51.428915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc114d3-8d39-4537-8381-5a1c3ea10e06 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:51.434785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ef69e-71bd-467d-9f2d-33288593f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:51.435522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ef69e-71bd-467d-9f2d-33288593f5bc admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:51.435816 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ef69e-71bd-467d-9f2d-33288593f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:51.436099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ef69e-71bd-467d-9f2d-33288593f5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:51.436938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ef69e-71bd-467d-9f2d-33288593f5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:51.438567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ef69e-71bd-467d-9f2d-33288593f5bc admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:51.450078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1245/2500] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:51.454231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fff97c-0688-49d2-bda0-68a5f6383572 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:51.465562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fff97c-0688-49d2-bda0-68a5f6383572 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:51.470394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd09ac-90e6-4c8c-b3e4-1560789399c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:51.471084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd09ac-90e6-4c8c-b3e4-1560789399c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:51.471368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd09ac-90e6-4c8c-b3e4-1560789399c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:51.471646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd09ac-90e6-4c8c-b3e4-1560789399c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:51.472378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd09ac-90e6-4c8c-b3e4-1560789399c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:51.474084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd09ac-90e6-4c8c-b3e4-1560789399c2 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:51.489597 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1256/2501] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:51.490963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ef69e-71bd-467d-9f2d-33288593f5bc admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:51.502001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ef69e-71bd-467d-9f2d-33288593f5bc admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:51.507410 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ec51e-bfe5-4b70-a913-a8fe78697b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:51.508325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ec51e-bfe5-4b70-a913-a8fe78697b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:51.508612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ec51e-bfe5-4b70-a913-a8fe78697b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:51.508934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ec51e-bfe5-4b70-a913-a8fe78697b18 admin admin] PATH_INFO: `/v3/projects/4c47dacbdad049cc816612decf12d5e3/users/abe34062ae5d4df3bc85c817e97333cc/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:51.527704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ec51e-bfe5-4b70-a913-a8fe78697b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c47dacbdad049cc816612decf12d5e3, user_id=abe34062ae5d4df3bc85c817e97333cc, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:51.530823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ec51e-bfe5-4b70-a913-a8fe78697b18 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:51.615594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1246/2502] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:51 2022] PUT /identity/v3/projects/4c47dacbdad049cc816612decf12d5e3/users/abe34062ae5d4df3bc85c817e97333cc/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:51.626514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a395-2f8e-41d6-95e9-1c5c1a777ea8 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:51.626907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a395-2f8e-41d6-95e9-1c5c1a777ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:51.628681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a395-2f8e-41d6-95e9-1c5c1a777ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:51.656924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ae46a395-2f8e-41d6-95e9-1c5c1a777ea8 None None] MFA Rules not processed for user `abe34062ae5d4df3bc85c817e97333cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:51.658331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ae46a395-2f8e-41d6-95e9-1c5c1a777ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:51.725424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1257/2503] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:51 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:51.731199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ec51e-bfe5-4b70-a913-a8fe78697b18 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:51.798010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ec51e-bfe5-4b70-a913-a8fe78697b18 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:51.803000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7ec54-467e-495e-81da-10151ef2da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:51.803794 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7ec54-467e-495e-81da-10151ef2da45 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:51.804192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7ec54-467e-495e-81da-10151ef2da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:51.804477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7ec54-467e-495e-81da-10151ef2da45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:51.805218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7ec54-467e-495e-81da-10151ef2da45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:51.807127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7ec54-467e-495e-81da-10151ef2da45 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:51.920779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1247/2504] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:18:51 2022] POST /identity/v3/projects => generated 357 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:18:51.924561 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46a395-2f8e-41d6-95e9-1c5c1a777ea8 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:51.945346 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46a395-2f8e-41d6-95e9-1c5c1a777ea8 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:52.028531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35542b9e-cd02-4fdb-bc6e-bce5f39bf7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:52.029257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35542b9e-cd02-4fdb-bc6e-bce5f39bf7bb admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:52.029538 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35542b9e-cd02-4fdb-bc6e-bce5f39bf7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:52.029824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35542b9e-cd02-4fdb-bc6e-bce5f39bf7bb admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:52.030528 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35542b9e-cd02-4fdb-bc6e-bce5f39bf7bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:52.032487 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35542b9e-cd02-4fdb-bc6e-bce5f39bf7bb admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:52.274480 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1258/2505] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:18:51 2022] POST /identity/v3/users => generated 285 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:18:52.280111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7ec54-467e-495e-81da-10151ef2da45 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:52.290556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7ec54-467e-495e-81da-10151ef2da45 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:52.295400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f4384-90e2-43b6-ae6d-fc96cecfd723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:52.296072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f4384-90e2-43b6-ae6d-fc96cecfd723 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:52.296383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f4384-90e2-43b6-ae6d-fc96cecfd723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:52.296659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f4384-90e2-43b6-ae6d-fc96cecfd723 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:52.297411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f4384-90e2-43b6-ae6d-fc96cecfd723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:52.299265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f4384-90e2-43b6-ae6d-fc96cecfd723 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:52.310571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1248/2506] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:18:52.317389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35542b9e-cd02-4fdb-bc6e-bce5f39bf7bb admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:52.329020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35542b9e-cd02-4fdb-bc6e-bce5f39bf7bb admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:52.333994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08285ab8-0374-4854-acd1-5a84e6035fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:52.334893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08285ab8-0374-4854-acd1-5a84e6035fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:52.335197 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08285ab8-0374-4854-acd1-5a84e6035fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:52.335694 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08285ab8-0374-4854-acd1-5a84e6035fdb admin admin] PATH_INFO: `/v3/projects/cb62c1b6f64c4b6d98d2f50517e8fa45/users/b38b13b7f75b4af09172cc0cdbe30ec8/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:52.352180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08285ab8-0374-4854-acd1-5a84e6035fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb62c1b6f64c4b6d98d2f50517e8fa45, user_id=b38b13b7f75b4af09172cc0cdbe30ec8, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:52.356163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08285ab8-0374-4854-acd1-5a84e6035fdb admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:52.454178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1259/2507] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:52 2022] PUT /identity/v3/projects/cb62c1b6f64c4b6d98d2f50517e8fa45/users/b38b13b7f75b4af09172cc0cdbe30ec8/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:52.460513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f4384-90e2-43b6-ae6d-fc96cecfd723 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:52.473129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f4384-90e2-43b6-ae6d-fc96cecfd723 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:52.522228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:52.535250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8409573-0ce9-47ff-be23-b2a74fe120c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:52.536566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8409573-0ce9-47ff-be23-b2a74fe120c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:52.536566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8409573-0ce9-47ff-be23-b2a74fe120c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:52.536566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8409573-0ce9-47ff-be23-b2a74fe120c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:52.537285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8409573-0ce9-47ff-be23-b2a74fe120c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:52.538962 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8409573-0ce9-47ff-be23-b2a74fe120c6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:52.552289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1249/2508] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:18:52.553679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08285ab8-0374-4854-acd1-5a84e6035fdb admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:52.565441 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08285ab8-0374-4854-acd1-5a84e6035fdb admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:52.571831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398a7c6-049a-49e5-87fc-d6398ef41076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:52.572854 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398a7c6-049a-49e5-87fc-d6398ef41076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:52.573128 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398a7c6-049a-49e5-87fc-d6398ef41076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:52.575386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398a7c6-049a-49e5-87fc-d6398ef41076 admin admin] PATH_INFO: `/v3/projects/cb62c1b6f64c4b6d98d2f50517e8fa45/users/b38b13b7f75b4af09172cc0cdbe30ec8/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:52.576355 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398a7c6-049a-49e5-87fc-d6398ef41076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb62c1b6f64c4b6d98d2f50517e8fa45, user_id=b38b13b7f75b4af09172cc0cdbe30ec8, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:52.579415 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398a7c6-049a-49e5-87fc-d6398ef41076 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:52.602027 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1260/2509] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:18:52 2022] PUT /identity/v3/projects/cb62c1b6f64c4b6d98d2f50517e8fa45/users/b38b13b7f75b4af09172cc0cdbe30ec8/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:18:52.603764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3a36e-1187-4515-ab74-1c9cd9906d46 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:52.604063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3a36e-1187-4515-ab74-1c9cd9906d46 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:52.604346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3a36e-1187-4515-ab74-1c9cd9906d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:52.636904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-3be3a36e-1187-4515-ab74-1c9cd9906d46 None None] MFA Rules not processed for user `b38b13b7f75b4af09172cc0cdbe30ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:18:52.638188 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3be3a36e-1187-4515-ab74-1c9cd9906d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:52.712890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1250/2510] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:18:52 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:18:52.725643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398a7c6-049a-49e5-87fc-d6398ef41076 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:52.729317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-3398a7c6-049a-49e5-87fc-d6398ef41076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:18:52.757617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:18:52.788368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398a7c6-049a-49e5-87fc-d6398ef41076 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:52.792031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d216a66-2ebd-4a5b-ad11-01b638265659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:52.793288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d216a66-2ebd-4a5b-ad11-01b638265659 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:52.793568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d216a66-2ebd-4a5b-ad11-01b638265659 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:52.793845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d216a66-2ebd-4a5b-ad11-01b638265659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:52.803151 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d216a66-2ebd-4a5b-ad11-01b638265659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:52.804600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d216a66-2ebd-4a5b-ad11-01b638265659 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:52.815271 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1261/2511] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:52 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:18:53.100699 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3a36e-1187-4515-ab74-1c9cd9906d46 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:18:53.111846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3a36e-1187-4515-ab74-1c9cd9906d46 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:18:53.116002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7597b60-feb7-40f5-a6ec-7aa70fdc34a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:18:53.116703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7597b60-feb7-40f5-a6ec-7aa70fdc34a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:18:53.117012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7597b60-feb7-40f5-a6ec-7aa70fdc34a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:18:53.117290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7597b60-feb7-40f5-a6ec-7aa70fdc34a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:18:53.181437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7597b60-feb7-40f5-a6ec-7aa70fdc34a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:18:53.183401 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7597b60-feb7-40f5-a6ec-7aa70fdc34a3 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:18:53.196399 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1251/2512] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:18:53 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:02.319288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d216a66-2ebd-4a5b-ad11-01b638265659 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:02.320791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7d216a66-2ebd-4a5b-ad11-01b638265659 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:02.384582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d216a66-2ebd-4a5b-ad11-01b638265659 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:02.388270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102a28a-b1de-431a-8256-a0aba1eac62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:02.388953 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102a28a-b1de-431a-8256-a0aba1eac62f service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:02.389241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102a28a-b1de-431a-8256-a0aba1eac62f service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:02.389518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102a28a-b1de-431a-8256-a0aba1eac62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:02.391288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4102a28a-b1de-431a-8256-a0aba1eac62f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:02.455578 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102a28a-b1de-431a-8256-a0aba1eac62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:02.457731 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102a28a-b1de-431a-8256-a0aba1eac62f service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:02.469155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1262/2513] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:03.191915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=70 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:06.722435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7597b60-feb7-40f5-a6ec-7aa70fdc34a3 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:06.724744 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d7597b60-feb7-40f5-a6ec-7aa70fdc34a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:06.740378 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7597b60-feb7-40f5-a6ec-7aa70fdc34a3 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:06.745289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f2d62-6302-4666-9e34-45bde7256a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:06.746188 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f2d62-6302-4666-9e34-45bde7256a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:06.746471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f2d62-6302-4666-9e34-45bde7256a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:06.746749 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f2d62-6302-4666-9e34-45bde7256a1a admin admin] PATH_INFO: `/v3/users/0ac9553e75a9408c80c0777f37c2b815` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:06.747934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f2d62-6302-4666-9e34-45bde7256a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ac9553e75a9408c80c0777f37c2b815)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:06.751052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f2d62-6302-4666-9e34-45bde7256a1a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:06.971267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a21f2d62-6302-4666-9e34-45bde7256a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ac9553e75a9408c80c0777f37c2b815'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:06.985967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a21f2d62-6302-4666-9e34-45bde7256a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ac9553e75a9408c80c0777f37c2b815'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:07.095028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a21f2d62-6302-4666-9e34-45bde7256a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ac9553e75a9408c80c0777f37c2b815'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:07.095916 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a21f2d62-6302-4666-9e34-45bde7256a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ac9553e75a9408c80c0777f37c2b815'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:07.096675 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a21f2d62-6302-4666-9e34-45bde7256a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ac9553e75a9408c80c0777f37c2b815'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:07.112246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1252/2514] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:06 2022] DELETE /identity/v3/users/0ac9553e75a9408c80c0777f37c2b815 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:07.396899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102a28a-b1de-431a-8256-a0aba1eac62f service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:07.415792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102a28a-b1de-431a-8256-a0aba1eac62f service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:07.479520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:07.480484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:07.480765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:07.481071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e admin admin] PATH_INFO: `/v3/projects/0dc9ccb280644ba1b17274a76677a98b` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:07.482259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc9ccb280644ba1b17274a76677a98b)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:07.485533 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:07.510600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:07.607412 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc9ccb280644ba1b17274a76677a98b', 'request_id': 'req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:07.696917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc9ccb280644ba1b17274a76677a98b', 'request_id': 'req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:07.705911 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc9ccb280644ba1b17274a76677a98b', 'request_id': 'req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:07.719681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e admin admin] The token cache is being invalidate because project 0dc9ccb280644ba1b17274a76677a98b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:07.720149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:07.720910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a9abeeee-71af-4847-a0f8-d3e6b5609b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:07.722527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1263/2515] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:07 2022] DELETE /identity/v3/projects/0dc9ccb280644ba1b17274a76677a98b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:07.731635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58d90b-e544-4285-871d-771e6ef8af93 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:07.732341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58d90b-e544-4285-871d-771e6ef8af93 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:07.732711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58d90b-e544-4285-871d-771e6ef8af93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:07.753032 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-5b58d90b-e544-4285-871d-771e6ef8af93 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:07.754385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5b58d90b-e544-4285-871d-771e6ef8af93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:07.820642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1253/2516] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:07.828958 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db474c-369f-418c-b7e4-d55d85caeac6 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:07.829648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db474c-369f-418c-b7e4-d55d85caeac6 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:07.829955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db474c-369f-418c-b7e4-d55d85caeac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:07.851866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-83db474c-369f-418c-b7e4-d55d85caeac6 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:07.853341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-83db474c-369f-418c-b7e4-d55d85caeac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:07.863032 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1264/2517] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:07.867346 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58d90b-e544-4285-871d-771e6ef8af93 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:07.877545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58d90b-e544-4285-871d-771e6ef8af93 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:07.882492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcddaee-43e1-4fa2-8441-9bb477334b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:07.883340 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcddaee-43e1-4fa2-8441-9bb477334b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:07.883634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcddaee-43e1-4fa2-8441-9bb477334b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:07.883912 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcddaee-43e1-4fa2-8441-9bb477334b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:07.884707 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcddaee-43e1-4fa2-8441-9bb477334b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:07.885052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcddaee-43e1-4fa2-8441-9bb477334b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:07.886669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcddaee-43e1-4fa2-8441-9bb477334b43 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:07.901384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1254/2518] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:19:07.912086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db474c-369f-418c-b7e4-d55d85caeac6 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:07.921898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db474c-369f-418c-b7e4-d55d85caeac6 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:07.929050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbea5d-755d-400f-acc8-1cf6729eebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:07.929676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbea5d-755d-400f-acc8-1cf6729eebac admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:07.929960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbea5d-755d-400f-acc8-1cf6729eebac admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:07.930234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fbea5d-755d-400f-acc8-1cf6729eebac admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:07.930965 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbea5d-755d-400f-acc8-1cf6729eebac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:07.932934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fbea5d-755d-400f-acc8-1cf6729eebac admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:07.974384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcddaee-43e1-4fa2-8441-9bb477334b43 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:07.976422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2bcddaee-43e1-4fa2-8441-9bb477334b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:08.035665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1265/2519] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:07 2022] POST /identity/v3/projects => generated 403 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:08.036976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbea5d-755d-400f-acc8-1cf6729eebac admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:08.043770 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:08.049370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcddaee-43e1-4fa2-8441-9bb477334b43 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:08.114356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fbea5d-755d-400f-acc8-1cf6729eebac admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:08.121799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0b49b-4583-4c6d-acf8-2cf20ca4f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:08.122638 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0b49b-4583-4c6d-acf8-2cf20ca4f49d admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:08.122933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0b49b-4583-4c6d-acf8-2cf20ca4f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:08.123673 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0b49b-4583-4c6d-acf8-2cf20ca4f49d admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:08.125013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0b49b-4583-4c6d-acf8-2cf20ca4f49d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:08.127066 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0b49b-4583-4c6d-acf8-2cf20ca4f49d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:08.131918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30bbe-6432-46a9-a821-a5f9c03c05fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b5745bfb5d4e6ca172bb8fab229e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:08.132676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30bbe-6432-46a9-a821-a5f9c03c05fe service placement] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:08.133141 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30bbe-6432-46a9-a821-a5f9c03c05fe service placement] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:08.133430 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30bbe-6432-46a9-a821-a5f9c03c05fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:08.135743 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-11f30bbe-6432-46a9-a821-a5f9c03c05fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:08.149129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f30bbe-6432-46a9-a821-a5f9c03c05fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:08.149946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f30bbe-6432-46a9-a821-a5f9c03c05fe service placement] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:08.160562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1255/2520] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:08.225552 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1266/2521] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:08 2022] POST /identity/v3/users => generated 302 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:08.227133 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30bbe-6432-46a9-a821-a5f9c03c05fe service placement] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:08.241326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30bbe-6432-46a9-a821-a5f9c03c05fe service placement] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:08.247322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e433-2975-4516-b616-68931bb1038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:08.248078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e433-2975-4516-b616-68931bb1038b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:08.248615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e433-2975-4516-b616-68931bb1038b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:08.249468 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79e433-2975-4516-b616-68931bb1038b admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:08.251038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79e433-2975-4516-b616-68931bb1038b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:08.252882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e79e433-2975-4516-b616-68931bb1038b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:08.280908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1256/2522] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:08.281616 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0b49b-4583-4c6d-acf8-2cf20ca4f49d admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:08.288077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0b49b-4583-4c6d-acf8-2cf20ca4f49d admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:08.293923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c1d46e-2c6e-46a5-96af-c125f80ffb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:08.294741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1d46e-2c6e-46a5-96af-c125f80ffb51 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:08.295129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1d46e-2c6e-46a5-96af-c125f80ffb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:08.295519 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c1d46e-2c6e-46a5-96af-c125f80ffb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:08.296459 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1d46e-2c6e-46a5-96af-c125f80ffb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:08.298224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c1d46e-2c6e-46a5-96af-c125f80ffb51 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:08.313198 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1267/2523] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:08.317419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e433-2975-4516-b616-68931bb1038b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:08.329045 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79e433-2975-4516-b616-68931bb1038b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:08.333888 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44950-d28a-498b-bf5f-3f241539c273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:08.334771 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44950-d28a-498b-bf5f-3f241539c273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:08.335160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44950-d28a-498b-bf5f-3f241539c273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:08.335439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44950-d28a-498b-bf5f-3f241539c273 admin admin] PATH_INFO: `/v3/projects/d47acb18afac43a88fe588f1afbeb668/users/c7c32e7576ab48738b182806bf6cd25e/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:08.351227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d44950-d28a-498b-bf5f-3f241539c273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d47acb18afac43a88fe588f1afbeb668, user_id=c7c32e7576ab48738b182806bf6cd25e, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:08.354002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d44950-d28a-498b-bf5f-3f241539c273 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:08.462116 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1257/2524] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:08 2022] PUT /identity/v3/projects/d47acb18afac43a88fe588f1afbeb668/users/c7c32e7576ab48738b182806bf6cd25e/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:08.473392 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76e1af-899f-4c70-88b9-3e15daac2fee None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:08.474471 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76e1af-899f-4c70-88b9-3e15daac2fee None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:08.475104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76e1af-899f-4c70-88b9-3e15daac2fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:08.506874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-1f76e1af-899f-4c70-88b9-3e15daac2fee None None] MFA Rules not processed for user `c7c32e7576ab48738b182806bf6cd25e`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:08.508195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1f76e1af-899f-4c70-88b9-3e15daac2fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:08.561513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:08.594652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1268/2525] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:08.606522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44950-d28a-498b-bf5f-3f241539c273 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:08.690017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44950-d28a-498b-bf5f-3f241539c273 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:08.696209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b58b-e231-48a8-91c9-0ea54be424bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:08.698357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b58b-e231-48a8-91c9-0ea54be424bc admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:08.698540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b58b-e231-48a8-91c9-0ea54be424bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:08.698898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b58b-e231-48a8-91c9-0ea54be424bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:08.699677 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77b58b-e231-48a8-91c9-0ea54be424bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:08.702039 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b77b58b-e231-48a8-91c9-0ea54be424bc admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:08.869040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1258/2526] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:08 2022] POST /identity/v3/projects => generated 405 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:08.873309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76e1af-899f-4c70-88b9-3e15daac2fee None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:08.884901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76e1af-899f-4c70-88b9-3e15daac2fee None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:08.891963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b58b-e231-48a8-91c9-0ea54be424bc admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:08.893941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5b77b58b-e231-48a8-91c9-0ea54be424bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:08.943674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:08.947890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39268b-b2ac-47a5-86c8-cdf50882d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:08.948893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39268b-b2ac-47a5-86c8-cdf50882d27a admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:08.949194 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39268b-b2ac-47a5-86c8-cdf50882d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:08.949456 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39268b-b2ac-47a5-86c8-cdf50882d27a admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:08.950143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39268b-b2ac-47a5-86c8-cdf50882d27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:08.952185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39268b-b2ac-47a5-86c8-cdf50882d27a admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:08.962558 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b77b58b-e231-48a8-91c9-0ea54be424bc admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:08.967182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:08.968599 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:08.968922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:08.969185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] PATH_INFO: `/v3/users/5836583c9aed46e09297c0f32cbb7520` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:08.970398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5836583c9aed46e09297c0f32cbb7520)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:08.972307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:09.028900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1269/2527] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:08 2022] POST /identity/v3/users => generated 309 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:09.032951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39268b-b2ac-47a5-86c8-cdf50882d27a admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:09.046789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39268b-b2ac-47a5-86c8-cdf50882d27a admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:09.052024 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd634b31-f137-41e0-b333-70627c300aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:09.053499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd634b31-f137-41e0-b333-70627c300aea admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:09.053791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd634b31-f137-41e0-b333-70627c300aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:09.054065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd634b31-f137-41e0-b333-70627c300aea admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:09.055971 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd634b31-f137-41e0-b333-70627c300aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:09.057791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd634b31-f137-41e0-b333-70627c300aea admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:09.068556 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1270/2528] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:09.072554 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd634b31-f137-41e0-b333-70627c300aea admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:09.083124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd634b31-f137-41e0-b333-70627c300aea admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:09.087856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860de63-50a7-43ee-ae0d-a39be12bb794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:09.088762 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860de63-50a7-43ee-ae0d-a39be12bb794 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:09.089073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860de63-50a7-43ee-ae0d-a39be12bb794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:09.089350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5860de63-50a7-43ee-ae0d-a39be12bb794 admin admin] PATH_INFO: `/v3/projects/64030fbaf54d4a46a659a73eac3adef6/users/fb7aea377f9f441fa7a32381fba32b30/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:09.103922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860de63-50a7-43ee-ae0d-a39be12bb794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64030fbaf54d4a46a659a73eac3adef6, user_id=fb7aea377f9f441fa7a32381fba32b30, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:09.106610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5860de63-50a7-43ee-ae0d-a39be12bb794 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:09.160874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5836583c9aed46e09297c0f32cbb7520'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:09.173815 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5836583c9aed46e09297c0f32cbb7520'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:09.185790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1271/2529] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:09 2022] PUT /identity/v3/projects/64030fbaf54d4a46a659a73eac3adef6/users/fb7aea377f9f441fa7a32381fba32b30/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:09.193245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860de63-50a7-43ee-ae0d-a39be12bb794 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:09.254361 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5860de63-50a7-43ee-ae0d-a39be12bb794 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:09.259201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08423ed5-d7c1-48bd-9492-147a607c96c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:09.259859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08423ed5-d7c1-48bd-9492-147a607c96c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:09.260148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08423ed5-d7c1-48bd-9492-147a607c96c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:09.260424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08423ed5-d7c1-48bd-9492-147a607c96c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:09.261255 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08423ed5-d7c1-48bd-9492-147a607c96c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:09.262921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08423ed5-d7c1-48bd-9492-147a607c96c2 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:09.272821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1272/2530] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:09.276710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08423ed5-d7c1-48bd-9492-147a607c96c2 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:09.286745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08423ed5-d7c1-48bd-9492-147a607c96c2 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:09.291329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac4d39-923c-4b16-911e-7b7a07a4e78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:09.292168 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac4d39-923c-4b16-911e-7b7a07a4e78a admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:09.292452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac4d39-923c-4b16-911e-7b7a07a4e78a admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:09.292733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac4d39-923c-4b16-911e-7b7a07a4e78a admin admin] PATH_INFO: `/v3/projects/64030fbaf54d4a46a659a73eac3adef6/users/fb7aea377f9f441fa7a32381fba32b30/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:09.294704 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac4d39-923c-4b16-911e-7b7a07a4e78a admin admin] RBAC: Authorizing `identity:create_grant(project_id=64030fbaf54d4a46a659a73eac3adef6, user_id=fb7aea377f9f441fa7a32381fba32b30, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:09.297879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac4d39-923c-4b16-911e-7b7a07a4e78a admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:09.308006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5836583c9aed46e09297c0f32cbb7520'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:09.308162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1273/2531] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:09 2022] PUT /identity/v3/projects/64030fbaf54d4a46a659a73eac3adef6/users/fb7aea377f9f441fa7a32381fba32b30/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:09.308456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5836583c9aed46e09297c0f32cbb7520'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:09.309129 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5836583c9aed46e09297c0f32cbb7520'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:09.319785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73292b0d-9827-437d-a67e-5f8042055147 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:09.320281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73292b0d-9827-437d-a67e-5f8042055147 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:09.321353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73292b0d-9827-437d-a67e-5f8042055147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:09.324138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1259/2532] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:08 2022] DELETE /identity/v3/users/5836583c9aed46e09297c0f32cbb7520 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:09.351720 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-73292b0d-9827-437d-a67e-5f8042055147 None None] MFA Rules not processed for user `fb7aea377f9f441fa7a32381fba32b30`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:09.354310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-73292b0d-9827-437d-a67e-5f8042055147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:09.367132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:09.428754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1274/2533] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:09.440984 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:09.442525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:09.502877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39e2ea-c0f4-43d9-b85e-c95581079d5e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:09.506637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a18b8-0d28-4d75-b3dd-b0ce30ebd6eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:09.507290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a18b8-0d28-4d75-b3dd-b0ce30ebd6eb service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:09.507577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a18b8-0d28-4d75-b3dd-b0ce30ebd6eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:09.507856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a18b8-0d28-4d75-b3dd-b0ce30ebd6eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:09.517115 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a18b8-0d28-4d75-b3dd-b0ce30ebd6eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:09.518537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a18b8-0d28-4d75-b3dd-b0ce30ebd6eb service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:09.528037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1260/2534] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:09 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:09.591418 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73292b0d-9827-437d-a67e-5f8042055147 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:09.594564 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-73292b0d-9827-437d-a67e-5f8042055147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:09.696233 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a18b8-0d28-4d75-b3dd-b0ce30ebd6eb service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:09.698247 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-550a18b8-0d28-4d75-b3dd-b0ce30ebd6eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:09.704068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73292b0d-9827-437d-a67e-5f8042055147 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:09.709647 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:09.710525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:09.710811 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:09.711091 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] PATH_INFO: `/v3/projects/c5f9be3ad4984e25aeac906e13fd0387` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:09.712299 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5f9be3ad4984e25aeac906e13fd0387)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:09.714362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:09.716482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a18b8-0d28-4d75-b3dd-b0ce30ebd6eb service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:09.722119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd37b3c-5060-4063-956a-ffdfff6f4341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:09.723171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd37b3c-5060-4063-956a-ffdfff6f4341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:09.723523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd37b3c-5060-4063-956a-ffdfff6f4341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:09.723889 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd37b3c-5060-4063-956a-ffdfff6f4341 admin admin] PATH_INFO: `/v3/users/c7c32e7576ab48738b182806bf6cd25e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:09.725669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd37b3c-5060-4063-956a-ffdfff6f4341 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c32e7576ab48738b182806bf6cd25e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:09.727582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd37b3c-5060-4063-956a-ffdfff6f4341 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:09.957333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5f9be3ad4984e25aeac906e13fd0387', 'request_id': 'req-cf1c5336-974d-47c7-ac57-84b96666a186'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:09.961506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5dd37b3c-5060-4063-956a-ffdfff6f4341 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c32e7576ab48738b182806bf6cd25e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:09.970511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:09.975066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5dd37b3c-5060-4063-956a-ffdfff6f4341 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c32e7576ab48738b182806bf6cd25e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.022621 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5f9be3ad4984e25aeac906e13fd0387', 'request_id': 'req-cf1c5336-974d-47c7-ac57-84b96666a186'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.029603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5f9be3ad4984e25aeac906e13fd0387', 'request_id': 'req-cf1c5336-974d-47c7-ac57-84b96666a186'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.040880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] The token cache is being invalidate because project c5f9be3ad4984e25aeac906e13fd0387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:10.041178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.041810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.043388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1275/2535] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:09 2022] DELETE /identity/v3/projects/c5f9be3ad4984e25aeac906e13fd0387 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:10.047354 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:10.048663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:10.092635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:10.108679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5dd37b3c-5060-4063-956a-ffdfff6f4341 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c32e7576ab48738b182806bf6cd25e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.109359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5dd37b3c-5060-4063-956a-ffdfff6f4341 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c32e7576ab48738b182806bf6cd25e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.109980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-5dd37b3c-5060-4063-956a-ffdfff6f4341 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c32e7576ab48738b182806bf6cd25e'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.114721 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c5336-974d-47c7-ac57-84b96666a186 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:10.119468 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:10.120333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:10.120611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:10.120915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] PATH_INFO: `/v3/users/14c717047e034b069cb80ff531b7d487` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:10.122160 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c717047e034b069cb80ff531b7d487)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:10.124300 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:10.124450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1261/2536] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:09 2022] DELETE /identity/v3/users/c7c32e7576ab48738b182806bf6cd25e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:10.128869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516631e-1d87-423a-8dfc-95f0a355866b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:10.129567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516631e-1d87-423a-8dfc-95f0a355866b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:10.130753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516631e-1d87-423a-8dfc-95f0a355866b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:10.150476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-4516631e-1d87-423a-8dfc-95f0a355866b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:10.151789 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4516631e-1d87-423a-8dfc-95f0a355866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:10.216952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1262/2537] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:10.227333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516631e-1d87-423a-8dfc-95f0a355866b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:10.233635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4516631e-1d87-423a-8dfc-95f0a355866b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:10.292842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516631e-1d87-423a-8dfc-95f0a355866b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:10.304742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630bf70-3523-41c4-a495-b397c3d89726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:10.304742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630bf70-3523-41c4-a495-b397c3d89726 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:10.304742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630bf70-3523-41c4-a495-b397c3d89726 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:10.304742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630bf70-3523-41c4-a495-b397c3d89726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:10.306613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630bf70-3523-41c4-a495-b397c3d89726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:10.308148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630bf70-3523-41c4-a495-b397c3d89726 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:10.318530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1263/2538] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:10.336197 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c717047e034b069cb80ff531b7d487'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.356679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c717047e034b069cb80ff531b7d487'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.445257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c717047e034b069cb80ff531b7d487'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.445837 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c717047e034b069cb80ff531b7d487'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.446524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c717047e034b069cb80ff531b7d487'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:10.460590 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1276/2539] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:10 2022] DELETE /identity/v3/users/14c717047e034b069cb80ff531b7d487 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:10.872534 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630bf70-3523-41c4-a495-b397c3d89726 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:10.875453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2630bf70-3523-41c4-a495-b397c3d89726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:10.880038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:10.881474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:10.899003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630bf70-3523-41c4-a495-b397c3d89726 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:10.968256 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e5297-7c78-4a6f-b506-dd0e311144e4 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:10.969536 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:10.970555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:10.970847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:10.971271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] PATH_INFO: `/v3/projects/d47acb18afac43a88fe588f1afbeb668` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:10.972484 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d47acb18afac43a88fe588f1afbeb668)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:10.974496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:10.975172 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:10.976113 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:10.976396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:10.976669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] PATH_INFO: `/v3/projects/ec56d0dccd8e4492a2b510c9396fc80a` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:10.978308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec56d0dccd8e4492a2b510c9396fc80a)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:10.980310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:10.999122 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:11.089209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd47acb18afac43a88fe588f1afbeb668', 'request_id': 'req-8ed90d04-85c4-4549-979f-1f2424161ce9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.107525 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec56d0dccd8e4492a2b510c9396fc80a', 'request_id': 'req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.230364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd47acb18afac43a88fe588f1afbeb668', 'request_id': 'req-8ed90d04-85c4-4549-979f-1f2424161ce9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.238217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd47acb18afac43a88fe588f1afbeb668', 'request_id': 'req-8ed90d04-85c4-4549-979f-1f2424161ce9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.249337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] The token cache is being invalidate because project d47acb18afac43a88fe588f1afbeb668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:11.249624 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.250355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.252062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1264/2540] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:10 2022] DELETE /identity/v3/projects/d47acb18afac43a88fe588f1afbeb668 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:11.256419 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:11.258170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:11.285771 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec56d0dccd8e4492a2b510c9396fc80a', 'request_id': 'req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.293229 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec56d0dccd8e4492a2b510c9396fc80a', 'request_id': 'req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.294742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:11.305077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] The token cache is being invalidate because project ec56d0dccd8e4492a2b510c9396fc80a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:11.305371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.306142 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.314639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1277/2541] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:10 2022] DELETE /identity/v3/projects/ec56d0dccd8e4492a2b510c9396fc80a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:11.338326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90d04-85c4-4549-979f-1f2424161ce9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:11.401672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b690d-8bb7-4753-8177-1ec3ce52ac27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:11.402577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b690d-8bb7-4753-8177-1ec3ce52ac27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:11.402869 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b690d-8bb7-4753-8177-1ec3ce52ac27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:11.403151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b690d-8bb7-4753-8177-1ec3ce52ac27 admin admin] PATH_INFO: `/v3/users/fb7aea377f9f441fa7a32381fba32b30` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:11.404694 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b690d-8bb7-4753-8177-1ec3ce52ac27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb7aea377f9f441fa7a32381fba32b30)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:11.407464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b690d-8bb7-4753-8177-1ec3ce52ac27 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:11.634789 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ef4b690d-8bb7-4753-8177-1ec3ce52ac27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb7aea377f9f441fa7a32381fba32b30'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.636749 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:11.640260 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ef4b690d-8bb7-4753-8177-1ec3ce52ac27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb7aea377f9f441fa7a32381fba32b30'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.709848 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ef4b690d-8bb7-4753-8177-1ec3ce52ac27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb7aea377f9f441fa7a32381fba32b30'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.710479 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ef4b690d-8bb7-4753-8177-1ec3ce52ac27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb7aea377f9f441fa7a32381fba32b30'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.713045 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-ef4b690d-8bb7-4753-8177-1ec3ce52ac27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb7aea377f9f441fa7a32381fba32b30'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:11.724581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1265/2542] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:11 2022] DELETE /identity/v3/users/fb7aea377f9f441fa7a32381fba32b30 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:12.143711 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:12.146218 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:12.162268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f6e6c-b47a-4ce8-8dd2-4719bde2efb5 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:12.224360 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57790374-df24-41b8-9acf-dd3b92e509e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:12.225253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57790374-df24-41b8-9acf-dd3b92e509e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:12.225534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57790374-df24-41b8-9acf-dd3b92e509e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:12.225812 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57790374-df24-41b8-9acf-dd3b92e509e0 admin admin] PATH_INFO: `/v3/projects/64030fbaf54d4a46a659a73eac3adef6` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:12.227018 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57790374-df24-41b8-9acf-dd3b92e509e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64030fbaf54d4a46a659a73eac3adef6)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:12.228974 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57790374-df24-41b8-9acf-dd3b92e509e0 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:12.356629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-57790374-df24-41b8-9acf-dd3b92e509e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64030fbaf54d4a46a659a73eac3adef6', 'request_id': 'req-57790374-df24-41b8-9acf-dd3b92e509e0'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:12.435676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-57790374-df24-41b8-9acf-dd3b92e509e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64030fbaf54d4a46a659a73eac3adef6', 'request_id': 'req-57790374-df24-41b8-9acf-dd3b92e509e0'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:12.443241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-57790374-df24-41b8-9acf-dd3b92e509e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64030fbaf54d4a46a659a73eac3adef6', 'request_id': 'req-57790374-df24-41b8-9acf-dd3b92e509e0'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:12.454107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-57790374-df24-41b8-9acf-dd3b92e509e0 admin admin] The token cache is being invalidate because project 64030fbaf54d4a46a659a73eac3adef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:12.454392 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-57790374-df24-41b8-9acf-dd3b92e509e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:12.455039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-57790374-df24-41b8-9acf-dd3b92e509e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:12.456609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1278/2543] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:12 2022] DELETE /identity/v3/projects/64030fbaf54d4a46a659a73eac3adef6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:12.461487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05433dce-ee4b-4b19-bc86-4aad15615b93 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:12.461966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05433dce-ee4b-4b19-bc86-4aad15615b93 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:12.462062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05433dce-ee4b-4b19-bc86-4aad15615b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:12.480560 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-05433dce-ee4b-4b19-bc86-4aad15615b93 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:12.481803 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-05433dce-ee4b-4b19-bc86-4aad15615b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:12.554622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1266/2544] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:12.562171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc67c8-90b7-4809-b767-4098364c5e01 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:12.564680 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc67c8-90b7-4809-b767-4098364c5e01 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:12.564680 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc67c8-90b7-4809-b767-4098364c5e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:12.583297 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-6acc67c8-90b7-4809-b767-4098364c5e01 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:12.584488 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6acc67c8-90b7-4809-b767-4098364c5e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:12.593261 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1279/2545] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:12.597517 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05433dce-ee4b-4b19-bc86-4aad15615b93 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:12.607098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05433dce-ee4b-4b19-bc86-4aad15615b93 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:12.612693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cc7d8-0d8c-44ce-9db9-d6a168f1dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:12.613382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cc7d8-0d8c-44ce-9db9-d6a168f1dc3a admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:12.613667 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cc7d8-0d8c-44ce-9db9-d6a168f1dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:12.613947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cc7d8-0d8c-44ce-9db9-d6a168f1dc3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:12.614708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cc7d8-0d8c-44ce-9db9-d6a168f1dc3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:12.615020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cc7d8-0d8c-44ce-9db9-d6a168f1dc3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:12.616640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cc7d8-0d8c-44ce-9db9-d6a168f1dc3a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:12.628463 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1267/2546] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:19:12.632964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc67c8-90b7-4809-b767-4098364c5e01 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:12.643197 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc67c8-90b7-4809-b767-4098364c5e01 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:12.648006 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ba912-ecbd-4a76-b028-65da2dca48b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:12.648671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ba912-ecbd-4a76-b028-65da2dca48b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:12.648993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ba912-ecbd-4a76-b028-65da2dca48b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:12.649278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ba912-ecbd-4a76-b028-65da2dca48b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:12.650013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ba912-ecbd-4a76-b028-65da2dca48b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:12.652175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ba912-ecbd-4a76-b028-65da2dca48b6 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:12.771240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1280/2547] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:12 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:12.775469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cc7d8-0d8c-44ce-9db9-d6a168f1dc3a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:12.788084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cc7d8-0d8c-44ce-9db9-d6a168f1dc3a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:12.849412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b36e7-61db-4749-b9ab-c57340c53e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:12.850090 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b36e7-61db-4749-b9ab-c57340c53e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:12.850483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b36e7-61db-4749-b9ab-c57340c53e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:12.850642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b36e7-61db-4749-b9ab-c57340c53e01 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:12.851414 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b36e7-61db-4749-b9ab-c57340c53e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:12.853435 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b36e7-61db-4749-b9ab-c57340c53e01 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:12.925627 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ba912-ecbd-4a76-b028-65da2dca48b6 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:12.927399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9d2ba912-ecbd-4a76-b028-65da2dca48b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:12.940905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ba912-ecbd-4a76-b028-65da2dca48b6 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:12.945858 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bbd6f2-19ca-4b6d-8c16-b4771c117254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:12.946807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbd6f2-19ca-4b6d-8c16-b4771c117254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:12.951870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbd6f2-19ca-4b6d-8c16-b4771c117254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:12.951870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bbd6f2-19ca-4b6d-8c16-b4771c117254 admin admin] PATH_INFO: `/v3/users/abe34062ae5d4df3bc85c817e97333cc` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:12.951870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbd6f2-19ca-4b6d-8c16-b4771c117254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe34062ae5d4df3bc85c817e97333cc)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:12.952110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1268/2548] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:12 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:12.952193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bbd6f2-19ca-4b6d-8c16-b4771c117254 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:12.955022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b36e7-61db-4749-b9ab-c57340c53e01 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:12.968444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b36e7-61db-4749-b9ab-c57340c53e01 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:12.973315 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c34b1e-4e79-4af2-b84c-092086d6794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:12.974066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c34b1e-4e79-4af2-b84c-092086d6794d admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:12.974353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c34b1e-4e79-4af2-b84c-092086d6794d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:12.974995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c34b1e-4e79-4af2-b84c-092086d6794d admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:12.975445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c34b1e-4e79-4af2-b84c-092086d6794d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:12.977077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c34b1e-4e79-4af2-b84c-092086d6794d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:12.988030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1269/2549] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:12.994717 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c34b1e-4e79-4af2-b84c-092086d6794d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:13.005531 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c34b1e-4e79-4af2-b84c-092086d6794d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:13.013126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805c15d-acfe-408c-a5ac-74960deaa94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:13.013610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805c15d-acfe-408c-a5ac-74960deaa94f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:13.013891 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805c15d-acfe-408c-a5ac-74960deaa94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:13.014170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805c15d-acfe-408c-a5ac-74960deaa94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:13.014931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805c15d-acfe-408c-a5ac-74960deaa94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:13.016668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805c15d-acfe-408c-a5ac-74960deaa94f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:13.028522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1270/2550] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:13.034586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805c15d-acfe-408c-a5ac-74960deaa94f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:13.045438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805c15d-acfe-408c-a5ac-74960deaa94f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:13.052696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb75123-3f51-405a-a430-b27719360def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:13.053625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb75123-3f51-405a-a430-b27719360def admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:13.053890 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb75123-3f51-405a-a430-b27719360def admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:13.054166 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb75123-3f51-405a-a430-b27719360def admin admin] PATH_INFO: `/v3/projects/9a600237f7944954bbce89a064a8252e/users/7d79b5646135447c9f7bc92044085c91/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:13.071745 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb75123-3f51-405a-a430-b27719360def admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a600237f7944954bbce89a064a8252e, user_id=7d79b5646135447c9f7bc92044085c91, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:13.074427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb75123-3f51-405a-a430-b27719360def admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:13.180988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:13.182859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c4bbd6f2-19ca-4b6d-8c16-b4771c117254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe34062ae5d4df3bc85c817e97333cc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:13.195659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c4bbd6f2-19ca-4b6d-8c16-b4771c117254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe34062ae5d4df3bc85c817e97333cc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:13.230948 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1271/2551] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:13 2022] PUT /identity/v3/projects/9a600237f7944954bbce89a064a8252e/users/7d79b5646135447c9f7bc92044085c91/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:13.242204 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ad648-b88c-4f6b-9ab2-b107f792567f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:13.242500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ad648-b88c-4f6b-9ab2-b107f792567f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:13.242785 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ad648-b88c-4f6b-9ab2-b107f792567f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:13.255533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:13.258511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c4bbd6f2-19ca-4b6d-8c16-b4771c117254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe34062ae5d4df3bc85c817e97333cc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:13.259227 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c4bbd6f2-19ca-4b6d-8c16-b4771c117254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe34062ae5d4df3bc85c817e97333cc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:13.259897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c4bbd6f2-19ca-4b6d-8c16-b4771c117254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe34062ae5d4df3bc85c817e97333cc'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:13.272293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7c4ad648-b88c-4f6b-9ab2-b107f792567f None None] MFA Rules not processed for user `7d79b5646135447c9f7bc92044085c91`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:13.273614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7c4ad648-b88c-4f6b-9ab2-b107f792567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:13.275790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1281/2552] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:12 2022] DELETE /identity/v3/users/abe34062ae5d4df3bc85c817e97333cc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:13.281560 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95952ac7-f27b-4385-93ce-cc061178d27e None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:13.281815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95952ac7-f27b-4385-93ce-cc061178d27e None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:13.282101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95952ac7-f27b-4385-93ce-cc061178d27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:13.301195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-95952ac7-f27b-4385-93ce-cc061178d27e None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:13.302420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-95952ac7-f27b-4385-93ce-cc061178d27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:13.346268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1272/2553] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:13.350173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ad648-b88c-4f6b-9ab2-b107f792567f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:13.351472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7c4ad648-b88c-4f6b-9ab2-b107f792567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:13.364003 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1282/2554] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:13.373940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95952ac7-f27b-4385-93ce-cc061178d27e None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:13.375340 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-95952ac7-f27b-4385-93ce-cc061178d27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:13.418468 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ad648-b88c-4f6b-9ab2-b107f792567f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:13.425060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356261d-8d6c-47e6-be67-8cfddb9a1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:13.425724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356261d-8d6c-47e6-be67-8cfddb9a1859 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:13.426006 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356261d-8d6c-47e6-be67-8cfddb9a1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:13.426279 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4356261d-8d6c-47e6-be67-8cfddb9a1859 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:13.426963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356261d-8d6c-47e6-be67-8cfddb9a1859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:13.429141 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4356261d-8d6c-47e6-be67-8cfddb9a1859 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:13.433243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95952ac7-f27b-4385-93ce-cc061178d27e None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:13.437231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba4dd4-bf68-4815-88b3-4ed74d6b9e66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:13.437878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba4dd4-bf68-4815-88b3-4ed74d6b9e66 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:13.438162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba4dd4-bf68-4815-88b3-4ed74d6b9e66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:13.438441 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba4dd4-bf68-4815-88b3-4ed74d6b9e66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:13.448521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba4dd4-bf68-4815-88b3-4ed74d6b9e66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:13.450007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba4dd4-bf68-4815-88b3-4ed74d6b9e66 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:13.459833 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1283/2555] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:13.523507 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1273/2556] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:13 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:13.527478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba4dd4-bf68-4815-88b3-4ed74d6b9e66 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:13.538888 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba4dd4-bf68-4815-88b3-4ed74d6b9e66 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:13.598200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d539b5d-443b-4793-bcd3-66325d334900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:13.598951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d539b5d-443b-4793-bcd3-66325d334900 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:13.599238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d539b5d-443b-4793-bcd3-66325d334900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:13.599516 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d539b5d-443b-4793-bcd3-66325d334900 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:13.600244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d539b5d-443b-4793-bcd3-66325d334900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:13.602224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d539b5d-443b-4793-bcd3-66325d334900 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:13.613297 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:13.720924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1284/2557] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:13 2022] POST /identity/v3/users => generated 296 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:13.724849 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356261d-8d6c-47e6-be67-8cfddb9a1859 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:13.735958 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4356261d-8d6c-47e6-be67-8cfddb9a1859 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:13.741678 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbd5a9-c7d2-46df-aa25-1e8fee15c015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:13.744065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbd5a9-c7d2-46df-aa25-1e8fee15c015 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:13.744065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbd5a9-c7d2-46df-aa25-1e8fee15c015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:13.744065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cbd5a9-c7d2-46df-aa25-1e8fee15c015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:13.744065 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbd5a9-c7d2-46df-aa25-1e8fee15c015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:13.745374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cbd5a9-c7d2-46df-aa25-1e8fee15c015 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:13.756409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1274/2558] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:13.760697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d539b5d-443b-4793-bcd3-66325d334900 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:13.771665 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d539b5d-443b-4793-bcd3-66325d334900 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:13.776536 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f49a6a-e4cd-45ee-b514-2466720b4c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:13.777540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49a6a-e4cd-45ee-b514-2466720b4c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:13.777822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49a6a-e4cd-45ee-b514-2466720b4c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:13.778222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f49a6a-e4cd-45ee-b514-2466720b4c7e admin admin] PATH_INFO: `/v3/projects/d8c6262515584ff5b2293052318900b5/users/855779f0569b4266acb77cab60ee651d/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:13.795409 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f49a6a-e4cd-45ee-b514-2466720b4c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c6262515584ff5b2293052318900b5, user_id=855779f0569b4266acb77cab60ee651d, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:13.798167 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f49a6a-e4cd-45ee-b514-2466720b4c7e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:13.895425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbd5a9-c7d2-46df-aa25-1e8fee15c015 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:13.897530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-43cbd5a9-c7d2-46df-aa25-1e8fee15c015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:13.912514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cbd5a9-c7d2-46df-aa25-1e8fee15c015 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:13.924907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:13.925823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:13.926102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:13.926377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] PATH_INFO: `/v3/projects/4c47dacbdad049cc816612decf12d5e3` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:13.927621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c47dacbdad049cc816612decf12d5e3)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:13.929628 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:13.955374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1285/2559] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:13 2022] PUT /identity/v3/projects/d8c6262515584ff5b2293052318900b5/users/855779f0569b4266acb77cab60ee651d/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:13.957034 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f49a6a-e4cd-45ee-b514-2466720b4c7e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:14.019163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f49a6a-e4cd-45ee-b514-2466720b4c7e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:14.023844 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b82e0-722c-4b3d-9b79-d53bcf8ff6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:14.024506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b82e0-722c-4b3d-9b79-d53bcf8ff6dc admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:14.024788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b82e0-722c-4b3d-9b79-d53bcf8ff6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:14.025090 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b82e0-722c-4b3d-9b79-d53bcf8ff6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:14.025819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b82e0-722c-4b3d-9b79-d53bcf8ff6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:14.027561 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b82e0-722c-4b3d-9b79-d53bcf8ff6dc admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:14.041180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1286/2560] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:14.045844 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b82e0-722c-4b3d-9b79-d53bcf8ff6dc admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:14.052319 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b82e0-722c-4b3d-9b79-d53bcf8ff6dc admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:14.057130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18577b9f-0c03-4bb7-b01f-c410bc940512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:14.058014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18577b9f-0c03-4bb7-b01f-c410bc940512 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:14.058299 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18577b9f-0c03-4bb7-b01f-c410bc940512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:14.058604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18577b9f-0c03-4bb7-b01f-c410bc940512 admin admin] PATH_INFO: `/v3/projects/d8c6262515584ff5b2293052318900b5/users/855779f0569b4266acb77cab60ee651d/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:14.060562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18577b9f-0c03-4bb7-b01f-c410bc940512 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c6262515584ff5b2293052318900b5, user_id=855779f0569b4266acb77cab60ee651d, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:14.063905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18577b9f-0c03-4bb7-b01f-c410bc940512 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:14.075241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1287/2561] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:14 2022] PUT /identity/v3/projects/d8c6262515584ff5b2293052318900b5/users/855779f0569b4266acb77cab60ee651d/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:14.086914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e7ca7-0de2-4b0e-a8b8-adb5c8bf94fd None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:14.087264 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e7ca7-0de2-4b0e-a8b8-adb5c8bf94fd None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:14.087570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e7ca7-0de2-4b0e-a8b8-adb5c8bf94fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:14.088326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c47dacbdad049cc816612decf12d5e3', 'request_id': 'req-76945ee6-5995-4682-9c5c-c0d98a5f33d7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:14.113505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-842e7ca7-0de2-4b0e-a8b8-adb5c8bf94fd None None] MFA Rules not processed for user `855779f0569b4266acb77cab60ee651d`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:14.115385 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-842e7ca7-0de2-4b0e-a8b8-adb5c8bf94fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:14.185116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1288/2562] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:14.199279 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e7ca7-0de2-4b0e-a8b8-adb5c8bf94fd None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:14.200841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-842e7ca7-0de2-4b0e-a8b8-adb5c8bf94fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:14.201555 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c47dacbdad049cc816612decf12d5e3', 'request_id': 'req-76945ee6-5995-4682-9c5c-c0d98a5f33d7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:14.210011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c47dacbdad049cc816612decf12d5e3', 'request_id': 'req-76945ee6-5995-4682-9c5c-c0d98a5f33d7'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:14.214520 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:14.223149 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] The token cache is being invalidate because project 4c47dacbdad049cc816612decf12d5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:14.223447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:14.224274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:14.226099 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1275/2563] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:13 2022] DELETE /identity/v3/projects/4c47dacbdad049cc816612decf12d5e3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:14.230148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:14.234565 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:14.251056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:14.268028 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e7ca7-0de2-4b0e-a8b8-adb5c8bf94fd None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:14.271766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5225935-867c-4d68-9982-6f88de5087c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:14.272417 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5225935-867c-4d68-9982-6f88de5087c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:14.272710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5225935-867c-4d68-9982-6f88de5087c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:14.273026 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5225935-867c-4d68-9982-6f88de5087c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:14.274976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f5225935-867c-4d68-9982-6f88de5087c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:14.288388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5225935-867c-4d68-9982-6f88de5087c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:14.289866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5225935-867c-4d68-9982-6f88de5087c3 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:14.297549 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76945ee6-5995-4682-9c5c-c0d98a5f33d7 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:14.299799 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1289/2564] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:14.302399 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:14.303316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:14.303594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:14.303867 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] PATH_INFO: `/v3/users/b38b13b7f75b4af09172cc0cdbe30ec8` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:14.305192 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38b13b7f75b4af09172cc0cdbe30ec8)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:14.307039 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:14.547551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38b13b7f75b4af09172cc0cdbe30ec8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:14.556522 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5225935-867c-4d68-9982-6f88de5087c3 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:14.558069 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f5225935-867c-4d68-9982-6f88de5087c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:14.561913 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38b13b7f75b4af09172cc0cdbe30ec8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:14.573341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5225935-867c-4d68-9982-6f88de5087c3 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:14.582317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40df7e-eda9-497c-b196-20348ef34064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:14.583730 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40df7e-eda9-497c-b196-20348ef34064 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:14.584252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40df7e-eda9-497c-b196-20348ef34064 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:14.584675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40df7e-eda9-497c-b196-20348ef34064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:14.587349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fa40df7e-eda9-497c-b196-20348ef34064 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:14.619504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38b13b7f75b4af09172cc0cdbe30ec8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:14.620288 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38b13b7f75b4af09172cc0cdbe30ec8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:14.621049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38b13b7f75b4af09172cc0cdbe30ec8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:14.634885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1276/2565] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:14 2022] DELETE /identity/v3/users/b38b13b7f75b4af09172cc0cdbe30ec8 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:14.667329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40df7e-eda9-497c-b196-20348ef34064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:14.668921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40df7e-eda9-497c-b196-20348ef34064 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:14.679094 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1290/2566] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:15.083694 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:15.085436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:15.164307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562e4ed-c18d-4019-b148-b9ea75a2fe91 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:15.169251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:15.170127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:15.170412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:15.171397 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec admin admin] PATH_INFO: `/v3/projects/cb62c1b6f64c4b6d98d2f50517e8fa45` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:15.172799 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb62c1b6f64c4b6d98d2f50517e8fa45)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:15.174762 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:15.199003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:15.287307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb62c1b6f64c4b6d98d2f50517e8fa45', 'request_id': 'req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:15.343911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb62c1b6f64c4b6d98d2f50517e8fa45', 'request_id': 'req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:15.350482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb62c1b6f64c4b6d98d2f50517e8fa45', 'request_id': 'req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:15.361049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec admin admin] The token cache is being invalidate because project cb62c1b6f64c4b6d98d2f50517e8fa45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:15.361332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:15.361958 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-776b5b31-7a1c-4f71-bac7-e9e2b96bcaec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:15.363496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1277/2567] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:15 2022] DELETE /identity/v3/projects/cb62c1b6f64c4b6d98d2f50517e8fa45 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:15.368460 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461469-5c57-4abd-8c13-f83d5a1cddd0 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:15.368951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461469-5c57-4abd-8c13-f83d5a1cddd0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:15.369080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461469-5c57-4abd-8c13-f83d5a1cddd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:15.389281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d2461469-5c57-4abd-8c13-f83d5a1cddd0 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:15.390717 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d2461469-5c57-4abd-8c13-f83d5a1cddd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:15.452085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1291/2568] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:15.461318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801011b4-16b6-4da6-8642-862da01c4030 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:15.461609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801011b4-16b6-4da6-8642-862da01c4030 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:15.462061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801011b4-16b6-4da6-8642-862da01c4030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:15.480782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-801011b4-16b6-4da6-8642-862da01c4030 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:15.482029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-801011b4-16b6-4da6-8642-862da01c4030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:15.490573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1278/2569] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:15.494901 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2461469-5c57-4abd-8c13-f83d5a1cddd0 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:15.505245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2461469-5c57-4abd-8c13-f83d5a1cddd0 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:15.509845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87685ab-565d-4ac9-b365-ddcbf3f83b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:15.510502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87685ab-565d-4ac9-b365-ddcbf3f83b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:15.510779 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87685ab-565d-4ac9-b365-ddcbf3f83b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:15.511062 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87685ab-565d-4ac9-b365-ddcbf3f83b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:15.511823 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87685ab-565d-4ac9-b365-ddcbf3f83b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:15.512135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87685ab-565d-4ac9-b365-ddcbf3f83b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:15.513777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87685ab-565d-4ac9-b365-ddcbf3f83b99 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:15.526233 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801011b4-16b6-4da6-8642-862da01c4030 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:15.529859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1292/2570] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:19:15.530567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-801011b4-16b6-4da6-8642-862da01c4030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:15.531954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87685ab-565d-4ac9-b365-ddcbf3f83b99 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:15.541357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801011b4-16b6-4da6-8642-862da01c4030 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:15.541491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87685ab-565d-4ac9-b365-ddcbf3f83b99 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:15.546880 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139dcb75-7054-4ee2-a8c2-4b6e04378484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:15.547129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2c0ca-3fc4-4165-9dea-6807df4a8591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:15.547765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2c0ca-3fc4-4165-9dea-6807df4a8591 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:15.547928 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dcb75-7054-4ee2-a8c2-4b6e04378484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:15.548363 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2c0ca-3fc4-4165-9dea-6807df4a8591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:15.548490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dcb75-7054-4ee2-a8c2-4b6e04378484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:15.548575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2c0ca-3fc4-4165-9dea-6807df4a8591 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:15.548652 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dcb75-7054-4ee2-a8c2-4b6e04378484 admin admin] PATH_INFO: `/v3/users/8ce2a0e9fb234051a5fbe8916a4fa356` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:15.549028 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2c0ca-3fc4-4165-9dea-6807df4a8591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:15.549834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dcb75-7054-4ee2-a8c2-4b6e04378484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ce2a0e9fb234051a5fbe8916a4fa356)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:15.550919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2c0ca-3fc4-4165-9dea-6807df4a8591 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:15.551736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dcb75-7054-4ee2-a8c2-4b6e04378484 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:15.660861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1293/2571] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:15 2022] POST /identity/v3/projects => generated 361 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:15.664917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2c0ca-3fc4-4165-9dea-6807df4a8591 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:15.712629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:15.727055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2c0ca-3fc4-4165-9dea-6807df4a8591 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:15.731777 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15960a0d-2266-4c14-bdaf-2e973ccbc98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:15.732442 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15960a0d-2266-4c14-bdaf-2e973ccbc98f admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:15.732735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15960a0d-2266-4c14-bdaf-2e973ccbc98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:15.733110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15960a0d-2266-4c14-bdaf-2e973ccbc98f admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:15.734350 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15960a0d-2266-4c14-bdaf-2e973ccbc98f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:15.736297 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15960a0d-2266-4c14-bdaf-2e973ccbc98f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:15.785438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-139dcb75-7054-4ee2-a8c2-4b6e04378484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ce2a0e9fb234051a5fbe8916a4fa356'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:15.797945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-139dcb75-7054-4ee2-a8c2-4b6e04378484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ce2a0e9fb234051a5fbe8916a4fa356'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:15.891899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1294/2572] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:15 2022] POST /identity/v3/users => generated 281 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:15.895969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15960a0d-2266-4c14-bdaf-2e973ccbc98f admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:15.906591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15960a0d-2266-4c14-bdaf-2e973ccbc98f admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:15.911270 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebd0d0-d7fc-428b-8daf-5e7a1fdc5ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:15.911918 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebd0d0-d7fc-428b-8daf-5e7a1fdc5ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:15.912206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebd0d0-d7fc-428b-8daf-5e7a1fdc5ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:15.912507 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebd0d0-d7fc-428b-8daf-5e7a1fdc5ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:15.913289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebd0d0-d7fc-428b-8daf-5e7a1fdc5ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:15.914940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceebd0d0-d7fc-428b-8daf-5e7a1fdc5ae9 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:15.924951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1295/2573] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:15.928568 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebd0d0-d7fc-428b-8daf-5e7a1fdc5ae9 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:15.938443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebd0d0-d7fc-428b-8daf-5e7a1fdc5ae9 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:15.943329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8e00c-f162-4d52-9b59-74d4ac8e2be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:15.943981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8e00c-f162-4d52-9b59-74d4ac8e2be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:15.944263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8e00c-f162-4d52-9b59-74d4ac8e2be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:15.944538 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8e00c-f162-4d52-9b59-74d4ac8e2be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:15.945298 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8e00c-f162-4d52-9b59-74d4ac8e2be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:15.946890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8e00c-f162-4d52-9b59-74d4ac8e2be4 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:15.959396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1296/2574] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:15.960058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-139dcb75-7054-4ee2-a8c2-4b6e04378484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ce2a0e9fb234051a5fbe8916a4fa356'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:15.960738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-139dcb75-7054-4ee2-a8c2-4b6e04378484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ce2a0e9fb234051a5fbe8916a4fa356'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:15.961492 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-139dcb75-7054-4ee2-a8c2-4b6e04378484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ce2a0e9fb234051a5fbe8916a4fa356'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:15.962531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8e00c-f162-4d52-9b59-74d4ac8e2be4 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:15.964830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-20f8e00c-f162-4d52-9b59-74d4ac8e2be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:15.975773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1279/2575] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:15 2022] DELETE /identity/v3/users/8ce2a0e9fb234051a5fbe8916a4fa356 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:15.978876 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8e00c-f162-4d52-9b59-74d4ac8e2be4 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:15.980535 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82db9a-8ac3-41fb-8f26-673ee43b0ad2 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:15.980855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82db9a-8ac3-41fb-8f26-673ee43b0ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:15.981136 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82db9a-8ac3-41fb-8f26-673ee43b0ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:16.000487 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-7e82db9a-8ac3-41fb-8f26-673ee43b0ad2 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:16.001895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7e82db9a-8ac3-41fb-8f26-673ee43b0ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:16.039520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c88f9-a8b0-42ec-9bed-b370ecdc6025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:16.040681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c88f9-a8b0-42ec-9bed-b370ecdc6025 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:16.041000 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c88f9-a8b0-42ec-9bed-b370ecdc6025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:16.041280 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c88f9-a8b0-42ec-9bed-b370ecdc6025 admin admin] PATH_INFO: `/v3/projects/bc107a7c7a6f4b869d5603780a59c500/users/cf801fa63f804a989d6c6246f591cea3/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:16.057575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c88f9-a8b0-42ec-9bed-b370ecdc6025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc107a7c7a6f4b869d5603780a59c500, user_id=cf801fa63f804a989d6c6246f591cea3, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:16.060294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c88f9-a8b0-42ec-9bed-b370ecdc6025 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:16.062495 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1280/2576] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:16.072004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82db9a-8ac3-41fb-8f26-673ee43b0ad2 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:16.073444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7e82db9a-8ac3-41fb-8f26-673ee43b0ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:16.084376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:16.128983 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82db9a-8ac3-41fb-8f26-673ee43b0ad2 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:16.132671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c93fb8-885c-40cf-b109-1e43bde286bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:16.133354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c93fb8-885c-40cf-b109-1e43bde286bb service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:16.133649 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c93fb8-885c-40cf-b109-1e43bde286bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:16.133934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c93fb8-885c-40cf-b109-1e43bde286bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:16.137425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1297/2577] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:15 2022] PUT /identity/v3/projects/bc107a7c7a6f4b869d5603780a59c500/users/cf801fa63f804a989d6c6246f591cea3/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:16.143991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c93fb8-885c-40cf-b109-1e43bde286bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:16.146255 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c93fb8-885c-40cf-b109-1e43bde286bb service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:16.148337 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302f50f-3784-4f14-b1b6-bb235296db02 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:16.148641 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302f50f-3784-4f14-b1b6-bb235296db02 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:16.148934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302f50f-3784-4f14-b1b6-bb235296db02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:16.157237 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1281/2578] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:16.177178 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-9302f50f-3784-4f14-b1b6-bb235296db02 None None] MFA Rules not processed for user `cf801fa63f804a989d6c6246f591cea3`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:16.178396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9302f50f-3784-4f14-b1b6-bb235296db02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:16.264202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1298/2579] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:16.266244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c93fb8-885c-40cf-b109-1e43bde286bb service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:16.278584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c93fb8-885c-40cf-b109-1e43bde286bb service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:16.356359 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe14e23-0e68-444a-be94-5963faa94fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:16.357068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe14e23-0e68-444a-be94-5963faa94fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:16.357681 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe14e23-0e68-444a-be94-5963faa94fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:16.357681 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe14e23-0e68-444a-be94-5963faa94fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:16.358513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe14e23-0e68-444a-be94-5963faa94fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:16.360523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe14e23-0e68-444a-be94-5963faa94fe2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:16.452705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1282/2580] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:16 2022] POST /identity/v3/projects => generated 363 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:16.454034 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302f50f-3784-4f14-b1b6-bb235296db02 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:16.465550 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302f50f-3784-4f14-b1b6-bb235296db02 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:16.490631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:16.526605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c46c3-9681-4c11-8caf-9ba8d8a4f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:16.527374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c46c3-9681-4c11-8caf-9ba8d8a4f471 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:16.527722 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c46c3-9681-4c11-8caf-9ba8d8a4f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:16.528075 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c46c3-9681-4c11-8caf-9ba8d8a4f471 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:16.529291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c46c3-9681-4c11-8caf-9ba8d8a4f471 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:16.531654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c46c3-9681-4c11-8caf-9ba8d8a4f471 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:16.658966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe14e23-0e68-444a-be94-5963faa94fe2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:16.661338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3fe14e23-0e68-444a-be94-5963faa94fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:16.662419 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1299/2581] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:16 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:16.667332 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c46c3-9681-4c11-8caf-9ba8d8a4f471 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:16.679596 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c46c3-9681-4c11-8caf-9ba8d8a4f471 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:16.679993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe14e23-0e68-444a-be94-5963faa94fe2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:16.684914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c94436-ae52-4b85-9a6e-90fd14d23590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:16.685395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee37735-8645-4bdb-b0b0-6dc08bb579e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:16.689892 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c94436-ae52-4b85-9a6e-90fd14d23590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:16.690308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee37735-8645-4bdb-b0b0-6dc08bb579e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:16.690416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c94436-ae52-4b85-9a6e-90fd14d23590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:16.690416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c94436-ae52-4b85-9a6e-90fd14d23590 admin admin] PATH_INFO: `/v3/projects/93900e3b95894800a887d9efadda2dcf` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:16.690696 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee37735-8645-4bdb-b0b0-6dc08bb579e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:16.690696 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee37735-8645-4bdb-b0b0-6dc08bb579e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:16.690696 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee37735-8645-4bdb-b0b0-6dc08bb579e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:16.690944 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c94436-ae52-4b85-9a6e-90fd14d23590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93900e3b95894800a887d9efadda2dcf)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:16.691210 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c94436-ae52-4b85-9a6e-90fd14d23590 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:16.691802 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee37735-8645-4bdb-b0b0-6dc08bb579e3 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:16.702401 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1300/2582] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:16.706394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee37735-8645-4bdb-b0b0-6dc08bb579e3 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:16.716206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee37735-8645-4bdb-b0b0-6dc08bb579e3 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:16.721037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43e374-e551-4137-90ee-488a3af72ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:16.721910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43e374-e551-4137-90ee-488a3af72ca9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:16.722192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43e374-e551-4137-90ee-488a3af72ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:16.722467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43e374-e551-4137-90ee-488a3af72ca9 admin admin] PATH_INFO: `/v3/projects/5539791ddf844cada47e6a2b21d8f5ac/users/86a42805119648389332868967c37abe/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:16.737578 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43e374-e551-4137-90ee-488a3af72ca9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5539791ddf844cada47e6a2b21d8f5ac, user_id=86a42805119648389332868967c37abe, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:16.740241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43e374-e551-4137-90ee-488a3af72ca9 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:16.853451 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1301/2583] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:16 2022] PUT /identity/v3/projects/5539791ddf844cada47e6a2b21d8f5ac/users/86a42805119648389332868967c37abe/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:16.857333 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43e374-e551-4137-90ee-488a3af72ca9 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:16.869443 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a0c94436-ae52-4b85-9a6e-90fd14d23590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93900e3b95894800a887d9efadda2dcf', 'request_id': 'req-a0c94436-ae52-4b85-9a6e-90fd14d23590'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:16.924032 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43e374-e551-4137-90ee-488a3af72ca9 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:16.985263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575b9e4-06b6-4215-a45b-26198fd6db61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:16.985928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575b9e4-06b6-4215-a45b-26198fd6db61 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:16.986213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575b9e4-06b6-4215-a45b-26198fd6db61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:16.986490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575b9e4-06b6-4215-a45b-26198fd6db61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:16.987253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575b9e4-06b6-4215-a45b-26198fd6db61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:16.989101 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575b9e4-06b6-4215-a45b-26198fd6db61 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:16.998790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1302/2584] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:17.002755 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575b9e4-06b6-4215-a45b-26198fd6db61 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:17.012018 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575b9e4-06b6-4215-a45b-26198fd6db61 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:17.012992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a0c94436-ae52-4b85-9a6e-90fd14d23590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93900e3b95894800a887d9efadda2dcf', 'request_id': 'req-a0c94436-ae52-4b85-9a6e-90fd14d23590'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:17.017144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b498f3-ad19-443c-9020-53a6d49167c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:17.017989 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b498f3-ad19-443c-9020-53a6d49167c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.018273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b498f3-ad19-443c-9020-53a6d49167c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.018587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b498f3-ad19-443c-9020-53a6d49167c6 admin admin] PATH_INFO: `/v3/projects/5539791ddf844cada47e6a2b21d8f5ac/users/86a42805119648389332868967c37abe/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.020402 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a0c94436-ae52-4b85-9a6e-90fd14d23590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93900e3b95894800a887d9efadda2dcf', 'request_id': 'req-a0c94436-ae52-4b85-9a6e-90fd14d23590'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:17.020537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b498f3-ad19-443c-9020-53a6d49167c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5539791ddf844cada47e6a2b21d8f5ac, user_id=86a42805119648389332868967c37abe, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:17.023751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b498f3-ad19-443c-9020-53a6d49167c6 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:17.044937 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1303/2585] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:17 2022] PUT /identity/v3/projects/5539791ddf844cada47e6a2b21d8f5ac/users/86a42805119648389332868967c37abe/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:17.045274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a0c94436-ae52-4b85-9a6e-90fd14d23590 admin admin] The token cache is being invalidate because project 93900e3b95894800a887d9efadda2dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:17.045274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a0c94436-ae52-4b85-9a6e-90fd14d23590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:17.045274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-a0c94436-ae52-4b85-9a6e-90fd14d23590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:17.045274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1283/2586] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:16 2022] DELETE /identity/v3/projects/93900e3b95894800a887d9efadda2dcf => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:17.047996 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d54e9-cb03-4cf9-b39d-b3e5dbde3702 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.048133 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1e4e0-441a-485f-9ef7-38087f0e81f2 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.048424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d54e9-cb03-4cf9-b39d-b3e5dbde3702 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.048570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1e4e0-441a-485f-9ef7-38087f0e81f2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.048894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d54e9-cb03-4cf9-b39d-b3e5dbde3702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.049058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1e4e0-441a-485f-9ef7-38087f0e81f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.070634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-c16d54e9-cb03-4cf9-b39d-b3e5dbde3702 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:17.071872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-c16d54e9-cb03-4cf9-b39d-b3e5dbde3702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:17.075420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:17.087793 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:17.093164 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-87c1e4e0-441a-485f-9ef7-38087f0e81f2 None None] MFA Rules not processed for user `86a42805119648389332868967c37abe`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:17.094841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-87c1e4e0-441a-485f-9ef7-38087f0e81f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:17.142577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1284/2587] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:17.150424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69f2f9-e1c6-4614-9944-66f21b1b7d23 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.150842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69f2f9-e1c6-4614-9944-66f21b1b7d23 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.151334 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c69f2f9-e1c6-4614-9944-66f21b1b7d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.172125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9c69f2f9-e1c6-4614-9944-66f21b1b7d23 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:17.173481 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9c69f2f9-e1c6-4614-9944-66f21b1b7d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:17.187830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1285/2588] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:17.189582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1304/2589] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:17 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:17.196236 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69f2f9-e1c6-4614-9944-66f21b1b7d23 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:17.204789 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1e4e0-441a-485f-9ef7-38087f0e81f2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:17.206441 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-87c1e4e0-441a-485f-9ef7-38087f0e81f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:17.210855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c69f2f9-e1c6-4614-9944-66f21b1b7d23 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:17.215935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ef68b-6bca-4269-a2af-8a4b7efeadb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:17.216740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ef68b-6bca-4269-a2af-8a4b7efeadb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.217218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ef68b-6bca-4269-a2af-8a4b7efeadb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.217491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ef68b-6bca-4269-a2af-8a4b7efeadb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.218345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ef68b-6bca-4269-a2af-8a4b7efeadb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:17.218717 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ef68b-6bca-4269-a2af-8a4b7efeadb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:17.220619 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ef68b-6bca-4269-a2af-8a4b7efeadb2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:17.232504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1286/2590] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:19:17.236874 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ef68b-6bca-4269-a2af-8a4b7efeadb2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:17.246590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ef68b-6bca-4269-a2af-8a4b7efeadb2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:17.252127 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11993b-32b3-4c7b-a29f-762caff6a467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:17.252781 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11993b-32b3-4c7b-a29f-762caff6a467 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.253103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11993b-32b3-4c7b-a29f-762caff6a467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.253383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11993b-32b3-4c7b-a29f-762caff6a467 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.254073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11993b-32b3-4c7b-a29f-762caff6a467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:17.255963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11993b-32b3-4c7b-a29f-762caff6a467 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:17.267019 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1e4e0-441a-485f-9ef7-38087f0e81f2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:17.271001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c53dd-4508-4cdf-8f19-5491eaa21835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:17.271661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c53dd-4508-4cdf-8f19-5491eaa21835 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.271938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c53dd-4508-4cdf-8f19-5491eaa21835 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.272215 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c53dd-4508-4cdf-8f19-5491eaa21835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.282183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c53dd-4508-4cdf-8f19-5491eaa21835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:17.283629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c53dd-4508-4cdf-8f19-5491eaa21835 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:17.292977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1305/2591] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:17 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:17.375349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1287/2592] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:17 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:17.379372 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c53dd-4508-4cdf-8f19-5491eaa21835 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:17.389732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c53dd-4508-4cdf-8f19-5491eaa21835 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:17.448770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185537b-486b-49c8-b41e-68fda3e6aa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:17.449371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185537b-486b-49c8-b41e-68fda3e6aa9c admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.449653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185537b-486b-49c8-b41e-68fda3e6aa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.449938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1185537b-486b-49c8-b41e-68fda3e6aa9c admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.450639 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185537b-486b-49c8-b41e-68fda3e6aa9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:17.452565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1185537b-486b-49c8-b41e-68fda3e6aa9c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:17.579766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1306/2593] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:17 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:17.584684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11993b-32b3-4c7b-a29f-762caff6a467 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:17.596619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185537b-486b-49c8-b41e-68fda3e6aa9c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:17.599198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11993b-32b3-4c7b-a29f-762caff6a467 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:17.605587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773d267-0181-4ee3-acfa-b3a74f2e438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:17.609421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773d267-0181-4ee3-acfa-b3a74f2e438a admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.610522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773d267-0181-4ee3-acfa-b3a74f2e438a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.610822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773d267-0181-4ee3-acfa-b3a74f2e438a admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.611590 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773d267-0181-4ee3-acfa-b3a74f2e438a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:17.613285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773d267-0181-4ee3-acfa-b3a74f2e438a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:17.627107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1288/2594] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:17.628635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773d267-0181-4ee3-acfa-b3a74f2e438a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:17.638379 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773d267-0181-4ee3-acfa-b3a74f2e438a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:17.643501 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4c8a-752e-4748-a8a3-92a37b6666d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:17.644209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4c8a-752e-4748-a8a3-92a37b6666d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.644491 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4c8a-752e-4748-a8a3-92a37b6666d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.644766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b4c8a-752e-4748-a8a3-92a37b6666d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.645519 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b4c8a-752e-4748-a8a3-92a37b6666d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:17.647161 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b4c8a-752e-4748-a8a3-92a37b6666d5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:17.657736 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:17.661668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1289/2595] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:17.662919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1185537b-486b-49c8-b41e-68fda3e6aa9c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:17.663035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4c8a-752e-4748-a8a3-92a37b6666d5 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:17.665762 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462254df-17e7-4567-a397-cc53d527df63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:17.666410 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462254df-17e7-4567-a397-cc53d527df63 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.666696 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462254df-17e7-4567-a397-cc53d527df63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.666969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462254df-17e7-4567-a397-cc53d527df63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.668891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-462254df-17e7-4567-a397-cc53d527df63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:17.673549 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b4c8a-752e-4748-a8a3-92a37b6666d5 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:17.678404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fc6dc-2028-4d06-8a4f-fbab6e11b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:17.679345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fc6dc-2028-4d06-8a4f-fbab6e11b2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.679756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fc6dc-2028-4d06-8a4f-fbab6e11b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.679998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43fc6dc-2028-4d06-8a4f-fbab6e11b2bc admin admin] PATH_INFO: `/v3/projects/b4fd831100ca4415b18259b4787a778b/users/da3ba8a4c9c1478a876b3a7ab11d0d90/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.695078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fc6dc-2028-4d06-8a4f-fbab6e11b2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fd831100ca4415b18259b4787a778b, user_id=da3ba8a4c9c1478a876b3a7ab11d0d90, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:17.697746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43fc6dc-2028-4d06-8a4f-fbab6e11b2bc admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:17.728347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462254df-17e7-4567-a397-cc53d527df63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:17.729875 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462254df-17e7-4567-a397-cc53d527df63 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:17.739543 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1307/2596] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:17.800919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1290/2597] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:17 2022] PUT /identity/v3/projects/b4fd831100ca4415b18259b4787a778b/users/da3ba8a4c9c1478a876b3a7ab11d0d90/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:17.812247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917cd39-987c-4ca8-a12d-29c537526c98 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.812565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917cd39-987c-4ca8-a12d-29c537526c98 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.812898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b917cd39-987c-4ca8-a12d-29c537526c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.838816 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-b917cd39-987c-4ca8-a12d-29c537526c98 None None] MFA Rules not processed for user `da3ba8a4c9c1478a876b3a7ab11d0d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:17.840134 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b917cd39-987c-4ca8-a12d-29c537526c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:17.907083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1308/2598] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:17.918138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fc6dc-2028-4d06-8a4f-fbab6e11b2bc admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:17.919949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f43fc6dc-2028-4d06-8a4f-fbab6e11b2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:17.976227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43fc6dc-2028-4d06-8a4f-fbab6e11b2bc admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:17.980217 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb4e8f-2e5e-4622-ae79-cb7d36063277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:17.980909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb4e8f-2e5e-4622-ae79-cb7d36063277 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:17.981221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb4e8f-2e5e-4622-ae79-cb7d36063277 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:17.981498 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb4e8f-2e5e-4622-ae79-cb7d36063277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:17.990950 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb4e8f-2e5e-4622-ae79-cb7d36063277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:17.992428 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb4e8f-2e5e-4622-ae79-cb7d36063277 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:18.001924 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1291/2599] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:21.816243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917cd39-987c-4ca8-a12d-29c537526c98 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:21.817994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b917cd39-987c-4ca8-a12d-29c537526c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:21.898518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b917cd39-987c-4ca8-a12d-29c537526c98 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:21.903033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:21.904344 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:21.904623 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:21.904929 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] PATH_INFO: `/v3/users/cf801fa63f804a989d6c6246f591cea3` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:21.906180 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf801fa63f804a989d6c6246f591cea3)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:21.909453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:21.925018 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:22.156643 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf801fa63f804a989d6c6246f591cea3'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:22.173926 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf801fa63f804a989d6c6246f591cea3'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:22.247213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf801fa63f804a989d6c6246f591cea3'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:22.247879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf801fa63f804a989d6c6246f591cea3'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:22.248938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf801fa63f804a989d6c6246f591cea3'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:22.267126 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1309/2600] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:21 2022] DELETE /identity/v3/users/cf801fa63f804a989d6c6246f591cea3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:22.277868 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf1535-f41d-4d1f-b4f6-57a5ff973035 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:22.277868 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf1535-f41d-4d1f-b4f6-57a5ff973035 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:22.277868 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf1535-f41d-4d1f-b4f6-57a5ff973035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:22.290306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-fbbf1535-f41d-4d1f-b4f6-57a5ff973035 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:22.291661 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fbbf1535-f41d-4d1f-b4f6-57a5ff973035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:22.340436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:22.399756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1292/2601] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:22.413791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:22.415275 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:22.477993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eeee5-c0d5-41a9-bb15-e8045c1034f0 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:22.481624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e5842-9ab0-4dd9-bb39-bd1c12f1ddf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:22.482281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e5842-9ab0-4dd9-bb39-bd1c12f1ddf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:22.482564 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e5842-9ab0-4dd9-bb39-bd1c12f1ddf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:22.482844 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e5842-9ab0-4dd9-bb39-bd1c12f1ddf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:22.497218 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e5842-9ab0-4dd9-bb39-bd1c12f1ddf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:22.498692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e5842-9ab0-4dd9-bb39-bd1c12f1ddf1 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:22.510107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1310/2602] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:23.341195 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf1535-f41d-4d1f-b4f6-57a5ff973035 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:23.342616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fbbf1535-f41d-4d1f-b4f6-57a5ff973035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:23.359757 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf1535-f41d-4d1f-b4f6-57a5ff973035 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:23.366454 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:23.367562 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:23.367997 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:23.368324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] PATH_INFO: `/v3/projects/bc107a7c7a6f4b869d5603780a59c500` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:23.369918 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc107a7c7a6f4b869d5603780a59c500)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:23.372372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:23.517337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc107a7c7a6f4b869d5603780a59c500', 'request_id': 'req-1ef9ae29-e247-47be-aef8-739940d55fde'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:23.612697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc107a7c7a6f4b869d5603780a59c500', 'request_id': 'req-1ef9ae29-e247-47be-aef8-739940d55fde'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:23.619879 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc107a7c7a6f4b869d5603780a59c500', 'request_id': 'req-1ef9ae29-e247-47be-aef8-739940d55fde'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:23.630687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] The token cache is being invalidate because project bc107a7c7a6f4b869d5603780a59c500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:23.642339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:23.642339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:23.642339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1293/2603] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:23 2022] DELETE /identity/v3/projects/bc107a7c7a6f4b869d5603780a59c500 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:23.645010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e5842-9ab0-4dd9-bb39-bd1c12f1ddf1 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:23.654816 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e5842-9ab0-4dd9-bb39-bd1c12f1ddf1 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:23.720649 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70835456-7feb-4e52-8d6b-c7f8b152607e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:23.725376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835456-7feb-4e52-8d6b-c7f8b152607e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:23.725376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835456-7feb-4e52-8d6b-c7f8b152607e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:23.725376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835456-7feb-4e52-8d6b-c7f8b152607e admin admin] PATH_INFO: `/v3/users/86a42805119648389332868967c37abe` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:23.725376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70835456-7feb-4e52-8d6b-c7f8b152607e admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a42805119648389332868967c37abe)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:23.726124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70835456-7feb-4e52-8d6b-c7f8b152607e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:23.978455 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:23.986617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-70835456-7feb-4e52-8d6b-c7f8b152607e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a42805119648389332868967c37abe'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:23.998347 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-70835456-7feb-4e52-8d6b-c7f8b152607e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a42805119648389332868967c37abe'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:24.065127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-70835456-7feb-4e52-8d6b-c7f8b152607e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a42805119648389332868967c37abe'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:24.065776 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-70835456-7feb-4e52-8d6b-c7f8b152607e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a42805119648389332868967c37abe'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:24.066394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-70835456-7feb-4e52-8d6b-c7f8b152607e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a42805119648389332868967c37abe'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:24.079841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1311/2604] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:23 2022] DELETE /identity/v3/users/86a42805119648389332868967c37abe => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:24.524949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:24.524949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:24.537516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9ae29-e247-47be-aef8-739940d55fde admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:24.603175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cd84c-e14f-4691-aaf7-e4984d7f894d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:24.604028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cd84c-e14f-4691-aaf7-e4984d7f894d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:24.604310 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cd84c-e14f-4691-aaf7-e4984d7f894d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:24.604587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cd84c-e14f-4691-aaf7-e4984d7f894d admin admin] PATH_INFO: `/v3/projects/5539791ddf844cada47e6a2b21d8f5ac` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:24.605802 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cd84c-e14f-4691-aaf7-e4984d7f894d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5539791ddf844cada47e6a2b21d8f5ac)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:24.607690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cd84c-e14f-4691-aaf7-e4984d7f894d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:24.743421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-683cd84c-e14f-4691-aaf7-e4984d7f894d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5539791ddf844cada47e6a2b21d8f5ac', 'request_id': 'req-683cd84c-e14f-4691-aaf7-e4984d7f894d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:24.875931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-683cd84c-e14f-4691-aaf7-e4984d7f894d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5539791ddf844cada47e6a2b21d8f5ac', 'request_id': 'req-683cd84c-e14f-4691-aaf7-e4984d7f894d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:24.883073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-683cd84c-e14f-4691-aaf7-e4984d7f894d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5539791ddf844cada47e6a2b21d8f5ac', 'request_id': 'req-683cd84c-e14f-4691-aaf7-e4984d7f894d'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:24.884540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:24.898493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-683cd84c-e14f-4691-aaf7-e4984d7f894d admin admin] The token cache is being invalidate because project 5539791ddf844cada47e6a2b21d8f5ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:24.903072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-683cd84c-e14f-4691-aaf7-e4984d7f894d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:24.903072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-683cd84c-e14f-4691-aaf7-e4984d7f894d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:24.903072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1294/2605] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:24 2022] DELETE /identity/v3/projects/5539791ddf844cada47e6a2b21d8f5ac => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:24.906362 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f279a7-28fb-4af0-87c8-9831ff6ca3e4 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:24.906829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f279a7-28fb-4af0-87c8-9831ff6ca3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:24.906933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f279a7-28fb-4af0-87c8-9831ff6ca3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:24.925520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-90f279a7-28fb-4af0-87c8-9831ff6ca3e4 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:24.926712 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-90f279a7-28fb-4af0-87c8-9831ff6ca3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:24.994167 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1312/2606] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:25.001893 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97c92f-3b13-40a6-a667-45b62635fbfc None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:25.002173 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97c92f-3b13-40a6-a667-45b62635fbfc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:25.002450 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97c92f-3b13-40a6-a667-45b62635fbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:25.021348 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-cc97c92f-3b13-40a6-a667-45b62635fbfc None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:25.023655 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-cc97c92f-3b13-40a6-a667-45b62635fbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:25.036091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1295/2607] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:25.040494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f279a7-28fb-4af0-87c8-9831ff6ca3e4 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:25.050158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f279a7-28fb-4af0-87c8-9831ff6ca3e4 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:25.054635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5fdc4-f057-4cb3-aeb3-da570b3e40d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:25.055330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5fdc4-f057-4cb3-aeb3-da570b3e40d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:25.055610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5fdc4-f057-4cb3-aeb3-da570b3e40d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:25.055883 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5fdc4-f057-4cb3-aeb3-da570b3e40d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:25.056629 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5fdc4-f057-4cb3-aeb3-da570b3e40d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:25.056976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5fdc4-f057-4cb3-aeb3-da570b3e40d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:25.058759 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5fdc4-f057-4cb3-aeb3-da570b3e40d8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:25.071109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1313/2608] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:19:25.075475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97c92f-3b13-40a6-a667-45b62635fbfc None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:25.085328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97c92f-3b13-40a6-a667-45b62635fbfc None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:25.090177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d969ffc-c105-48d6-8596-6e1bf5119aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:25.090825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d969ffc-c105-48d6-8596-6e1bf5119aca admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:25.091111 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d969ffc-c105-48d6-8596-6e1bf5119aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:25.091417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d969ffc-c105-48d6-8596-6e1bf5119aca admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:25.092118 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d969ffc-c105-48d6-8596-6e1bf5119aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:25.094042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d969ffc-c105-48d6-8596-6e1bf5119aca admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:25.167663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5fdc4-f057-4cb3-aeb3-da570b3e40d8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:25.170169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cef5fdc4-f057-4cb3-aeb3-da570b3e40d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:25.183325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5fdc4-f057-4cb3-aeb3-da570b3e40d8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:25.188058 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360d522-e855-4ab9-b5df-2a60848fd8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:25.189632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360d522-e855-4ab9-b5df-2a60848fd8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:25.189632 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360d522-e855-4ab9-b5df-2a60848fd8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:25.190076 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360d522-e855-4ab9-b5df-2a60848fd8c1 admin admin] PATH_INFO: `/v3/users/7d79b5646135447c9f7bc92044085c91` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:25.191280 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360d522-e855-4ab9-b5df-2a60848fd8c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d79b5646135447c9f7bc92044085c91)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:25.193250 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360d522-e855-4ab9-b5df-2a60848fd8c1 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:25.198746 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1296/2609] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:25 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:25.202618 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d969ffc-c105-48d6-8596-6e1bf5119aca admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:25.264672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d969ffc-c105-48d6-8596-6e1bf5119aca admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:25.270094 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b601e4-1983-44a7-b0b7-2dec6aa9ace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:25.270768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b601e4-1983-44a7-b0b7-2dec6aa9ace2 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:25.271060 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b601e4-1983-44a7-b0b7-2dec6aa9ace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:25.271369 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b601e4-1983-44a7-b0b7-2dec6aa9ace2 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:25.272067 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b601e4-1983-44a7-b0b7-2dec6aa9ace2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:25.274029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b601e4-1983-44a7-b0b7-2dec6aa9ace2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:25.405513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1297/2610] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:25 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:25.408454 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b601e4-1983-44a7-b0b7-2dec6aa9ace2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:25.412671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4360d522-e855-4ab9-b5df-2a60848fd8c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d79b5646135447c9f7bc92044085c91'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:25.419788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b601e4-1983-44a7-b0b7-2dec6aa9ace2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:25.424967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043fe1a-51f7-439e-bfd2-c2444ab8cbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:25.425721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043fe1a-51f7-439e-bfd2-c2444ab8cbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:25.425954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043fe1a-51f7-439e-bfd2-c2444ab8cbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:25.426188 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043fe1a-51f7-439e-bfd2-c2444ab8cbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:25.426931 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043fe1a-51f7-439e-bfd2-c2444ab8cbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:25.428546 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043fe1a-51f7-439e-bfd2-c2444ab8cbc6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:25.437331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4360d522-e855-4ab9-b5df-2a60848fd8c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d79b5646135447c9f7bc92044085c91'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:25.440059 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1298/2611] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:25.443195 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043fe1a-51f7-439e-bfd2-c2444ab8cbc6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:25.453048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043fe1a-51f7-439e-bfd2-c2444ab8cbc6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:25.458317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fe000-de01-4e85-86e7-a008cd8d9391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:25.458973 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fe000-de01-4e85-86e7-a008cd8d9391 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:25.463896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fe000-de01-4e85-86e7-a008cd8d9391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:25.463896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fe000-de01-4e85-86e7-a008cd8d9391 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:25.463896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fe000-de01-4e85-86e7-a008cd8d9391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:25.463896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fe000-de01-4e85-86e7-a008cd8d9391 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:25.473267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1299/2612] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:25.477024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fe000-de01-4e85-86e7-a008cd8d9391 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:25.488322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fe000-de01-4e85-86e7-a008cd8d9391 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:25.493081 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981be69-686f-447c-87e7-0cb165860b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:25.493976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981be69-686f-447c-87e7-0cb165860b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:25.494274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981be69-686f-447c-87e7-0cb165860b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:25.494537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981be69-686f-447c-87e7-0cb165860b35 admin admin] PATH_INFO: `/v3/projects/e66ddd15e9b247d5b00cb9b6ed1dc60d/users/53ba16cdd85b4d1589955c616649fc37/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:25.520932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981be69-686f-447c-87e7-0cb165860b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66ddd15e9b247d5b00cb9b6ed1dc60d, user_id=53ba16cdd85b4d1589955c616649fc37, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:25.523716 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981be69-686f-447c-87e7-0cb165860b35 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:25.538153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4360d522-e855-4ab9-b5df-2a60848fd8c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d79b5646135447c9f7bc92044085c91'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:25.538788 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4360d522-e855-4ab9-b5df-2a60848fd8c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d79b5646135447c9f7bc92044085c91'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:25.539396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-4360d522-e855-4ab9-b5df-2a60848fd8c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d79b5646135447c9f7bc92044085c91'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:25.552560 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1314/2613] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:25 2022] DELETE /identity/v3/users/7d79b5646135447c9f7bc92044085c91 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:25.556955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c95a4-096b-4ace-8d75-9013a1c86f8f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:25.557247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c95a4-096b-4ace-8d75-9013a1c86f8f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:25.557527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c95a4-096b-4ace-8d75-9013a1c86f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:25.576512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-161c95a4-096b-4ace-8d75-9013a1c86f8f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:25.577764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-161c95a4-096b-4ace-8d75-9013a1c86f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:25.586316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:25.636839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1300/2614] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:25 2022] PUT /identity/v3/projects/e66ddd15e9b247d5b00cb9b6ed1dc60d/users/53ba16cdd85b4d1589955c616649fc37/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:25.639676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1315/2615] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:25.650340 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebb026-e56c-4f8e-93ef-941aa8ab4690 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:25.650636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebb026-e56c-4f8e-93ef-941aa8ab4690 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:25.651524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ebb026-e56c-4f8e-93ef-941aa8ab4690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:25.652140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981be69-686f-447c-87e7-0cb165860b35 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:25.654266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6981be69-686f-447c-87e7-0cb165860b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:25.680546 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-c3ebb026-e56c-4f8e-93ef-941aa8ab4690 None None] MFA Rules not processed for user `53ba16cdd85b4d1589955c616649fc37`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:25.681707 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c3ebb026-e56c-4f8e-93ef-941aa8ab4690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:25.717091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981be69-686f-447c-87e7-0cb165860b35 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:25.721191 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfeb07d-cedb-4842-b194-80531cc67819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:25.721847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb07d-cedb-4842-b194-80531cc67819 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:25.722125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb07d-cedb-4842-b194-80531cc67819 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:25.722405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfeb07d-cedb-4842-b194-80531cc67819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:25.740544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:25.746177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1316/2616] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:25.750756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebb026-e56c-4f8e-93ef-941aa8ab4690 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:25.753581 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c3ebb026-e56c-4f8e-93ef-941aa8ab4690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:25.788992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfeb07d-cedb-4842-b194-80531cc67819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:25.790790 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfeb07d-cedb-4842-b194-80531cc67819 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:25.802722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1301/2617] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:25.826001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ebb026-e56c-4f8e-93ef-941aa8ab4690 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:25.831631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbf0cc-9f5e-4027-b7b1-7f2480f544a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:25.832329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbf0cc-9f5e-4027-b7b1-7f2480f544a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:25.832609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbf0cc-9f5e-4027-b7b1-7f2480f544a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:25.833093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbf0cc-9f5e-4027-b7b1-7f2480f544a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:25.833794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbf0cc-9f5e-4027-b7b1-7f2480f544a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:25.835729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbf0cc-9f5e-4027-b7b1-7f2480f544a8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:25.955514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1317/2618] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:25 2022] POST /identity/v3/projects => generated 387 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:25.959559 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfeb07d-cedb-4842-b194-80531cc67819 service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:25.969478 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfeb07d-cedb-4842-b194-80531cc67819 service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:26.029528 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c37e41-f6f2-4ac3-94d1-a7b1da44b6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:26.030196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c37e41-f6f2-4ac3-94d1-a7b1da44b6d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:26.030482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c37e41-f6f2-4ac3-94d1-a7b1da44b6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:26.030759 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c37e41-f6f2-4ac3-94d1-a7b1da44b6d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:26.031472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c37e41-f6f2-4ac3-94d1-a7b1da44b6d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:26.034088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c37e41-f6f2-4ac3-94d1-a7b1da44b6d9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:26.146784 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1302/2619] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:25 2022] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:26.149718 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbf0cc-9f5e-4027-b7b1-7f2480f544a8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:26.161190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbf0cc-9f5e-4027-b7b1-7f2480f544a8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:26.165955 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7733ecb-01b9-4b8e-aa14-c1d9ece3079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:26.166774 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7733ecb-01b9-4b8e-aa14-c1d9ece3079e admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:26.167189 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7733ecb-01b9-4b8e-aa14-c1d9ece3079e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:26.168074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7733ecb-01b9-4b8e-aa14-c1d9ece3079e admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:26.168919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7733ecb-01b9-4b8e-aa14-c1d9ece3079e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:26.171770 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7733ecb-01b9-4b8e-aa14-c1d9ece3079e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:26.185433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1318/2620] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:26.189640 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c37e41-f6f2-4ac3-94d1-a7b1da44b6d9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:26.199917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c37e41-f6f2-4ac3-94d1-a7b1da44b6d9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:26.205098 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa579a-c4fc-4ae1-b0d5-3eeab18e8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:26.205774 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa579a-c4fc-4ae1-b0d5-3eeab18e8dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:26.205986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa579a-c4fc-4ae1-b0d5-3eeab18e8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:26.206262 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa579a-c4fc-4ae1-b0d5-3eeab18e8dcb admin admin] PATH_INFO: `/v3/projects/4199b76d451b4ca0944a3793b78a00dd/users/079df84ab05247f180d5fa3df465b076/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:26.221634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa579a-c4fc-4ae1-b0d5-3eeab18e8dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4199b76d451b4ca0944a3793b78a00dd, user_id=079df84ab05247f180d5fa3df465b076, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:26.224712 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa579a-c4fc-4ae1-b0d5-3eeab18e8dcb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:26.355337 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7733ecb-01b9-4b8e-aa14-c1d9ece3079e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:26.357767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e7733ecb-01b9-4b8e-aa14-c1d9ece3079e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:26.360382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1303/2621] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:26 2022] PUT /identity/v3/projects/4199b76d451b4ca0944a3793b78a00dd/users/079df84ab05247f180d5fa3df465b076/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:26.364751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa579a-c4fc-4ae1-b0d5-3eeab18e8dcb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:26.374253 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7733ecb-01b9-4b8e-aa14-c1d9ece3079e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:26.390060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:26.444346 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:26.445810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:26.446302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:26.446898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] PATH_INFO: `/v3/projects/9a600237f7944954bbce89a064a8252e` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:26.448864 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a600237f7944954bbce89a064a8252e)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:26.451444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:26.474698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa579a-c4fc-4ae1-b0d5-3eeab18e8dcb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:26.482625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9024e0-d0f9-4836-9512-7d174446ca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:26.482625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9024e0-d0f9-4836-9512-7d174446ca0a admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:26.482625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9024e0-d0f9-4836-9512-7d174446ca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:26.482625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9024e0-d0f9-4836-9512-7d174446ca0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:26.483470 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9024e0-d0f9-4836-9512-7d174446ca0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:26.484160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9024e0-d0f9-4836-9512-7d174446ca0a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:26.500110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1304/2622] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:26.502498 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9024e0-d0f9-4836-9512-7d174446ca0a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:26.517656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9024e0-d0f9-4836-9512-7d174446ca0a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:26.522496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622686a-5a78-4f6c-ba68-adc039d195f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:26.523382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622686a-5a78-4f6c-ba68-adc039d195f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:26.523669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622686a-5a78-4f6c-ba68-adc039d195f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:26.523949 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622686a-5a78-4f6c-ba68-adc039d195f0 admin admin] PATH_INFO: `/v3/projects/4199b76d451b4ca0944a3793b78a00dd/users/079df84ab05247f180d5fa3df465b076/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:26.528773 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622686a-5a78-4f6c-ba68-adc039d195f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4199b76d451b4ca0944a3793b78a00dd, user_id=079df84ab05247f180d5fa3df465b076, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:26.531721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6622686a-5a78-4f6c-ba68-adc039d195f0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:26.543117 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1305/2623] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:26 2022] PUT /identity/v3/projects/4199b76d451b4ca0944a3793b78a00dd/users/079df84ab05247f180d5fa3df465b076/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:26.554405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f14bd8-e9f2-475f-958a-376eaa27c423 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:26.557965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f14bd8-e9f2-475f-958a-376eaa27c423 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:26.557965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f14bd8-e9f2-475f-958a-376eaa27c423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:26.562720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:26.602061 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-40f14bd8-e9f2-475f-958a-376eaa27c423 None None] MFA Rules not processed for user `079df84ab05247f180d5fa3df465b076`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:26.603607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-40f14bd8-e9f2-475f-958a-376eaa27c423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:26.630796 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a600237f7944954bbce89a064a8252e', 'request_id': 'req-43973d49-9fae-40dd-a6b0-e9763f827068'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:26.686752 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1306/2624] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:26.694673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f14bd8-e9f2-475f-958a-376eaa27c423 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:26.696740 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-40f14bd8-e9f2-475f-958a-376eaa27c423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:26.697289 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a600237f7944954bbce89a064a8252e', 'request_id': 'req-43973d49-9fae-40dd-a6b0-e9763f827068'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:26.707553 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a600237f7944954bbce89a064a8252e', 'request_id': 'req-43973d49-9fae-40dd-a6b0-e9763f827068'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:26.738904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] The token cache is being invalidate because project 9a600237f7944954bbce89a064a8252e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:26.739433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:26.740539 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:26.747285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1319/2625] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:26 2022] DELETE /identity/v3/projects/9a600237f7944954bbce89a064a8252e => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:26.748508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:26.750382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:26.779934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f14bd8-e9f2-475f-958a-376eaa27c423 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:26.784871 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923925ac-3c5a-4cc0-8605-18567ee58312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:26.785761 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923925ac-3c5a-4cc0-8605-18567ee58312 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:26.786122 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923925ac-3c5a-4cc0-8605-18567ee58312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:26.786504 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923925ac-3c5a-4cc0-8605-18567ee58312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:26.788495 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-923925ac-3c5a-4cc0-8605-18567ee58312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:26.802235 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923925ac-3c5a-4cc0-8605-18567ee58312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:26.804038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923925ac-3c5a-4cc0-8605-18567ee58312 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:26.818154 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1307/2626] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:26.844852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43973d49-9fae-40dd-a6b0-e9763f827068 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:26.865344 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2c8493-783f-4020-b0d9-9466261eec4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:26.865344 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c8493-783f-4020-b0d9-9466261eec4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:26.865344 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c8493-783f-4020-b0d9-9466261eec4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:26.865344 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2c8493-783f-4020-b0d9-9466261eec4b admin admin] PATH_INFO: `/v3/users/855779f0569b4266acb77cab60ee651d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:26.873534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c8493-783f-4020-b0d9-9466261eec4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=855779f0569b4266acb77cab60ee651d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:26.877310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2c8493-783f-4020-b0d9-9466261eec4b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:26.901134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923925ac-3c5a-4cc0-8605-18567ee58312 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:26.902620 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-923925ac-3c5a-4cc0-8605-18567ee58312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:26.920486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923925ac-3c5a-4cc0-8605-18567ee58312 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:26.922185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:26.923068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:26.923904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:26.924193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] PATH_INFO: `/v3/users/53ba16cdd85b4d1589955c616649fc37` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:26.925531 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ba16cdd85b4d1589955c616649fc37)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:26.927440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:27.156470 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-2d2c8493-783f-4020-b0d9-9466261eec4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855779f0569b4266acb77cab60ee651d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:27.158503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:27.171345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-2d2c8493-783f-4020-b0d9-9466261eec4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855779f0569b4266acb77cab60ee651d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:27.199131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ba16cdd85b4d1589955c616649fc37'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:27.199131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ba16cdd85b4d1589955c616649fc37'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:27.271884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-2d2c8493-783f-4020-b0d9-9466261eec4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855779f0569b4266acb77cab60ee651d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:27.272530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-2d2c8493-783f-4020-b0d9-9466261eec4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855779f0569b4266acb77cab60ee651d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:27.273175 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-2d2c8493-783f-4020-b0d9-9466261eec4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855779f0569b4266acb77cab60ee651d'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:27.287446 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1320/2627] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:26 2022] DELETE /identity/v3/users/855779f0569b4266acb77cab60ee651d => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:27.348748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ba16cdd85b4d1589955c616649fc37'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:27.349457 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ba16cdd85b4d1589955c616649fc37'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:27.350084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ba16cdd85b4d1589955c616649fc37'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:27.363942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1308/2628] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:26 2022] DELETE /identity/v3/users/53ba16cdd85b4d1589955c616649fc37 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:27.368551 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36d586-5b49-46bc-b713-009ef5eecd58 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:27.368872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36d586-5b49-46bc-b713-009ef5eecd58 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:27.369158 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36d586-5b49-46bc-b713-009ef5eecd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:27.391321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-ef36d586-5b49-46bc-b713-009ef5eecd58 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:27.392621 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ef36d586-5b49-46bc-b713-009ef5eecd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:27.452396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1321/2629] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:27.462372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:27.463919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:27.471339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:27.557393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ebe603-78bc-4e31-b41c-cec3703920b7 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:27.557393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54050a22-e28c-4038-8bc6-c75be744cd02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:27.557393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54050a22-e28c-4038-8bc6-c75be744cd02 service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:27.557393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54050a22-e28c-4038-8bc6-c75be744cd02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:27.558416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54050a22-e28c-4038-8bc6-c75be744cd02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:27.558416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54050a22-e28c-4038-8bc6-c75be744cd02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:27.558416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54050a22-e28c-4038-8bc6-c75be744cd02 service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:27.563013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1309/2630] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:27.824754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36d586-5b49-46bc-b713-009ef5eecd58 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:27.826454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-ef36d586-5b49-46bc-b713-009ef5eecd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:27.840313 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36d586-5b49-46bc-b713-009ef5eecd58 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:27.846830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:27.847946 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:27.848343 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:27.848782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] PATH_INFO: `/v3/projects/d8c6262515584ff5b2293052318900b5` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:27.850185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c6262515584ff5b2293052318900b5)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:27.856254 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:28.002466 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c6262515584ff5b2293052318900b5', 'request_id': 'req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.121245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c6262515584ff5b2293052318900b5', 'request_id': 'req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.129086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c6262515584ff5b2293052318900b5', 'request_id': 'req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.139389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] The token cache is being invalidate because project d8c6262515584ff5b2293052318900b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:28.139675 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.140342 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.142597 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1322/2631] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:27 2022] DELETE /identity/v3/projects/d8c6262515584ff5b2293052318900b5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:28.147599 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510cb23-f8a6-4ebb-aaf9-e4e21c0867bc None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:28.148088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510cb23-f8a6-4ebb-aaf9-e4e21c0867bc None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:28.148471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510cb23-f8a6-4ebb-aaf9-e4e21c0867bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:28.158656 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:28.161686 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:28.172873 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e510cb23-f8a6-4ebb-aaf9-e4e21c0867bc None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:28.174550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e510cb23-f8a6-4ebb-aaf9-e4e21c0867bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:28.221395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:28.235018 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c8f54-ee2a-48ba-b676-ba6d623dfb95 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:28.240459 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:28.241374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:28.241653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:28.241925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] PATH_INFO: `/v3/projects/e66ddd15e9b247d5b00cb9b6ed1dc60d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:28.243129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66ddd15e9b247d5b00cb9b6ed1dc60d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:28.244855 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1310/2632] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:28.245073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:28.253553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef174395-799c-49bc-b607-86735742ff69 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:28.253845 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef174395-799c-49bc-b607-86735742ff69 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:28.254126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef174395-799c-49bc-b607-86735742ff69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:28.278807 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-ef174395-799c-49bc-b607-86735742ff69 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:28.278807 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-ef174395-799c-49bc-b607-86735742ff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:28.286702 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1311/2633] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:28.290920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef174395-799c-49bc-b607-86735742ff69 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:28.307304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef174395-799c-49bc-b607-86735742ff69 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:28.307304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521c9b1-2d29-4a0c-8d9d-4ad8b97cd4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:28.307304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521c9b1-2d29-4a0c-8d9d-4ad8b97cd4eb admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:28.307304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521c9b1-2d29-4a0c-8d9d-4ad8b97cd4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:28.307736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521c9b1-2d29-4a0c-8d9d-4ad8b97cd4eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:28.307736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521c9b1-2d29-4a0c-8d9d-4ad8b97cd4eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:28.307736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521c9b1-2d29-4a0c-8d9d-4ad8b97cd4eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:28.309355 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521c9b1-2d29-4a0c-8d9d-4ad8b97cd4eb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:28.321820 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1312/2634] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:19:28.326082 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521c9b1-2d29-4a0c-8d9d-4ad8b97cd4eb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:28.336566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521c9b1-2d29-4a0c-8d9d-4ad8b97cd4eb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:28.341195 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce72fa-af7c-4f5c-8833-a61181b64596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:28.341846 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce72fa-af7c-4f5c-8833-a61181b64596 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:28.342130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce72fa-af7c-4f5c-8833-a61181b64596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:28.342463 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce72fa-af7c-4f5c-8833-a61181b64596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:28.343120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce72fa-af7c-4f5c-8833-a61181b64596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:28.345636 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce72fa-af7c-4f5c-8833-a61181b64596 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:28.377642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66ddd15e9b247d5b00cb9b6ed1dc60d', 'request_id': 'req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.442292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1313/2635] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:28 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:28.449689 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce72fa-af7c-4f5c-8833-a61181b64596 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:28.468985 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66ddd15e9b247d5b00cb9b6ed1dc60d', 'request_id': 'req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.477198 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66ddd15e9b247d5b00cb9b6ed1dc60d', 'request_id': 'req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.493368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] The token cache is being invalidate because project e66ddd15e9b247d5b00cb9b6ed1dc60d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:28.493749 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.494472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.496151 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1323/2636] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:28 2022] DELETE /identity/v3/projects/e66ddd15e9b247d5b00cb9b6ed1dc60d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:28.500012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:28.501980 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:28.510703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce72fa-af7c-4f5c-8833-a61181b64596 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:28.515349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e69568-e188-4997-98f7-aecc8a9c7b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:28.516013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e69568-e188-4997-98f7-aecc8a9c7b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:28.516296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e69568-e188-4997-98f7-aecc8a9c7b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:28.516571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e69568-e188-4997-98f7-aecc8a9c7b83 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:28.517887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e69568-e188-4997-98f7-aecc8a9c7b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:28.519841 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e69568-e188-4997-98f7-aecc8a9c7b83 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:28.528407 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:28.566671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c55201-ee95-4afa-a4bb-d84cf9e4d9f9 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:28.571461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:28.572296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:28.572575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:28.572895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] PATH_INFO: `/v3/users/079df84ab05247f180d5fa3df465b076` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:28.574105 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=079df84ab05247f180d5fa3df465b076)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:28.576016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:28.649017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1314/2637] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:28 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:28.652145 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e69568-e188-4997-98f7-aecc8a9c7b83 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:28.654058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-55e69568-e188-4997-98f7-aecc8a9c7b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:28.667354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e69568-e188-4997-98f7-aecc8a9c7b83 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:28.672186 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af126f-d7e3-4313-a629-401aadd9524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:28.672876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af126f-d7e3-4313-a629-401aadd9524b admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:28.673392 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af126f-d7e3-4313-a629-401aadd9524b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:28.673907 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af126f-d7e3-4313-a629-401aadd9524b admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:28.674537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af126f-d7e3-4313-a629-401aadd9524b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:28.676147 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af126f-d7e3-4313-a629-401aadd9524b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:28.686998 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1315/2638] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:28.690600 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af126f-d7e3-4313-a629-401aadd9524b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:28.700463 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af126f-d7e3-4313-a629-401aadd9524b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:28.706293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c68a05-848d-48b2-92e9-37ca085628fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:28.707187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c68a05-848d-48b2-92e9-37ca085628fb admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:28.707473 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c68a05-848d-48b2-92e9-37ca085628fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:28.707754 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c68a05-848d-48b2-92e9-37ca085628fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:28.708484 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c68a05-848d-48b2-92e9-37ca085628fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:28.710119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c68a05-848d-48b2-92e9-37ca085628fb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:28.725806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1316/2639] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:28.729872 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c68a05-848d-48b2-92e9-37ca085628fb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:28.740329 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c68a05-848d-48b2-92e9-37ca085628fb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:28.745220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743099ff-5075-41a1-a193-ebcf1844175e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:28.746142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743099ff-5075-41a1-a193-ebcf1844175e admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:28.746425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743099ff-5075-41a1-a193-ebcf1844175e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:28.746700 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743099ff-5075-41a1-a193-ebcf1844175e admin admin] PATH_INFO: `/v3/projects/366f618a9a564367b923627312e88300/users/d88b3280788f4c66b7f7351badee6ad1/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:28.762219 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743099ff-5075-41a1-a193-ebcf1844175e admin admin] RBAC: Authorizing `identity:create_grant(project_id=366f618a9a564367b923627312e88300, user_id=d88b3280788f4c66b7f7351badee6ad1, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:28.764882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743099ff-5075-41a1-a193-ebcf1844175e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:28.849519 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '079df84ab05247f180d5fa3df465b076'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.861727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '079df84ab05247f180d5fa3df465b076'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.875925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1317/2640] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:28 2022] PUT /identity/v3/projects/366f618a9a564367b923627312e88300/users/d88b3280788f4c66b7f7351badee6ad1/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:28.888044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e6347-6b6b-4cdd-a8d5-150315fc3f5f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:28.888334 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e6347-6b6b-4cdd-a8d5-150315fc3f5f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:28.888616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e6347-6b6b-4cdd-a8d5-150315fc3f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:28.918563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-399e6347-6b6b-4cdd-a8d5-150315fc3f5f None None] MFA Rules not processed for user `d88b3280788f4c66b7f7351badee6ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:28.920172 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-399e6347-6b6b-4cdd-a8d5-150315fc3f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:28.978427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '079df84ab05247f180d5fa3df465b076'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.983633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '079df84ab05247f180d5fa3df465b076'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.983633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '079df84ab05247f180d5fa3df465b076'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:28.988775 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1318/2641] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:28.993139 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e6347-6b6b-4cdd-a8d5-150315fc3f5f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:29.004778 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1324/2642] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:28 2022] DELETE /identity/v3/users/079df84ab05247f180d5fa3df465b076 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:29.057763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e6347-6b6b-4cdd-a8d5-150315fc3f5f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:29.116051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b92f24-c6c0-4b24-93e4-0479df38ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:29.116813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b92f24-c6c0-4b24-93e4-0479df38ac5e admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:29.117183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b92f24-c6c0-4b24-93e4-0479df38ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:29.117656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b92f24-c6c0-4b24-93e4-0479df38ac5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:29.118505 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b92f24-c6c0-4b24-93e4-0479df38ac5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:29.120554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b92f24-c6c0-4b24-93e4-0479df38ac5e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:29.148687 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:29.234893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:29.243464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1319/2643] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:28 2022] POST /identity/v3/projects => generated 391 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:29.247506 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:29.252928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:29.269915 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e88713-10f0-4de2-85a2-0b10ecc9ce7f admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:29.346468 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b08e9c-c440-485a-b2ea-a843ce1bb89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:29.347249 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b08e9c-c440-485a-b2ea-a843ce1bb89e admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:29.347384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b08e9c-c440-485a-b2ea-a843ce1bb89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:29.347603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b08e9c-c440-485a-b2ea-a843ce1bb89e admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:29.348504 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b08e9c-c440-485a-b2ea-a843ce1bb89e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:29.350878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b08e9c-c440-485a-b2ea-a843ce1bb89e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:29.437895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1325/2644] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:29 2022] POST /identity/v3/users => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:29.442834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b92f24-c6c0-4b24-93e4-0479df38ac5e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:29.453493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b92f24-c6c0-4b24-93e4-0479df38ac5e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:29.458955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a780270-d593-47db-ad4c-19f4b59c123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:29.459626 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a780270-d593-47db-ad4c-19f4b59c123d admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:29.459909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a780270-d593-47db-ad4c-19f4b59c123d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:29.460187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a780270-d593-47db-ad4c-19f4b59c123d admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:29.460979 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a780270-d593-47db-ad4c-19f4b59c123d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:29.462697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a780270-d593-47db-ad4c-19f4b59c123d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:29.473799 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1320/2645] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:29.478002 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b08e9c-c440-485a-b2ea-a843ce1bb89e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:29.488991 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b08e9c-c440-485a-b2ea-a843ce1bb89e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:29.493679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fcef9-0e18-43b2-9352-094c91c4a87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:29.494557 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fcef9-0e18-43b2-9352-094c91c4a87b admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:29.494840 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fcef9-0e18-43b2-9352-094c91c4a87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:29.495115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fcef9-0e18-43b2-9352-094c91c4a87b admin admin] PATH_INFO: `/v3/projects/8986d55f9be24a76949594698be8d38d/users/2d4b9a00dbd846c18766bd299a02eaef/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:29.510756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fcef9-0e18-43b2-9352-094c91c4a87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8986d55f9be24a76949594698be8d38d, user_id=2d4b9a00dbd846c18766bd299a02eaef, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:29.513441 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fcef9-0e18-43b2-9352-094c91c4a87b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:29.568610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a780270-d593-47db-ad4c-19f4b59c123d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:29.570588 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6a780270-d593-47db-ad4c-19f4b59c123d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:29.586446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a780270-d593-47db-ad4c-19f4b59c123d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:29.591449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac7075-7be4-49cc-8929-ec63bee13ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:29.592467 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac7075-7be4-49cc-8929-ec63bee13ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:29.593301 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac7075-7be4-49cc-8929-ec63bee13ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:29.593594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac7075-7be4-49cc-8929-ec63bee13ef9 admin admin] PATH_INFO: `/v3/projects/4199b76d451b4ca0944a3793b78a00dd` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:29.595218 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac7075-7be4-49cc-8929-ec63bee13ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4199b76d451b4ca0944a3793b78a00dd)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:29.597089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ac7075-7be4-49cc-8929-ec63bee13ef9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:29.636241 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1326/2646] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:29 2022] PUT /identity/v3/projects/8986d55f9be24a76949594698be8d38d/users/2d4b9a00dbd846c18766bd299a02eaef/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:29.639809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fcef9-0e18-43b2-9352-094c91c4a87b admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:29.702447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fcef9-0e18-43b2-9352-094c91c4a87b admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:29.707427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c8fb4-90fa-4670-8c9b-6fb75562e294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:29.708091 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c8fb4-90fa-4670-8c9b-6fb75562e294 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:29.708376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c8fb4-90fa-4670-8c9b-6fb75562e294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:29.708652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c8fb4-90fa-4670-8c9b-6fb75562e294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:29.709418 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c8fb4-90fa-4670-8c9b-6fb75562e294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:29.711031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c8fb4-90fa-4670-8c9b-6fb75562e294 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:29.723873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1327/2647] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:29.727949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c8fb4-90fa-4670-8c9b-6fb75562e294 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:29.739247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c8fb4-90fa-4670-8c9b-6fb75562e294 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:29.739690 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-86ac7075-7be4-49cc-8929-ec63bee13ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4199b76d451b4ca0944a3793b78a00dd', 'request_id': 'req-86ac7075-7be4-49cc-8929-ec63bee13ef9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:29.797214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbce96c-b5ae-4179-a785-30c3e89aacf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:29.798760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbce96c-b5ae-4179-a785-30c3e89aacf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:29.799045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbce96c-b5ae-4179-a785-30c3e89aacf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:29.799321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbce96c-b5ae-4179-a785-30c3e89aacf6 admin admin] PATH_INFO: `/v3/projects/8986d55f9be24a76949594698be8d38d/users/2d4b9a00dbd846c18766bd299a02eaef/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:29.801407 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbce96c-b5ae-4179-a785-30c3e89aacf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8986d55f9be24a76949594698be8d38d, user_id=2d4b9a00dbd846c18766bd299a02eaef, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:29.804227 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbce96c-b5ae-4179-a785-30c3e89aacf6 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:29.814961 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1328/2648] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:29 2022] PUT /identity/v3/projects/8986d55f9be24a76949594698be8d38d/users/2d4b9a00dbd846c18766bd299a02eaef/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:29.824953 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f753e3-f93f-4576-a818-039313b355d5 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:29.825243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f753e3-f93f-4576-a818-039313b355d5 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:29.825517 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f753e3-f93f-4576-a818-039313b355d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:29.829831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-86ac7075-7be4-49cc-8929-ec63bee13ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4199b76d451b4ca0944a3793b78a00dd', 'request_id': 'req-86ac7075-7be4-49cc-8929-ec63bee13ef9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:29.836542 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-86ac7075-7be4-49cc-8929-ec63bee13ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4199b76d451b4ca0944a3793b78a00dd', 'request_id': 'req-86ac7075-7be4-49cc-8929-ec63bee13ef9'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:29.847471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-86ac7075-7be4-49cc-8929-ec63bee13ef9 admin admin] The token cache is being invalidate because project 4199b76d451b4ca0944a3793b78a00dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:29.847695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-86ac7075-7be4-49cc-8929-ec63bee13ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:29.848391 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-86ac7075-7be4-49cc-8929-ec63bee13ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:29.849977 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1321/2649] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:29 2022] DELETE /identity/v3/projects/4199b76d451b4ca0944a3793b78a00dd => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:29.853349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e6f753e3-f93f-4576-a818-039313b355d5 None None] MFA Rules not processed for user `2d4b9a00dbd846c18766bd299a02eaef`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:29.854644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e6f753e3-f93f-4576-a818-039313b355d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:29.854761 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af1389-bdda-4953-bc9d-d9749ef6e96d None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:29.854963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af1389-bdda-4953-bc9d-d9749ef6e96d None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:29.855240 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af1389-bdda-4953-bc9d-d9749ef6e96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:29.876764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-61af1389-bdda-4953-bc9d-d9749ef6e96d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:29.878036 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-61af1389-bdda-4953-bc9d-d9749ef6e96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:29.939722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1322/2650] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:29.944483 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1329/2651] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:29.950670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a87a9-706b-4ee2-ac22-a97a5a2b51ae None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:29.951095 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a87a9-706b-4ee2-ac22-a97a5a2b51ae None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:29.951506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a87a9-706b-4ee2-ac22-a97a5a2b51ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:29.953353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f753e3-f93f-4576-a818-039313b355d5 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:29.955212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e6f753e3-f93f-4576-a818-039313b355d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:29.974695 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-879a87a9-706b-4ee2-ac22-a97a5a2b51ae None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:29.975926 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-879a87a9-706b-4ee2-ac22-a97a5a2b51ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:29.986945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1323/2652] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:29.991152 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a87a9-706b-4ee2-ac22-a97a5a2b51ae None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:30.000905 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a87a9-706b-4ee2-ac22-a97a5a2b51ae None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:30.007408 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b9155-9e4c-4ce9-bf98-48121151c85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:30.008220 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b9155-9e4c-4ce9-bf98-48121151c85f admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:30.008612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b9155-9e4c-4ce9-bf98-48121151c85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:30.009015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b9155-9e4c-4ce9-bf98-48121151c85f admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:30.009853 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b9155-9e4c-4ce9-bf98-48121151c85f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:30.010413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b9155-9e4c-4ce9-bf98-48121151c85f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:30.012372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b9155-9e4c-4ce9-bf98-48121151c85f admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:30.026091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1324/2653] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:19:30.026772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f753e3-f93f-4576-a818-039313b355d5 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:30.030460 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b9155-9e4c-4ce9-bf98-48121151c85f admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:30.031201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8daeba-f0f4-4a4e-a2fd-8ebb617a2c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:30.031917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8daeba-f0f4-4a4e-a2fd-8ebb617a2c23 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:30.033020 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8daeba-f0f4-4a4e-a2fd-8ebb617a2c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:30.033713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8daeba-f0f4-4a4e-a2fd-8ebb617a2c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:30.042372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b9155-9e4c-4ce9-bf98-48121151c85f admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:30.046173 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8daeba-f0f4-4a4e-a2fd-8ebb617a2c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:30.046173 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8daeba-f0f4-4a4e-a2fd-8ebb617a2c23 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:30.047356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458f622-dd1d-4d00-9b39-d376787b5e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:30.048043 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458f622-dd1d-4d00-9b39-d376787b5e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:30.049108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458f622-dd1d-4d00-9b39-d376787b5e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:30.049531 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458f622-dd1d-4d00-9b39-d376787b5e6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:30.050277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458f622-dd1d-4d00-9b39-d376787b5e6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:30.052586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458f622-dd1d-4d00-9b39-d376787b5e6d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:30.056620 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1330/2654] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:30.108487 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8daeba-f0f4-4a4e-a2fd-8ebb617a2c23 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:30.109932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-0e8daeba-f0f4-4a4e-a2fd-8ebb617a2c23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:30.121827 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8daeba-f0f4-4a4e-a2fd-8ebb617a2c23 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:30.125668 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fc0d5-3841-4049-82d2-3c24d3c0fa59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:30.126977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fc0d5-3841-4049-82d2-3c24d3c0fa59 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:30.127527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fc0d5-3841-4049-82d2-3c24d3c0fa59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:30.127633 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fc0d5-3841-4049-82d2-3c24d3c0fa59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:30.129696 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-864fc0d5-3841-4049-82d2-3c24d3c0fa59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:30.132108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:30.139057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1325/2655] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:30 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:30.143272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458f622-dd1d-4d00-9b39-d376787b5e6d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:30.200995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fc0d5-3841-4049-82d2-3c24d3c0fa59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:30.202452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fc0d5-3841-4049-82d2-3c24d3c0fa59 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:30.208972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:30.210527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458f622-dd1d-4d00-9b39-d376787b5e6d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:30.214418 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1331/2656] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:30.215325 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5e6d3-bac7-44ee-8269-a88c344742e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:30.215992 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5e6d3-bac7-44ee-8269-a88c344742e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:30.216276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5e6d3-bac7-44ee-8269-a88c344742e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:30.216649 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5e6d3-bac7-44ee-8269-a88c344742e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:30.217375 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5e6d3-bac7-44ee-8269-a88c344742e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:30.219270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5e6d3-bac7-44ee-8269-a88c344742e6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:30.325573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1326/2657] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:30 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:30.327747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fc0d5-3841-4049-82d2-3c24d3c0fa59 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:30.339809 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fc0d5-3841-4049-82d2-3c24d3c0fa59 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:30.353838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64386a07-c69b-4589-9c47-054910fcb526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:30.353838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64386a07-c69b-4589-9c47-054910fcb526 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:30.353838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64386a07-c69b-4589-9c47-054910fcb526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:30.353838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64386a07-c69b-4589-9c47-054910fcb526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:30.354303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64386a07-c69b-4589-9c47-054910fcb526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:30.354303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64386a07-c69b-4589-9c47-054910fcb526 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:30.364505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1332/2658] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:30.368895 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5e6d3-bac7-44ee-8269-a88c344742e6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:30.379959 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5e6d3-bac7-44ee-8269-a88c344742e6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:30.384911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c842c9-bf50-45ee-a794-5fc1971899a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:30.385613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c842c9-bf50-45ee-a794-5fc1971899a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:30.385898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c842c9-bf50-45ee-a794-5fc1971899a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:30.386178 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c842c9-bf50-45ee-a794-5fc1971899a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:30.386912 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c842c9-bf50-45ee-a794-5fc1971899a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:30.388500 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c842c9-bf50-45ee-a794-5fc1971899a0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:30.401886 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1327/2659] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:30.403025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64386a07-c69b-4589-9c47-054910fcb526 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:30.414060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64386a07-c69b-4589-9c47-054910fcb526 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:30.418795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf29c5-0a85-46ba-9429-08e4fffd7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:30.419792 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf29c5-0a85-46ba-9429-08e4fffd7bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:30.419973 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf29c5-0a85-46ba-9429-08e4fffd7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:30.420252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf29c5-0a85-46ba-9429-08e4fffd7bc8 admin admin] PATH_INFO: `/v3/projects/b58ed9176d634d01b4ac42f32412a986/users/62b28c0c046d4402b35d72740127ae65/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:30.435852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf29c5-0a85-46ba-9429-08e4fffd7bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58ed9176d634d01b4ac42f32412a986, user_id=62b28c0c046d4402b35d72740127ae65, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:30.438807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bf29c5-0a85-46ba-9429-08e4fffd7bc8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:30.571207 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1333/2660] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:30 2022] PUT /identity/v3/projects/b58ed9176d634d01b4ac42f32412a986/users/62b28c0c046d4402b35d72740127ae65/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:30.573789 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6f1c0-aa59-487e-8dd9-c7554a92f9ee None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:30.574087 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6f1c0-aa59-487e-8dd9-c7554a92f9ee None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:30.574372 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6f1c0-aa59-487e-8dd9-c7554a92f9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:30.601104 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e1a6f1c0-aa59-487e-8dd9-c7554a92f9ee None None] MFA Rules not processed for user `62b28c0c046d4402b35d72740127ae65`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:30.602307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e1a6f1c0-aa59-487e-8dd9-c7554a92f9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:30.676635 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1328/2661] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:30.681153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf29c5-0a85-46ba-9429-08e4fffd7bc8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:30.742159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf29c5-0a85-46ba-9429-08e4fffd7bc8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:30.747056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073e3d0-edfa-42d2-8cf1-6109e229ce1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:30.747714 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e3d0-edfa-42d2-8cf1-6109e229ce1f admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:30.747997 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e3d0-edfa-42d2-8cf1-6109e229ce1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:30.748276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073e3d0-edfa-42d2-8cf1-6109e229ce1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:30.749011 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073e3d0-edfa-42d2-8cf1-6109e229ce1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:30.750935 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3073e3d0-edfa-42d2-8cf1-6109e229ce1f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:30.855610 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1334/2662] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:30 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:30.857232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6f1c0-aa59-487e-8dd9-c7554a92f9ee None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:30.870803 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6f1c0-aa59-487e-8dd9-c7554a92f9ee None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:30.870912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:30.927277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eba2be-7ead-4120-929d-1b35d0311241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:30.927960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eba2be-7ead-4120-929d-1b35d0311241 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:30.928246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eba2be-7ead-4120-929d-1b35d0311241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:30.928529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eba2be-7ead-4120-929d-1b35d0311241 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:30.929265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eba2be-7ead-4120-929d-1b35d0311241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:30.931175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eba2be-7ead-4120-929d-1b35d0311241 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:31.007486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1329/2663] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:30 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:31.011323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073e3d0-edfa-42d2-8cf1-6109e229ce1f admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:31.022521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3073e3d0-edfa-42d2-8cf1-6109e229ce1f admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:31.027367 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e352bad-a6d0-459c-ab80-2a3aadd7ed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:31.028038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e352bad-a6d0-459c-ab80-2a3aadd7ed10 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:31.028330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e352bad-a6d0-459c-ab80-2a3aadd7ed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:31.035732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e352bad-a6d0-459c-ab80-2a3aadd7ed10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:31.035732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e352bad-a6d0-459c-ab80-2a3aadd7ed10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:31.035732 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e352bad-a6d0-459c-ab80-2a3aadd7ed10 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:31.043328 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1335/2664] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:31.047727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eba2be-7ead-4120-929d-1b35d0311241 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:31.058819 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eba2be-7ead-4120-929d-1b35d0311241 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:31.063725 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1170bf2-da9f-4824-8bc9-5896e87fe061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:31.064683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1170bf2-da9f-4824-8bc9-5896e87fe061 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:31.065000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1170bf2-da9f-4824-8bc9-5896e87fe061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:31.065333 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1170bf2-da9f-4824-8bc9-5896e87fe061 admin admin] PATH_INFO: `/v3/projects/c49709d4fd4d48a8b8ea2d20b58139c0/users/3bb046de18844790a694e56ae33d8582/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:31.081185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1170bf2-da9f-4824-8bc9-5896e87fe061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49709d4fd4d48a8b8ea2d20b58139c0, user_id=3bb046de18844790a694e56ae33d8582, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:31.083843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1170bf2-da9f-4824-8bc9-5896e87fe061 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:31.092513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:31.155919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1330/2665] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:31 2022] PUT /identity/v3/projects/c49709d4fd4d48a8b8ea2d20b58139c0/users/3bb046de18844790a694e56ae33d8582/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:31.159988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e352bad-a6d0-459c-ab80-2a3aadd7ed10 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:31.170162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e352bad-a6d0-459c-ab80-2a3aadd7ed10 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:31.233129 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3293ab-297f-44f5-8350-547987fc7715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:31.233825 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3293ab-297f-44f5-8350-547987fc7715 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:31.234108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3293ab-297f-44f5-8350-547987fc7715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:31.234385 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3293ab-297f-44f5-8350-547987fc7715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:31.235131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3293ab-297f-44f5-8350-547987fc7715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:31.237118 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3293ab-297f-44f5-8350-547987fc7715 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:31.248931 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1336/2666] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:31.259934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1170bf2-da9f-4824-8bc9-5896e87fe061 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:31.272583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1170bf2-da9f-4824-8bc9-5896e87fe061 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:31.277485 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3d2e3-135a-44c4-a534-a44a0058cea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:31.278405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3d2e3-135a-44c4-a534-a44a0058cea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:31.278954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3d2e3-135a-44c4-a534-a44a0058cea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:31.279239 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3d2e3-135a-44c4-a534-a44a0058cea4 admin admin] PATH_INFO: `/v3/projects/c49709d4fd4d48a8b8ea2d20b58139c0/users/3bb046de18844790a694e56ae33d8582/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:31.281323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3d2e3-135a-44c4-a534-a44a0058cea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c49709d4fd4d48a8b8ea2d20b58139c0, user_id=3bb046de18844790a694e56ae33d8582, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:31.285641 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3d2e3-135a-44c4-a534-a44a0058cea4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:31.295737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1331/2667] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:31 2022] PUT /identity/v3/projects/c49709d4fd4d48a8b8ea2d20b58139c0/users/3bb046de18844790a694e56ae33d8582/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:31.307920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052de958-7a42-477d-b29d-b9063ecf41da None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:31.308229 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052de958-7a42-477d-b29d-b9063ecf41da None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:31.308582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052de958-7a42-477d-b29d-b9063ecf41da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:31.341594 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-052de958-7a42-477d-b29d-b9063ecf41da None None] MFA Rules not processed for user `3bb046de18844790a694e56ae33d8582`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:31.342838 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-052de958-7a42-477d-b29d-b9063ecf41da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:31.390566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:31.417565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1337/2668] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:31.429039 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3d2e3-135a-44c4-a534-a44a0058cea4 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:31.488326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3d2e3-135a-44c4-a534-a44a0058cea4 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:31.492759 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222e523-5f5b-4e78-9d84-0657365e0b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:31.493452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222e523-5f5b-4e78-9d84-0657365e0b59 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:31.493739 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222e523-5f5b-4e78-9d84-0657365e0b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:31.494018 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222e523-5f5b-4e78-9d84-0657365e0b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:31.509835 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222e523-5f5b-4e78-9d84-0657365e0b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:31.511323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222e523-5f5b-4e78-9d84-0657365e0b59 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:31.521347 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1332/2669] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:31.663145 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052de958-7a42-477d-b29d-b9063ecf41da None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:31.726478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052de958-7a42-477d-b29d-b9063ecf41da None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:31.731107 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:31.732037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:31.732346 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:31.732619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] PATH_INFO: `/v3/users/62b28c0c046d4402b35d72740127ae65` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:31.733836 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b28c0c046d4402b35d72740127ae65)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:31.736793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:32.002617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b28c0c046d4402b35d72740127ae65'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:32.015381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b28c0c046d4402b35d72740127ae65'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:32.109671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b28c0c046d4402b35d72740127ae65'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:32.110493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b28c0c046d4402b35d72740127ae65'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:32.111690 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b28c0c046d4402b35d72740127ae65'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:32.125933 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1338/2670] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:31 2022] DELETE /identity/v3/users/62b28c0c046d4402b35d72740127ae65 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:32.133311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508fb32-71b5-4169-98d5-e2b89a00a694 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:32.133603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508fb32-71b5-4169-98d5-e2b89a00a694 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:32.133880 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508fb32-71b5-4169-98d5-e2b89a00a694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:32.151537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-6508fb32-71b5-4169-98d5-e2b89a00a694 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:32.152737 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6508fb32-71b5-4169-98d5-e2b89a00a694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:32.211071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1333/2671] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:32.221593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:32.223209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:32.292229 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e1c58-4c0c-4155-94a6-4aed0deed0c3 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:32.296320 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e8fcc-deaf-437b-bbcb-4a878e32a9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:32.302259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e8fcc-deaf-437b-bbcb-4a878e32a9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:32.302259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e8fcc-deaf-437b-bbcb-4a878e32a9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:32.302259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e8fcc-deaf-437b-bbcb-4a878e32a9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:32.308185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e8fcc-deaf-437b-bbcb-4a878e32a9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:32.310234 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e8fcc-deaf-437b-bbcb-4a878e32a9f2 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:32.321306 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1339/2672] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:32.824530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508fb32-71b5-4169-98d5-e2b89a00a694 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:32.826200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6508fb32-71b5-4169-98d5-e2b89a00a694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:32.839881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508fb32-71b5-4169-98d5-e2b89a00a694 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:32.849525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:32.849525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:32.849525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:32.849525 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] PATH_INFO: `/v3/projects/b58ed9176d634d01b4ac42f32412a986` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:32.850813 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58ed9176d634d01b4ac42f32412a986)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:32.853577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:33.025839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58ed9176d634d01b4ac42f32412a986', 'request_id': 'req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:33.143583 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58ed9176d634d01b4ac42f32412a986', 'request_id': 'req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:33.146228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:33.151042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58ed9176d634d01b4ac42f32412a986', 'request_id': 'req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:33.172126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] The token cache is being invalidate because project b58ed9176d634d01b4ac42f32412a986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:33.172126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:33.172126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:33.178642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e8fcc-deaf-437b-bbcb-4a878e32a9f2 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:33.180898 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1334/2673] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:32 2022] DELETE /identity/v3/projects/b58ed9176d634d01b4ac42f32412a986 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:33.185083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:33.189450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e8fcc-deaf-437b-bbcb-4a878e32a9f2 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:33.252117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3f837-af2a-4c2b-a463-0d4743c35a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:33.253051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f837-af2a-4c2b-a463-0d4743c35a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:33.253334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f837-af2a-4c2b-a463-0d4743c35a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:33.253611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3f837-af2a-4c2b-a463-0d4743c35a6d admin admin] PATH_INFO: `/v3/users/3bb046de18844790a694e56ae33d8582` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:33.254916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3f837-af2a-4c2b-a463-0d4743c35a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb046de18844790a694e56ae33d8582)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:33.256897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3f837-af2a-4c2b-a463-0d4743c35a6d admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:33.474463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-70c3f837-af2a-4c2b-a463-0d4743c35a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb046de18844790a694e56ae33d8582'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:33.502667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-70c3f837-af2a-4c2b-a463-0d4743c35a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb046de18844790a694e56ae33d8582'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:33.647813 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-70c3f837-af2a-4c2b-a463-0d4743c35a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb046de18844790a694e56ae33d8582'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:33.648356 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-70c3f837-af2a-4c2b-a463-0d4743c35a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb046de18844790a694e56ae33d8582'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:33.649015 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-70c3f837-af2a-4c2b-a463-0d4743c35a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb046de18844790a694e56ae33d8582'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:33.663648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1340/2674] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:33 2022] DELETE /identity/v3/users/3bb046de18844790a694e56ae33d8582 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:34.079246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:34.079246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:34.093178 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4463a-1ffb-4fd3-87b8-c12a097d10d4 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:34.164154 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c39db-9654-490a-b3c5-e4a9197121ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:34.165553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c39db-9654-490a-b3c5-e4a9197121ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:34.166003 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c39db-9654-490a-b3c5-e4a9197121ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:34.166290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c39db-9654-490a-b3c5-e4a9197121ca admin admin] PATH_INFO: `/v3/projects/c49709d4fd4d48a8b8ea2d20b58139c0` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:34.167593 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c39db-9654-490a-b3c5-e4a9197121ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=c49709d4fd4d48a8b8ea2d20b58139c0)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:34.169597 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c39db-9654-490a-b3c5-e4a9197121ca admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:34.310389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-529c39db-9654-490a-b3c5-e4a9197121ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c49709d4fd4d48a8b8ea2d20b58139c0', 'request_id': 'req-529c39db-9654-490a-b3c5-e4a9197121ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:34.393725 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-529c39db-9654-490a-b3c5-e4a9197121ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c49709d4fd4d48a8b8ea2d20b58139c0', 'request_id': 'req-529c39db-9654-490a-b3c5-e4a9197121ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:34.400771 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-529c39db-9654-490a-b3c5-e4a9197121ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c49709d4fd4d48a8b8ea2d20b58139c0', 'request_id': 'req-529c39db-9654-490a-b3c5-e4a9197121ca'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:34.412291 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-529c39db-9654-490a-b3c5-e4a9197121ca admin admin] The token cache is being invalidate because project c49709d4fd4d48a8b8ea2d20b58139c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:34.412582 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-529c39db-9654-490a-b3c5-e4a9197121ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:34.413251 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-529c39db-9654-490a-b3c5-e4a9197121ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:34.415027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1335/2675] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:34 2022] DELETE /identity/v3/projects/c49709d4fd4d48a8b8ea2d20b58139c0 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:34.420582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d9f6f-1a3b-486e-a198-ee0c2904a7fe None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:34.421084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d9f6f-1a3b-486e-a198-ee0c2904a7fe None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:34.421181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d9f6f-1a3b-486e-a198-ee0c2904a7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:34.441547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-216d9f6f-1a3b-486e-a198-ee0c2904a7fe None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:34.442756 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-216d9f6f-1a3b-486e-a198-ee0c2904a7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:34.504492 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1341/2676] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:34.512038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cffedf-8af8-4aad-9728-c99bcbb99b9a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:34.512331 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cffedf-8af8-4aad-9728-c99bcbb99b9a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:34.512668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cffedf-8af8-4aad-9728-c99bcbb99b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:34.531953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d1cffedf-8af8-4aad-9728-c99bcbb99b9a None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:34.533971 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d1cffedf-8af8-4aad-9728-c99bcbb99b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:34.541986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1336/2677] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:34.546436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d9f6f-1a3b-486e-a198-ee0c2904a7fe None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:34.556224 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d9f6f-1a3b-486e-a198-ee0c2904a7fe None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:34.561257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef6784-f770-4d43-b483-ceaf233cf631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:34.561916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef6784-f770-4d43-b483-ceaf233cf631 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:34.562196 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef6784-f770-4d43-b483-ceaf233cf631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:34.562472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef6784-f770-4d43-b483-ceaf233cf631 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:34.563206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef6784-f770-4d43-b483-ceaf233cf631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:34.563555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef6784-f770-4d43-b483-ceaf233cf631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:34.565824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef6784-f770-4d43-b483-ceaf233cf631 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:34.582818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1342/2678] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:19:34.585828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cffedf-8af8-4aad-9728-c99bcbb99b9a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:34.596496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cffedf-8af8-4aad-9728-c99bcbb99b9a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:34.601626 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94eaf-426a-4d6e-b32a-8ad96fa16b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:34.602336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94eaf-426a-4d6e-b32a-8ad96fa16b1d admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:34.602626 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94eaf-426a-4d6e-b32a-8ad96fa16b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:34.602908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c94eaf-426a-4d6e-b32a-8ad96fa16b1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:34.603602 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c94eaf-426a-4d6e-b32a-8ad96fa16b1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:34.605564 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c94eaf-426a-4d6e-b32a-8ad96fa16b1d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:34.666652 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1337/2679] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:34 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:34.670644 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef6784-f770-4d43-b483-ceaf233cf631 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:34.681566 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef6784-f770-4d43-b483-ceaf233cf631 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:34.690209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:34.750528 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20055671-bf76-45cd-8d64-936e9f708387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:34.751210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20055671-bf76-45cd-8d64-936e9f708387 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:34.751486 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20055671-bf76-45cd-8d64-936e9f708387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:34.751764 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20055671-bf76-45cd-8d64-936e9f708387 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:34.752452 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20055671-bf76-45cd-8d64-936e9f708387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:34.754547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20055671-bf76-45cd-8d64-936e9f708387 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:34.953478 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1343/2680] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:34 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:34.960963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94eaf-426a-4d6e-b32a-8ad96fa16b1d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:34.968914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c94eaf-426a-4d6e-b32a-8ad96fa16b1d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:34.974630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c542b-c9b8-4c32-b056-b6fc1050a533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:34.975485 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c542b-c9b8-4c32-b056-b6fc1050a533 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:34.975768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c542b-c9b8-4c32-b056-b6fc1050a533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:34.976053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c542b-c9b8-4c32-b056-b6fc1050a533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:34.978313 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c542b-c9b8-4c32-b056-b6fc1050a533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:34.979842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c542b-c9b8-4c32-b056-b6fc1050a533 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:34.998005 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1338/2681] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:34.999375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20055671-bf76-45cd-8d64-936e9f708387 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:35.023475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20055671-bf76-45cd-8d64-936e9f708387 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:35.028943 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c642526-825c-40fd-a37f-67dbc0c6d7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:35.029611 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c642526-825c-40fd-a37f-67dbc0c6d7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:35.029890 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c642526-825c-40fd-a37f-67dbc0c6d7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:35.030570 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c642526-825c-40fd-a37f-67dbc0c6d7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:35.031012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c642526-825c-40fd-a37f-67dbc0c6d7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:35.032905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c642526-825c-40fd-a37f-67dbc0c6d7a9 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:35.064899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1344/2682] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:35.067078 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c542b-c9b8-4c32-b056-b6fc1050a533 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:35.077490 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c542b-c9b8-4c32-b056-b6fc1050a533 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:35.084436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528083d-e788-465b-9ea9-c52e7bd43d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:35.085374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528083d-e788-465b-9ea9-c52e7bd43d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:35.085862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528083d-e788-465b-9ea9-c52e7bd43d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:35.086167 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528083d-e788-465b-9ea9-c52e7bd43d42 admin admin] PATH_INFO: `/v3/projects/926e7f86d48f4e0b8396ef10c7043f7e/users/b96b7062488a4013aa69c7486181dede/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:35.104499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528083d-e788-465b-9ea9-c52e7bd43d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=926e7f86d48f4e0b8396ef10c7043f7e, user_id=b96b7062488a4013aa69c7486181dede, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:35.107200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528083d-e788-465b-9ea9-c52e7bd43d42 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:35.201945 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1339/2683] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:35 2022] PUT /identity/v3/projects/926e7f86d48f4e0b8396ef10c7043f7e/users/b96b7062488a4013aa69c7486181dede/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:35.213153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c361a22-1139-4824-8b26-0dca691dc4ef None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:35.213600 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c361a22-1139-4824-8b26-0dca691dc4ef None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:35.213916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c361a22-1139-4824-8b26-0dca691dc4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:35.266466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528083d-e788-465b-9ea9-c52e7bd43d42 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:35.268025 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-9c361a22-1139-4824-8b26-0dca691dc4ef None None] MFA Rules not processed for user `b96b7062488a4013aa69c7486181dede`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:35.268474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9528083d-e788-465b-9ea9-c52e7bd43d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:35.269884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-9c361a22-1139-4824-8b26-0dca691dc4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:35.284128 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:35.346029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528083d-e788-465b-9ea9-c52e7bd43d42 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:35.350854 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c3663-0173-4531-b61b-fef0f3653228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:35.358208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c3663-0173-4531-b61b-fef0f3653228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:35.358208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c3663-0173-4531-b61b-fef0f3653228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:35.358208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c3663-0173-4531-b61b-fef0f3653228 admin admin] PATH_INFO: `/v3/users/d88b3280788f4c66b7f7351badee6ad1` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:35.358208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c3663-0173-4531-b61b-fef0f3653228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88b3280788f4c66b7f7351badee6ad1)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:35.358208 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c3663-0173-4531-b61b-fef0f3653228 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:35.358655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1345/2684] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:35.362912 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c361a22-1139-4824-8b26-0dca691dc4ef None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:35.378920 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c361a22-1139-4824-8b26-0dca691dc4ef None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:35.383845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4d33-dde4-4a9e-a7df-eae5e7584474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:35.384501 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4d33-dde4-4a9e-a7df-eae5e7584474 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:35.384782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4d33-dde4-4a9e-a7df-eae5e7584474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:35.385087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4d33-dde4-4a9e-a7df-eae5e7584474 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:35.385881 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da4d33-dde4-4a9e-a7df-eae5e7584474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:35.387900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da4d33-dde4-4a9e-a7df-eae5e7584474 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:35.518376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1346/2685] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:35 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:35.522396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4d33-dde4-4a9e-a7df-eae5e7584474 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:35.580993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:35.584706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4d33-dde4-4a9e-a7df-eae5e7584474 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:35.589708 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21649be-d51a-45c4-809e-e87e5b9b66bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:35.590378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21649be-d51a-45c4-809e-e87e5b9b66bc admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:35.590662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21649be-d51a-45c4-809e-e87e5b9b66bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:35.590940 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21649be-d51a-45c4-809e-e87e5b9b66bc admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:35.591631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21649be-d51a-45c4-809e-e87e5b9b66bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:35.593589 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21649be-d51a-45c4-809e-e87e5b9b66bc admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:35.603652 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bc5c3663-0173-4531-b61b-fef0f3653228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88b3280788f4c66b7f7351badee6ad1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:35.616020 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bc5c3663-0173-4531-b61b-fef0f3653228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88b3280788f4c66b7f7351badee6ad1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:35.693821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1347/2686] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:35 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:35.698051 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21649be-d51a-45c4-809e-e87e5b9b66bc admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:35.709130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21649be-d51a-45c4-809e-e87e5b9b66bc admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:35.713908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd72261-b2b8-40c0-9374-d76be82b57d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:35.714562 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd72261-b2b8-40c0-9374-d76be82b57d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:35.714844 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd72261-b2b8-40c0-9374-d76be82b57d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:35.715119 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd72261-b2b8-40c0-9374-d76be82b57d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:35.715847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd72261-b2b8-40c0-9374-d76be82b57d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:35.717482 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd72261-b2b8-40c0-9374-d76be82b57d0 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:35.729378 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1348/2687] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:35.731107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bc5c3663-0173-4531-b61b-fef0f3653228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88b3280788f4c66b7f7351badee6ad1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:35.731856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bc5c3663-0173-4531-b61b-fef0f3653228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88b3280788f4c66b7f7351badee6ad1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:35.732567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-bc5c3663-0173-4531-b61b-fef0f3653228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88b3280788f4c66b7f7351badee6ad1'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:35.733081 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd72261-b2b8-40c0-9374-d76be82b57d0 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:35.735963 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-8dd72261-b2b8-40c0-9374-d76be82b57d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:35.746856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1340/2688] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:35 2022] DELETE /identity/v3/users/d88b3280788f4c66b7f7351badee6ad1 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:35.751248 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93330-93fa-4962-92ac-66b6cfe01f3a None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:35.751572 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93330-93fa-4962-92ac-66b6cfe01f3a None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:35.751913 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e93330-93fa-4962-92ac-66b6cfe01f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:35.752591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd72261-b2b8-40c0-9374-d76be82b57d0 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:35.771474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-d8e93330-93fa-4962-92ac-66b6cfe01f3a None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:35.772842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d8e93330-93fa-4962-92ac-66b6cfe01f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:35.819457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450767f9-05eb-413d-a28d-eb6ee724fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:35.820155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450767f9-05eb-413d-a28d-eb6ee724fc21 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:35.820443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450767f9-05eb-413d-a28d-eb6ee724fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:35.820727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450767f9-05eb-413d-a28d-eb6ee724fc21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:35.821894 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450767f9-05eb-413d-a28d-eb6ee724fc21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:35.823169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450767f9-05eb-413d-a28d-eb6ee724fc21 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:35.833965 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1349/2689] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:35.835400 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1341/2690] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:35.837836 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450767f9-05eb-413d-a28d-eb6ee724fc21 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:35.845592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e93330-93fa-4962-92ac-66b6cfe01f3a None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:35.847028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d8e93330-93fa-4962-92ac-66b6cfe01f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:35.848587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450767f9-05eb-413d-a28d-eb6ee724fc21 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:35.853154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba4fdb-5cc1-4323-b4da-35d8f28d45ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:35.854047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba4fdb-5cc1-4323-b4da-35d8f28d45ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:35.854327 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba4fdb-5cc1-4323-b4da-35d8f28d45ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:35.854625 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba4fdb-5cc1-4323-b4da-35d8f28d45ef admin admin] PATH_INFO: `/v3/projects/a568378c7b8b4033a6f21ebd6f759b24/users/271c4404a18d465aa37f68ac983d33f6/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:35.879786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba4fdb-5cc1-4323-b4da-35d8f28d45ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a568378c7b8b4033a6f21ebd6f759b24, user_id=271c4404a18d465aa37f68ac983d33f6, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:35.882715 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba4fdb-5cc1-4323-b4da-35d8f28d45ef admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:35.905742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:35.910986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e93330-93fa-4962-92ac-66b6cfe01f3a None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:35.914807 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363b795-d127-4b04-b0a4-1990771f81be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:35.915453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b795-d127-4b04-b0a4-1990771f81be service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:35.915736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b795-d127-4b04-b0a4-1990771f81be service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:35.916011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363b795-d127-4b04-b0a4-1990771f81be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:35.926393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363b795-d127-4b04-b0a4-1990771f81be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:35.927888 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363b795-d127-4b04-b0a4-1990771f81be service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:35.940107 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1342/2691] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:35.985144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1350/2692] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:35 2022] PUT /identity/v3/projects/a568378c7b8b4033a6f21ebd6f759b24/users/271c4404a18d465aa37f68ac983d33f6/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:35.998717 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc528df6-f4dd-47ec-a794-74b30958d77c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:35.999047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc528df6-f4dd-47ec-a794-74b30958d77c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:35.999342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc528df6-f4dd-47ec-a794-74b30958d77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:36.028332 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-dc528df6-f4dd-47ec-a794-74b30958d77c None None] MFA Rules not processed for user `271c4404a18d465aa37f68ac983d33f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:36.029837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-dc528df6-f4dd-47ec-a794-74b30958d77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:36.097761 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1343/2693] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:36.102371 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba4fdb-5cc1-4323-b4da-35d8f28d45ef admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:36.176826 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba4fdb-5cc1-4323-b4da-35d8f28d45ef admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:36.186905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab7a63-8760-430d-891a-160bb421d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:36.187582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab7a63-8760-430d-891a-160bb421d72c admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:36.187860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab7a63-8760-430d-891a-160bb421d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:36.188135 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab7a63-8760-430d-891a-160bb421d72c admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:36.188904 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab7a63-8760-430d-891a-160bb421d72c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:36.190819 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab7a63-8760-430d-891a-160bb421d72c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:36.303773 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1351/2694] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:36 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:36.308183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc528df6-f4dd-47ec-a794-74b30958d77c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:36.319943 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc528df6-f4dd-47ec-a794-74b30958d77c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:36.381091 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab7a63-8760-430d-891a-160bb421d72c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:36.382664 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96098996-2968-4eb0-861e-21826bdc29a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:36.383232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-acab7a63-8760-430d-891a-160bb421d72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:36.383341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96098996-2968-4eb0-861e-21826bdc29a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:36.387764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96098996-2968-4eb0-861e-21826bdc29a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:36.387764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96098996-2968-4eb0-861e-21826bdc29a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:36.387764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96098996-2968-4eb0-861e-21826bdc29a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:36.387764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96098996-2968-4eb0-861e-21826bdc29a8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:36.397878 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab7a63-8760-430d-891a-160bb421d72c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:36.404082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:36.405003 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:36.405447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:36.405733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] PATH_INFO: `/v3/projects/366f618a9a564367b923627312e88300` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:36.407659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=366f618a9a564367b923627312e88300)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:36.409993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:36.465511 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1344/2695] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:36 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:36.469977 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96098996-2968-4eb0-861e-21826bdc29a8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:36.480845 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96098996-2968-4eb0-861e-21826bdc29a8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:36.485569 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50b241-f09d-4d32-bf7c-163e8288cbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:36.486241 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50b241-f09d-4d32-bf7c-163e8288cbca admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:36.486521 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50b241-f09d-4d32-bf7c-163e8288cbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:36.487999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50b241-f09d-4d32-bf7c-163e8288cbca admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:36.487999 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50b241-f09d-4d32-bf7c-163e8288cbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:36.489174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50b241-f09d-4d32-bf7c-163e8288cbca admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:36.499177 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1345/2696] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:36.504045 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50b241-f09d-4d32-bf7c-163e8288cbca admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:36.512695 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:36.513809 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50b241-f09d-4d32-bf7c-163e8288cbca admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:36.527697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '366f618a9a564367b923627312e88300', 'request_id': 'req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:36.560959 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:36.576007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cefa5e-4d17-4cc2-8ff2-e363ca583e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:36.576933 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cefa5e-4d17-4cc2-8ff2-e363ca583e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:36.577214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cefa5e-4d17-4cc2-8ff2-e363ca583e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:36.577494 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cefa5e-4d17-4cc2-8ff2-e363ca583e93 admin admin] PATH_INFO: `/v3/projects/944a7b3390a4461ca793b19dcabf357e/users/f686a5a0e1a54461befda89b750f4c92/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:36.594941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cefa5e-4d17-4cc2-8ff2-e363ca583e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944a7b3390a4461ca793b19dcabf357e, user_id=f686a5a0e1a54461befda89b750f4c92, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:36.597697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cefa5e-4d17-4cc2-8ff2-e363ca583e93 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:36.629533 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '366f618a9a564367b923627312e88300', 'request_id': 'req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:36.636895 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '366f618a9a564367b923627312e88300', 'request_id': 'req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:36.649146 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] The token cache is being invalidate because project 366f618a9a564367b923627312e88300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:36.649382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:36.650063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:36.651729 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1352/2697] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:36 2022] DELETE /identity/v3/projects/366f618a9a564367b923627312e88300 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:36.655872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:36.657571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:36.670793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0693b3a-5ffd-4f4f-b7ad-5ea12f5a2150 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:36.675761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:36.676636 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:36.676945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:36.677244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] PATH_INFO: `/v3/users/2d4b9a00dbd846c18766bd299a02eaef` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:36.678406 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4b9a00dbd846c18766bd299a02eaef)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:36.680334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:36.697573 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1346/2698] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:36 2022] PUT /identity/v3/projects/944a7b3390a4461ca793b19dcabf357e/users/f686a5a0e1a54461befda89b750f4c92/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:36.701847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cefa5e-4d17-4cc2-8ff2-e363ca583e93 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:36.703144 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d2cefa5e-4d17-4cc2-8ff2-e363ca583e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:36.770990 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cefa5e-4d17-4cc2-8ff2-e363ca583e93 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:36.776757 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa441844-b0e2-477d-8098-b6ee772cbb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:36.777466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa441844-b0e2-477d-8098-b6ee772cbb40 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:36.777748 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa441844-b0e2-477d-8098-b6ee772cbb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:36.778024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa441844-b0e2-477d-8098-b6ee772cbb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:36.779009 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa441844-b0e2-477d-8098-b6ee772cbb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:36.780738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa441844-b0e2-477d-8098-b6ee772cbb40 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:36.791561 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1347/2699] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:36.795656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa441844-b0e2-477d-8098-b6ee772cbb40 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:36.807179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa441844-b0e2-477d-8098-b6ee772cbb40 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:36.812068 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702014f7-b7a3-4467-8b5e-c640f49f4537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:36.816965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702014f7-b7a3-4467-8b5e-c640f49f4537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:36.816965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702014f7-b7a3-4467-8b5e-c640f49f4537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:36.816965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702014f7-b7a3-4467-8b5e-c640f49f4537 admin admin] PATH_INFO: `/v3/projects/944a7b3390a4461ca793b19dcabf357e/users/f686a5a0e1a54461befda89b750f4c92/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:36.816965 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702014f7-b7a3-4467-8b5e-c640f49f4537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944a7b3390a4461ca793b19dcabf357e, user_id=f686a5a0e1a54461befda89b750f4c92, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:36.819102 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702014f7-b7a3-4467-8b5e-c640f49f4537 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:36.829553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1348/2700] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:36 2022] PUT /identity/v3/projects/944a7b3390a4461ca793b19dcabf357e/users/f686a5a0e1a54461befda89b750f4c92/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:36.839725 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327de3-68ea-4f8c-b515-5715ff58137e None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:36.840017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327de3-68ea-4f8c-b515-5715ff58137e None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:36.840302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c327de3-68ea-4f8c-b515-5715ff58137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:36.873729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-0c327de3-68ea-4f8c-b515-5715ff58137e None None] MFA Rules not processed for user `f686a5a0e1a54461befda89b750f4c92`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:36.875023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0c327de3-68ea-4f8c-b515-5715ff58137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:36.946510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1349/2701] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:36.958796 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4b9a00dbd846c18766bd299a02eaef'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:36.959599 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c327de3-68ea-4f8c-b515-5715ff58137e None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:36.961088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0c327de3-68ea-4f8c-b515-5715ff58137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:36.983441 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4b9a00dbd846c18766bd299a02eaef'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:37.007796 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:37.026936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c327de3-68ea-4f8c-b515-5715ff58137e None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:37.031071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe436e0-44b3-4251-9682-6e84ac8859a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:37.031728 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe436e0-44b3-4251-9682-6e84ac8859a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:37.032148 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe436e0-44b3-4251-9682-6e84ac8859a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:37.033221 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe436e0-44b3-4251-9682-6e84ac8859a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:37.043535 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe436e0-44b3-4251-9682-6e84ac8859a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:37.045053 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe436e0-44b3-4251-9682-6e84ac8859a7 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:37.046706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4b9a00dbd846c18766bd299a02eaef'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:37.047387 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4b9a00dbd846c18766bd299a02eaef'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:37.048182 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4b9a00dbd846c18766bd299a02eaef'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:37.055616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1350/2702] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:37.064960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1353/2703] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:36 2022] DELETE /identity/v3/users/2d4b9a00dbd846c18766bd299a02eaef => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:37.205005 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe436e0-44b3-4251-9682-6e84ac8859a7 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:37.206761 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9fe436e0-44b3-4251-9682-6e84ac8859a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:37.218923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe436e0-44b3-4251-9682-6e84ac8859a7 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:37.268483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f062f53-09e0-4d0e-94a8-e5187cf5341b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:37.269814 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062f53-09e0-4d0e-94a8-e5187cf5341b service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:37.270403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062f53-09e0-4d0e-94a8-e5187cf5341b service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:37.271100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f062f53-09e0-4d0e-94a8-e5187cf5341b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:37.273725 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3f062f53-09e0-4d0e-94a8-e5187cf5341b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:37.339929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f062f53-09e0-4d0e-94a8-e5187cf5341b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:37.341434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f062f53-09e0-4d0e-94a8-e5187cf5341b service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:37.352030 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1351/2704] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:37.569424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:37.571761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:37.646662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708a2e7-6a91-4be5-aa7a-cc9867579011 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:37.651364 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd47e6-3952-4021-a54c-5abff78bfc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:37.652223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd47e6-3952-4021-a54c-5abff78bfc20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:37.652507 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd47e6-3952-4021-a54c-5abff78bfc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:37.652782 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd47e6-3952-4021-a54c-5abff78bfc20 admin admin] PATH_INFO: `/v3/projects/8986d55f9be24a76949594698be8d38d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:37.654268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd47e6-3952-4021-a54c-5abff78bfc20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8986d55f9be24a76949594698be8d38d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:37.656190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd47e6-3952-4021-a54c-5abff78bfc20 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:37.776573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:37.789405 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-91bd47e6-3952-4021-a54c-5abff78bfc20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8986d55f9be24a76949594698be8d38d', 'request_id': 'req-91bd47e6-3952-4021-a54c-5abff78bfc20'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:37.904243 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-91bd47e6-3952-4021-a54c-5abff78bfc20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8986d55f9be24a76949594698be8d38d', 'request_id': 'req-91bd47e6-3952-4021-a54c-5abff78bfc20'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:37.913019 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-91bd47e6-3952-4021-a54c-5abff78bfc20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8986d55f9be24a76949594698be8d38d', 'request_id': 'req-91bd47e6-3952-4021-a54c-5abff78bfc20'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:37.924723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-91bd47e6-3952-4021-a54c-5abff78bfc20 admin admin] The token cache is being invalidate because project 8986d55f9be24a76949594698be8d38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:37.925038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-91bd47e6-3952-4021-a54c-5abff78bfc20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:37.925720 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-91bd47e6-3952-4021-a54c-5abff78bfc20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:37.927245 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1354/2705] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:37 2022] DELETE /identity/v3/projects/8986d55f9be24a76949594698be8d38d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:37.932100 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5ab53-6708-4bbc-8d7f-1d76e23f4e94 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:37.932394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5ab53-6708-4bbc-8d7f-1d76e23f4e94 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:37.932680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5ab53-6708-4bbc-8d7f-1d76e23f4e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:37.950197 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-15a5ab53-6708-4bbc-8d7f-1d76e23f4e94 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:37.951409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-15a5ab53-6708-4bbc-8d7f-1d76e23f4e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:38.018126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1352/2706] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:38.026212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407d10c-0248-4e35-83f8-92608cbc64e8 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:38.026501 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407d10c-0248-4e35-83f8-92608cbc64e8 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:38.026828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407d10c-0248-4e35-83f8-92608cbc64e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:38.045952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d407d10c-0248-4e35-83f8-92608cbc64e8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:38.047162 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d407d10c-0248-4e35-83f8-92608cbc64e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:38.055900 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1355/2707] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:38.060167 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5ab53-6708-4bbc-8d7f-1d76e23f4e94 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:38.070512 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5ab53-6708-4bbc-8d7f-1d76e23f4e94 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:38.075387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d945f-cb78-45a4-8d27-d789cce6f20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:38.076057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d945f-cb78-45a4-8d27-d789cce6f20c admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:38.076343 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d945f-cb78-45a4-8d27-d789cce6f20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:38.076623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d945f-cb78-45a4-8d27-d789cce6f20c admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:38.077447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d945f-cb78-45a4-8d27-d789cce6f20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:38.082194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d945f-cb78-45a4-8d27-d789cce6f20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:38.082194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d945f-cb78-45a4-8d27-d789cce6f20c admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:38.092328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1353/2708] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:19:38.097192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407d10c-0248-4e35-83f8-92608cbc64e8 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:38.107104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407d10c-0248-4e35-83f8-92608cbc64e8 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:38.115747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcf188-2033-4a08-8542-f6c1ccb667b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:38.116571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcf188-2033-4a08-8542-f6c1ccb667b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:38.117005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcf188-2033-4a08-8542-f6c1ccb667b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:38.117316 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fcf188-2033-4a08-8542-f6c1ccb667b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:38.118060 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcf188-2033-4a08-8542-f6c1ccb667b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:38.120010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fcf188-2033-4a08-8542-f6c1ccb667b9 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:38.227484 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1356/2709] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:38 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:38.237199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d945f-cb78-45a4-8d27-d789cce6f20c admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:38.247356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d945f-cb78-45a4-8d27-d789cce6f20c admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:38.265142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:38.309424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521a4c-9736-4739-9100-881c6f6a7610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:38.310097 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521a4c-9736-4739-9100-881c6f6a7610 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:38.310382 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521a4c-9736-4739-9100-881c6f6a7610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:38.312283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521a4c-9736-4739-9100-881c6f6a7610 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:38.312283 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521a4c-9736-4739-9100-881c6f6a7610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:38.313309 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521a4c-9736-4739-9100-881c6f6a7610 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:38.395351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1354/2710] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:38 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:38.399565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcf188-2033-4a08-8542-f6c1ccb667b9 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:38.410936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fcf188-2033-4a08-8542-f6c1ccb667b9 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:38.415650 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10875125-310f-4a6e-97ce-a487568d5cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:38.417883 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10875125-310f-4a6e-97ce-a487568d5cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:38.418184 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10875125-310f-4a6e-97ce-a487568d5cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:38.418471 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10875125-310f-4a6e-97ce-a487568d5cf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:38.419215 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10875125-310f-4a6e-97ce-a487568d5cf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:38.420859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10875125-310f-4a6e-97ce-a487568d5cf8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:38.433518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1357/2711] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:38.437630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521a4c-9736-4739-9100-881c6f6a7610 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:38.448246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521a4c-9736-4739-9100-881c6f6a7610 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:38.453380 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51538da-7254-495e-95a8-93c45e3ae7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:38.454827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51538da-7254-495e-95a8-93c45e3ae7af admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:38.455126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51538da-7254-495e-95a8-93c45e3ae7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:38.455405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51538da-7254-495e-95a8-93c45e3ae7af admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:38.456229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51538da-7254-495e-95a8-93c45e3ae7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:38.458137 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51538da-7254-495e-95a8-93c45e3ae7af admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:38.469298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1355/2712] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:38.473981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10875125-310f-4a6e-97ce-a487568d5cf8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:38.484038 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10875125-310f-4a6e-97ce-a487568d5cf8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:38.489039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3480a-efb7-4382-8c7c-71105dd4cb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:38.489923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3480a-efb7-4382-8c7c-71105dd4cb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:38.490208 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3480a-efb7-4382-8c7c-71105dd4cb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:38.490520 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3480a-efb7-4382-8c7c-71105dd4cb20 admin admin] PATH_INFO: `/v3/projects/d346b98fa9d5441eb4c4311c4594ebca/users/221dcc1878c94f699fa835ea26181cb6/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:38.505439 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3480a-efb7-4382-8c7c-71105dd4cb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d346b98fa9d5441eb4c4311c4594ebca, user_id=221dcc1878c94f699fa835ea26181cb6, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:38.508163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3480a-efb7-4382-8c7c-71105dd4cb20 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:38.605375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1358/2713] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:38 2022] PUT /identity/v3/projects/d346b98fa9d5441eb4c4311c4594ebca/users/221dcc1878c94f699fa835ea26181cb6/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:38.616703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83279136-9af2-4d35-b2a6-d3c263b36145 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:38.617033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83279136-9af2-4d35-b2a6-d3c263b36145 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:38.617319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83279136-9af2-4d35-b2a6-d3c263b36145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:38.645947 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-83279136-9af2-4d35-b2a6-d3c263b36145 None None] MFA Rules not processed for user `221dcc1878c94f699fa835ea26181cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:38.647190 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-83279136-9af2-4d35-b2a6-d3c263b36145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:38.728438 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1356/2714] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:38.733573 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3480a-efb7-4382-8c7c-71105dd4cb20 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:38.798703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3480a-efb7-4382-8c7c-71105dd4cb20 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:38.803302 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266d971-1a73-477c-ad5b-4a90ecfcfaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:38.803964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266d971-1a73-477c-ad5b-4a90ecfcfaee admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:38.804244 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266d971-1a73-477c-ad5b-4a90ecfcfaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:38.804723 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266d971-1a73-477c-ad5b-4a90ecfcfaee admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:38.805692 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266d971-1a73-477c-ad5b-4a90ecfcfaee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:38.809200 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266d971-1a73-477c-ad5b-4a90ecfcfaee admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:38.907494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1359/2715] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:38 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:38.911887 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83279136-9af2-4d35-b2a6-d3c263b36145 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:38.924341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83279136-9af2-4d35-b2a6-d3c263b36145 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:38.985720 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e14f-cb40-47dd-b182-b002fea11397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:38.987577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e14f-cb40-47dd-b182-b002fea11397 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:38.987577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e14f-cb40-47dd-b182-b002fea11397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:38.987577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e14f-cb40-47dd-b182-b002fea11397 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:38.988367 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e14f-cb40-47dd-b182-b002fea11397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:38.991830 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e14f-cb40-47dd-b182-b002fea11397 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:39.091698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1357/2716] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:38 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:39.095973 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266d971-1a73-477c-ad5b-4a90ecfcfaee admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:39.106602 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266d971-1a73-477c-ad5b-4a90ecfcfaee admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:39.111982 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fb43b-a3fa-4b70-bdeb-002a82b8506c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:39.112654 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fb43b-a3fa-4b70-bdeb-002a82b8506c admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:39.112954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fb43b-a3fa-4b70-bdeb-002a82b8506c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:39.113238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fb43b-a3fa-4b70-bdeb-002a82b8506c admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:39.114045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fb43b-a3fa-4b70-bdeb-002a82b8506c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:39.115646 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fb43b-a3fa-4b70-bdeb-002a82b8506c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:39.127386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1360/2717] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:39.131951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e14f-cb40-47dd-b182-b002fea11397 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:39.142807 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e14f-cb40-47dd-b182-b002fea11397 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:39.147388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab00350-aa06-44d1-b40f-2ba0070d3190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:39.148054 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab00350-aa06-44d1-b40f-2ba0070d3190 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:39.148339 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab00350-aa06-44d1-b40f-2ba0070d3190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:39.148616 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab00350-aa06-44d1-b40f-2ba0070d3190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:39.149384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab00350-aa06-44d1-b40f-2ba0070d3190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:39.150976 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab00350-aa06-44d1-b40f-2ba0070d3190 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:39.161199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1358/2718] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:39.165422 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fb43b-a3fa-4b70-bdeb-002a82b8506c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:39.176463 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fb43b-a3fa-4b70-bdeb-002a82b8506c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:39.181149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc1912-c771-42ec-910c-6cc8ffad1ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:39.182039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc1912-c771-42ec-910c-6cc8ffad1ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:39.182322 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc1912-c771-42ec-910c-6cc8ffad1ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:39.182601 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc1912-c771-42ec-910c-6cc8ffad1ec2 admin admin] PATH_INFO: `/v3/projects/6669cd6341d64115ae07443a1100014d/users/4a031dadb30b416b8e079a87eb690500/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:39.199661 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc1912-c771-42ec-910c-6cc8ffad1ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6669cd6341d64115ae07443a1100014d, user_id=4a031dadb30b416b8e079a87eb690500, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:39.202368 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc1912-c771-42ec-910c-6cc8ffad1ec2 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:39.283530 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1361/2719] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:39 2022] PUT /identity/v3/projects/6669cd6341d64115ae07443a1100014d/users/4a031dadb30b416b8e079a87eb690500/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:39.293987 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87065db8-a707-4e13-a6e8-d58c113acd15 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:39.294485 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87065db8-a707-4e13-a6e8-d58c113acd15 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:39.294594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87065db8-a707-4e13-a6e8-d58c113acd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:39.308721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:39.323926 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-87065db8-a707-4e13-a6e8-d58c113acd15 None None] MFA Rules not processed for user `4a031dadb30b416b8e079a87eb690500`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:39.325266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-87065db8-a707-4e13-a6e8-d58c113acd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:39.405980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1359/2720] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:39.410860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc1912-c771-42ec-910c-6cc8ffad1ec2 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:39.416703 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:39.479726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc1912-c771-42ec-910c-6cc8ffad1ec2 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:39.484751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c897c0f-1ea2-420e-81ca-c7440168fa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:39.485469 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c897c0f-1ea2-420e-81ca-c7440168fa5a admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:39.485758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c897c0f-1ea2-420e-81ca-c7440168fa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:39.486036 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c897c0f-1ea2-420e-81ca-c7440168fa5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:39.486765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c897c0f-1ea2-420e-81ca-c7440168fa5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:39.488667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c897c0f-1ea2-420e-81ca-c7440168fa5a admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:39.626373 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1362/2721] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:39 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:39.630405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87065db8-a707-4e13-a6e8-d58c113acd15 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:39.643824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87065db8-a707-4e13-a6e8-d58c113acd15 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:39.708318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7dde9-bc16-4456-8021-86cdf34d1f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:39.709035 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7dde9-bc16-4456-8021-86cdf34d1f3d admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:39.709320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7dde9-bc16-4456-8021-86cdf34d1f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:39.709621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7dde9-bc16-4456-8021-86cdf34d1f3d admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:39.710302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7dde9-bc16-4456-8021-86cdf34d1f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:39.712233 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7dde9-bc16-4456-8021-86cdf34d1f3d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:39.833750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1360/2722] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:39 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:39.837773 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c897c0f-1ea2-420e-81ca-c7440168fa5a admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:39.848521 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c897c0f-1ea2-420e-81ca-c7440168fa5a admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:39.853437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4a086-ef0e-4d19-8976-862c09c0d76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:39.854305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4a086-ef0e-4d19-8976-862c09c0d76e admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:39.854591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4a086-ef0e-4d19-8976-862c09c0d76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:39.855039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4a086-ef0e-4d19-8976-862c09c0d76e admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:39.855823 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4a086-ef0e-4d19-8976-862c09c0d76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:39.857396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4a086-ef0e-4d19-8976-862c09c0d76e admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:39.885902 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1363/2723] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:39.887092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7dde9-bc16-4456-8021-86cdf34d1f3d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:39.898007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7dde9-bc16-4456-8021-86cdf34d1f3d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:39.902885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ef3b9-6d22-4748-857b-562db68a30bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:39.904029 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ef3b9-6d22-4748-857b-562db68a30bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:39.904311 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ef3b9-6d22-4748-857b-562db68a30bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:39.904612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ef3b9-6d22-4748-857b-562db68a30bb admin admin] PATH_INFO: `/v3/projects/31bb6aaf59a04fe79d87516372aca391/users/0d4395e15f294624b4d271d5ab3f8e34/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:39.919712 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ef3b9-6d22-4748-857b-562db68a30bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bb6aaf59a04fe79d87516372aca391, user_id=0d4395e15f294624b4d271d5ab3f8e34, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:39.922455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ef3b9-6d22-4748-857b-562db68a30bb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:40.006008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1361/2724] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:39 2022] PUT /identity/v3/projects/31bb6aaf59a04fe79d87516372aca391/users/0d4395e15f294624b4d271d5ab3f8e34/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:40.010014 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4a086-ef0e-4d19-8976-862c09c0d76e admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:40.020247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4a086-ef0e-4d19-8976-862c09c0d76e admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:40.080348 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc0a87-3853-41a5-94d1-46d7bc3032be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:40.081111 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc0a87-3853-41a5-94d1-46d7bc3032be admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:40.081425 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc0a87-3853-41a5-94d1-46d7bc3032be admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:40.081832 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc0a87-3853-41a5-94d1-46d7bc3032be admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:40.082961 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc0a87-3853-41a5-94d1-46d7bc3032be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:40.084977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fc0a87-3853-41a5-94d1-46d7bc3032be admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:40.099283 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1364/2725] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:40.103447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ef3b9-6d22-4748-857b-562db68a30bb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:40.114273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ef3b9-6d22-4748-857b-562db68a30bb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:40.118824 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad760d9-5182-4323-af70-76435d5b5606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:40.119703 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad760d9-5182-4323-af70-76435d5b5606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:40.119994 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad760d9-5182-4323-af70-76435d5b5606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:40.125446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad760d9-5182-4323-af70-76435d5b5606 admin admin] PATH_INFO: `/v3/projects/31bb6aaf59a04fe79d87516372aca391/users/0d4395e15f294624b4d271d5ab3f8e34/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:40.125446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad760d9-5182-4323-af70-76435d5b5606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bb6aaf59a04fe79d87516372aca391, user_id=0d4395e15f294624b4d271d5ab3f8e34, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:40.125446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad760d9-5182-4323-af70-76435d5b5606 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:40.136199 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1362/2726] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:40 2022] PUT /identity/v3/projects/31bb6aaf59a04fe79d87516372aca391/users/0d4395e15f294624b4d271d5ab3f8e34/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:40.146803 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4213320-f0a3-4149-8972-69ed119a89a0 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:40.147096 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4213320-f0a3-4149-8972-69ed119a89a0 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:40.147382 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4213320-f0a3-4149-8972-69ed119a89a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:40.175949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-c4213320-f0a3-4149-8972-69ed119a89a0 None None] MFA Rules not processed for user `0d4395e15f294624b4d271d5ab3f8e34`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:40.177214 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c4213320-f0a3-4149-8972-69ed119a89a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:40.247928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:40.253067 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1365/2727] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:40.266026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad760d9-5182-4323-af70-76435d5b5606 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:40.268026 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-0ad760d9-5182-4323-af70-76435d5b5606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:40.327374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:40.331246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad760d9-5182-4323-af70-76435d5b5606 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:40.334957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b009b0d-74f9-4beb-8894-586ee12ba19f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:40.335604 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b009b0d-74f9-4beb-8894-586ee12ba19f service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:40.335909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b009b0d-74f9-4beb-8894-586ee12ba19f service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:40.336171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b009b0d-74f9-4beb-8894-586ee12ba19f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:40.393659 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b009b0d-74f9-4beb-8894-586ee12ba19f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:40.395287 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b009b0d-74f9-4beb-8894-586ee12ba19f service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:40.407580 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1363/2728] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:41.652015 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4213320-f0a3-4149-8972-69ed119a89a0 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:41.653571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c4213320-f0a3-4149-8972-69ed119a89a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:41.722325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4213320-f0a3-4149-8972-69ed119a89a0 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:41.729138 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:41.730311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:41.730571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:41.730844 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] PATH_INFO: `/v3/users/b96b7062488a4013aa69c7486181dede` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:41.732104 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96b7062488a4013aa69c7486181dede)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:41.734167 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:41.958976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96b7062488a4013aa69c7486181dede'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:41.971358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96b7062488a4013aa69c7486181dede'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:42.046761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96b7062488a4013aa69c7486181dede'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:42.047305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96b7062488a4013aa69c7486181dede'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:42.047999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96b7062488a4013aa69c7486181dede'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:42.061176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1366/2729] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:41 2022] DELETE /identity/v3/users/b96b7062488a4013aa69c7486181dede => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:42.065779 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc56f0d-1f10-46ae-b4a1-deb88df467b1 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:42.066963 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc56f0d-1f10-46ae-b4a1-deb88df467b1 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:42.067254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc56f0d-1f10-46ae-b4a1-deb88df467b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:42.088296 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-acc56f0d-1f10-46ae-b4a1-deb88df467b1 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:42.089566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-acc56f0d-1f10-46ae-b4a1-deb88df467b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:42.153353 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1364/2730] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:42.163906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:42.165386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:42.224252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060bc7e-b863-4733-b9a2-40fd26007ba8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:42.227879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd960c11-427e-45e5-9d3a-70f5443b347a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:42.228522 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd960c11-427e-45e5-9d3a-70f5443b347a service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:42.228822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd960c11-427e-45e5-9d3a-70f5443b347a service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:42.229115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd960c11-427e-45e5-9d3a-70f5443b347a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:42.238339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd960c11-427e-45e5-9d3a-70f5443b347a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:42.239791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd960c11-427e-45e5-9d3a-70f5443b347a service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:42.253874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1367/2731] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:42.371509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc56f0d-1f10-46ae-b4a1-deb88df467b1 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:42.372939 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-acc56f0d-1f10-46ae-b4a1-deb88df467b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:42.432159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc56f0d-1f10-46ae-b4a1-deb88df467b1 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:42.435733 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f91fc-030f-48f1-9f5f-589f00bb3551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:42.436392 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f91fc-030f-48f1-9f5f-589f00bb3551 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:42.436681 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f91fc-030f-48f1-9f5f-589f00bb3551 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:42.437001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f91fc-030f-48f1-9f5f-589f00bb3551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:42.439421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5d7f91fc-030f-48f1-9f5f-589f00bb3551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:42.504850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f91fc-030f-48f1-9f5f-589f00bb3551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:42.506798 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f91fc-030f-48f1-9f5f-589f00bb3551 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:42.512489 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:42.522908 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1365/2732] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:42.696851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd960c11-427e-45e5-9d3a-70f5443b347a service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:42.698338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-dd960c11-427e-45e5-9d3a-70f5443b347a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:42.714935 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd960c11-427e-45e5-9d3a-70f5443b347a service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:42.722514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:42.723496 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:42.724229 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:42.724527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] PATH_INFO: `/v3/projects/926e7f86d48f4e0b8396ef10c7043f7e` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:42.726045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] RBAC: Authorizing `identity:delete_project(project_id=926e7f86d48f4e0b8396ef10c7043f7e)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:42.729850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:42.752990 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:42.886140 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '926e7f86d48f4e0b8396ef10c7043f7e', 'request_id': 'req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:42.984100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '926e7f86d48f4e0b8396ef10c7043f7e', 'request_id': 'req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:42.991831 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '926e7f86d48f4e0b8396ef10c7043f7e', 'request_id': 'req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:43.003726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] The token cache is being invalidate because project 926e7f86d48f4e0b8396ef10c7043f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:43.004022 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:43.004679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:43.006466 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1368/2733] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:42 2022] DELETE /identity/v3/projects/926e7f86d48f4e0b8396ef10c7043f7e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:43.010418 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f91fc-030f-48f1-9f5f-589f00bb3551 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:43.021625 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f91fc-030f-48f1-9f5f-589f00bb3551 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:43.081151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:43.082064 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:43.082349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:43.082621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] PATH_INFO: `/v3/users/271c4404a18d465aa37f68ac983d33f6` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:43.083795 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271c4404a18d465aa37f68ac983d33f6)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:43.085724 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:43.294670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271c4404a18d465aa37f68ac983d33f6'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:43.307673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271c4404a18d465aa37f68ac983d33f6'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:43.446960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271c4404a18d465aa37f68ac983d33f6'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:43.447572 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271c4404a18d465aa37f68ac983d33f6'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:43.448175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271c4404a18d465aa37f68ac983d33f6'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:43.463157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1366/2734] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:43 2022] DELETE /identity/v3/users/271c4404a18d465aa37f68ac983d33f6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:43.962443 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:43.963903 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:43.977013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d6a0ab-2a29-40dc-b5c3-4d85e7ada57f admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:44.043490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:44.044367 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:44.044657 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:44.044994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] PATH_INFO: `/v3/projects/a568378c7b8b4033a6f21ebd6f759b24` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:44.048447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a568378c7b8b4033a6f21ebd6f759b24)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:44.049311 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:44.145509 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:44.146955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:44.171652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a568378c7b8b4033a6f21ebd6f759b24', 'request_id': 'req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:44.206476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37542a93-c6c8-4e9d-a4a1-6d6e804e7ef6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:44.239944 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:44.250392 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a568378c7b8b4033a6f21ebd6f759b24', 'request_id': 'req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:44.257708 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a568378c7b8b4033a6f21ebd6f759b24', 'request_id': 'req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:44.260324 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634674b-6926-4a80-a5f4-b0bc776a5d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:44.261013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634674b-6926-4a80-a5f4-b0bc776a5d9e service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:44.261297 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634674b-6926-4a80-a5f4-b0bc776a5d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:44.261579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634674b-6926-4a80-a5f4-b0bc776a5d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:44.263362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2634674b-6926-4a80-a5f4-b0bc776a5d9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:44.269398 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] The token cache is being invalidate because project a568378c7b8b4033a6f21ebd6f759b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:44.269857 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:44.270510 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:44.272056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1369/2735] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:43 2022] DELETE /identity/v3/projects/a568378c7b8b4033a6f21ebd6f759b24 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:44.275821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:44.277237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:44.320299 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:44.336527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634674b-6926-4a80-a5f4-b0bc776a5d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:44.336527 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634674b-6926-4a80-a5f4-b0bc776a5d9e service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:44.344282 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b3a0b-9ab0-4f73-a79e-d4e8fafcfb23 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:44.346553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1367/2736] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:44.349330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2cb76-3a89-4fb2-924a-c9b02741c379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:44.350204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2cb76-3a89-4fb2-924a-c9b02741c379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:44.350489 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2cb76-3a89-4fb2-924a-c9b02741c379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:44.350769 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2cb76-3a89-4fb2-924a-c9b02741c379 admin admin] PATH_INFO: `/v3/users/f686a5a0e1a54461befda89b750f4c92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:44.352073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2cb76-3a89-4fb2-924a-c9b02741c379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f686a5a0e1a54461befda89b750f4c92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:44.353928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2cb76-3a89-4fb2-924a-c9b02741c379 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:44.523212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d6f2cb76-3a89-4fb2-924a-c9b02741c379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f686a5a0e1a54461befda89b750f4c92'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:44.535896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d6f2cb76-3a89-4fb2-924a-c9b02741c379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f686a5a0e1a54461befda89b750f4c92'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:44.607784 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d6f2cb76-3a89-4fb2-924a-c9b02741c379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f686a5a0e1a54461befda89b750f4c92'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:44.608617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d6f2cb76-3a89-4fb2-924a-c9b02741c379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f686a5a0e1a54461befda89b750f4c92'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:44.609268 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d6f2cb76-3a89-4fb2-924a-c9b02741c379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f686a5a0e1a54461befda89b750f4c92'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:44.623624 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1370/2737] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:44 2022] DELETE /identity/v3/users/f686a5a0e1a54461befda89b750f4c92 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:45.105200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634674b-6926-4a80-a5f4-b0bc776a5d9e service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:45.106831 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-2634674b-6926-4a80-a5f4-b0bc776a5d9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:45.122796 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634674b-6926-4a80-a5f4-b0bc776a5d9e service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:45.183376 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e201606-52ed-4e54-b597-999fda65612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:45.184318 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e201606-52ed-4e54-b597-999fda65612b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:45.184523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e201606-52ed-4e54-b597-999fda65612b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:45.184952 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e201606-52ed-4e54-b597-999fda65612b admin admin] PATH_INFO: `/v3/projects/944a7b3390a4461ca793b19dcabf357e` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:45.186142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e201606-52ed-4e54-b597-999fda65612b admin admin] RBAC: Authorizing `identity:delete_project(project_id=944a7b3390a4461ca793b19dcabf357e)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:45.188103 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e201606-52ed-4e54-b597-999fda65612b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:45.365368 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1e201606-52ed-4e54-b597-999fda65612b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944a7b3390a4461ca793b19dcabf357e', 'request_id': 'req-1e201606-52ed-4e54-b597-999fda65612b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:45.444844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1e201606-52ed-4e54-b597-999fda65612b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944a7b3390a4461ca793b19dcabf357e', 'request_id': 'req-1e201606-52ed-4e54-b597-999fda65612b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:45.451420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1e201606-52ed-4e54-b597-999fda65612b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944a7b3390a4461ca793b19dcabf357e', 'request_id': 'req-1e201606-52ed-4e54-b597-999fda65612b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:45.462445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1e201606-52ed-4e54-b597-999fda65612b admin admin] The token cache is being invalidate because project 944a7b3390a4461ca793b19dcabf357e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:45.462730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1e201606-52ed-4e54-b597-999fda65612b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:45.463360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-1e201606-52ed-4e54-b597-999fda65612b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:45.464932 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1368/2738] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:45 2022] DELETE /identity/v3/projects/944a7b3390a4461ca793b19dcabf357e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:45.470962 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e30853-87d1-4b28-9ee8-e2a6de4b01d8 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:45.471921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e30853-87d1-4b28-9ee8-e2a6de4b01d8 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:45.471921 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e30853-87d1-4b28-9ee8-e2a6de4b01d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:45.490869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-73e30853-87d1-4b28-9ee8-e2a6de4b01d8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:45.492057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-73e30853-87d1-4b28-9ee8-e2a6de4b01d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:45.555154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1371/2739] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:45.563637 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d91ff1-0300-46f0-8099-676f71fc4d62 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:45.563923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d91ff1-0300-46f0-8099-676f71fc4d62 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:45.564201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d91ff1-0300-46f0-8099-676f71fc4d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:45.583518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-82d91ff1-0300-46f0-8099-676f71fc4d62 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:45.584730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-82d91ff1-0300-46f0-8099-676f71fc4d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:45.592693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1369/2740] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:45.597468 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e30853-87d1-4b28-9ee8-e2a6de4b01d8 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:45.607698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e30853-87d1-4b28-9ee8-e2a6de4b01d8 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:45.613773 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cc0d8-3071-4a21-a1b2-90ff31bfc3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:45.614440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cc0d8-3071-4a21-a1b2-90ff31bfc3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:45.614727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cc0d8-3071-4a21-a1b2-90ff31bfc3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:45.615005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cc0d8-3071-4a21-a1b2-90ff31bfc3a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:45.615733 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cc0d8-3071-4a21-a1b2-90ff31bfc3a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:45.616046 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cc0d8-3071-4a21-a1b2-90ff31bfc3a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:45.617768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cc0d8-3071-4a21-a1b2-90ff31bfc3a0 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:45.629824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1372/2741] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:19:45.634472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d91ff1-0300-46f0-8099-676f71fc4d62 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:45.645358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d91ff1-0300-46f0-8099-676f71fc4d62 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:45.650046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120298ae-3fa0-4290-87ad-c6b2f7e784f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:45.650714 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120298ae-3fa0-4290-87ad-c6b2f7e784f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:45.651095 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120298ae-3fa0-4290-87ad-c6b2f7e784f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:45.651414 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120298ae-3fa0-4290-87ad-c6b2f7e784f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:45.652274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120298ae-3fa0-4290-87ad-c6b2f7e784f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:45.654312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120298ae-3fa0-4290-87ad-c6b2f7e784f5 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:45.657753 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:45.778328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1370/2742] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:45 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:45.779677 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cc0d8-3071-4a21-a1b2-90ff31bfc3a0 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:45.790464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cc0d8-3071-4a21-a1b2-90ff31bfc3a0 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:45.832108 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:45.849772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc26d-d2bb-4057-a017-fafceae6da7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:45.850435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc26d-d2bb-4057-a017-fafceae6da7c admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:45.850718 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc26d-d2bb-4057-a017-fafceae6da7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:45.850990 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc26d-d2bb-4057-a017-fafceae6da7c admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:45.851689 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cc26d-d2bb-4057-a017-fafceae6da7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:45.853663 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cc26d-d2bb-4057-a017-fafceae6da7c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:46.005584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1373/2743] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:45 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:46.011170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120298ae-3fa0-4290-87ad-c6b2f7e784f5 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:46.022010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120298ae-3fa0-4290-87ad-c6b2f7e784f5 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:46.026699 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b66733-3384-4bc3-9ad6-c073cf27b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:46.027356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b66733-3384-4bc3-9ad6-c073cf27b8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:46.027642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b66733-3384-4bc3-9ad6-c073cf27b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:46.027919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b66733-3384-4bc3-9ad6-c073cf27b8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:46.028911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b66733-3384-4bc3-9ad6-c073cf27b8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:46.030510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b66733-3384-4bc3-9ad6-c073cf27b8a6 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:46.047897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1371/2744] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:46.050852 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc26d-d2bb-4057-a017-fafceae6da7c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:46.061163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc26d-d2bb-4057-a017-fafceae6da7c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:46.066708 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171dc649-beb2-4535-9673-9ef9b669fdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:46.067454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dc649-beb2-4535-9673-9ef9b669fdf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:46.067738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dc649-beb2-4535-9673-9ef9b669fdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:46.068034 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171dc649-beb2-4535-9673-9ef9b669fdf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:46.068793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dc649-beb2-4535-9673-9ef9b669fdf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:46.070413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171dc649-beb2-4535-9673-9ef9b669fdf5 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:46.081667 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1374/2745] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:46.085827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b66733-3384-4bc3-9ad6-c073cf27b8a6 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:46.095766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b66733-3384-4bc3-9ad6-c073cf27b8a6 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:46.100361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e8fa0-c993-4170-8e83-7298ec096c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:46.101265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e8fa0-c993-4170-8e83-7298ec096c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:46.101550 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e8fa0-c993-4170-8e83-7298ec096c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:46.101823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e8fa0-c993-4170-8e83-7298ec096c8e admin admin] PATH_INFO: `/v3/projects/dbab03669747457dbdac5136c042f858/users/ab0ed56a89de45b191dbeba0df0426a9/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:46.116270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e8fa0-c993-4170-8e83-7298ec096c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbab03669747457dbdac5136c042f858, user_id=ab0ed56a89de45b191dbeba0df0426a9, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:46.118989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e8fa0-c993-4170-8e83-7298ec096c8e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:46.245025 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1372/2746] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:46 2022] PUT /identity/v3/projects/dbab03669747457dbdac5136c042f858/users/ab0ed56a89de45b191dbeba0df0426a9/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:46.256889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088729d9-0bbb-4f97-ad2b-0fc4154798db None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:46.257132 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088729d9-0bbb-4f97-ad2b-0fc4154798db None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:46.257413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088729d9-0bbb-4f97-ad2b-0fc4154798db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:46.284248 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-088729d9-0bbb-4f97-ad2b-0fc4154798db None None] MFA Rules not processed for user `ab0ed56a89de45b191dbeba0df0426a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:46.285563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-088729d9-0bbb-4f97-ad2b-0fc4154798db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:46.353531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1375/2747] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:46.365614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e8fa0-c993-4170-8e83-7298ec096c8e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:46.372986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5a6e8fa0-c993-4170-8e83-7298ec096c8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:46.429215 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e8fa0-c993-4170-8e83-7298ec096c8e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:46.433269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891e34f-2a2b-4af8-adc0-095931956529 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:46.433919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891e34f-2a2b-4af8-adc0-095931956529 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:46.434203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891e34f-2a2b-4af8-adc0-095931956529 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:46.434483 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891e34f-2a2b-4af8-adc0-095931956529 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:46.443370 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891e34f-2a2b-4af8-adc0-095931956529 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:46.444840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891e34f-2a2b-4af8-adc0-095931956529 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:46.453980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1373/2748] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:49.272143 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088729d9-0bbb-4f97-ad2b-0fc4154798db None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:49.273867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-088729d9-0bbb-4f97-ad2b-0fc4154798db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:49.340794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088729d9-0bbb-4f97-ad2b-0fc4154798db None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:49.345349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:49.346221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:49.346499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:49.346851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] PATH_INFO: `/v3/users/221dcc1878c94f699fa835ea26181cb6` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:49.348204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=221dcc1878c94f699fa835ea26181cb6)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:49.350095 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:49.513794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221dcc1878c94f699fa835ea26181cb6'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:49.519394 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:49.528269 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221dcc1878c94f699fa835ea26181cb6'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:49.595681 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221dcc1878c94f699fa835ea26181cb6'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:49.597456 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221dcc1878c94f699fa835ea26181cb6'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:49.598225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221dcc1878c94f699fa835ea26181cb6'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:49.610998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1376/2749] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:49 2022] DELETE /identity/v3/users/221dcc1878c94f699fa835ea26181cb6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:49.615647 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebb78e-9ad0-4f58-b1ba-47e4e75876c2 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:49.616135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebb78e-9ad0-4f58-b1ba-47e4e75876c2 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:49.617721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebb78e-9ad0-4f58-b1ba-47e4e75876c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:49.633709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-57ebb78e-9ad0-4f58-b1ba-47e4e75876c2 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:49.634950 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-57ebb78e-9ad0-4f58-b1ba-47e4e75876c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:49.700276 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1374/2750] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:49.710674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:49.712124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:49.771219 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25083e8c-a9e0-4102-a9b2-a116c393e951 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:49.774787 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa14b56-4760-44c5-b536-c6b9ecf11e04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:49.775426 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa14b56-4760-44c5-b536-c6b9ecf11e04 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:49.775713 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa14b56-4760-44c5-b536-c6b9ecf11e04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:49.775990 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa14b56-4760-44c5-b536-c6b9ecf11e04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:49.785936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa14b56-4760-44c5-b536-c6b9ecf11e04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:49.787379 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa14b56-4760-44c5-b536-c6b9ecf11e04 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:49.796934 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1377/2751] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:50.212008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebb78e-9ad0-4f58-b1ba-47e4e75876c2 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:50.214011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-57ebb78e-9ad0-4f58-b1ba-47e4e75876c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:50.229856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebb78e-9ad0-4f58-b1ba-47e4e75876c2 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:50.242120 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:50.243201 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:50.243533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:50.243815 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] PATH_INFO: `/v3/projects/d346b98fa9d5441eb4c4311c4594ebca` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:50.245266 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d346b98fa9d5441eb4c4311c4594ebca)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:50.247766 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:50.347366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:50.348788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd346b98fa9d5441eb4c4311c4594ebca', 'request_id': 'req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:50.450268 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd346b98fa9d5441eb4c4311c4594ebca', 'request_id': 'req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:50.457568 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd346b98fa9d5441eb4c4311c4594ebca', 'request_id': 'req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:50.468468 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] The token cache is being invalidate because project d346b98fa9d5441eb4c4311c4594ebca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:50.468764 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:50.469425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:50.470986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1375/2752] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:50 2022] DELETE /identity/v3/projects/d346b98fa9d5441eb4c4311c4594ebca => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:50.475682 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa14b56-4760-44c5-b536-c6b9ecf11e04 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:50.485776 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa14b56-4760-44c5-b536-c6b9ecf11e04 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:50.550684 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:50.551583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:50.551868 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:50.552260 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] PATH_INFO: `/v3/users/4a031dadb30b416b8e079a87eb690500` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:50.553810 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a031dadb30b416b8e079a87eb690500)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:50.555835 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:50.757331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a031dadb30b416b8e079a87eb690500'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:50.770210 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a031dadb30b416b8e079a87eb690500'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:50.864160 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a031dadb30b416b8e079a87eb690500'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:50.865490 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a031dadb30b416b8e079a87eb690500'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:50.866267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a031dadb30b416b8e079a87eb690500'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:50.869247 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:50.884796 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1378/2753] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:50 2022] DELETE /identity/v3/users/4a031dadb30b416b8e079a87eb690500 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:51.339644 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:51.341197 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:51.354842 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4cdbb-f6cf-40f2-888d-d892d982dbd8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:51.415541 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:51.416421 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:51.416701 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:51.417012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] PATH_INFO: `/v3/projects/6669cd6341d64115ae07443a1100014d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:51.418269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6669cd6341d64115ae07443a1100014d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:51.420232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:51.554960 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6669cd6341d64115ae07443a1100014d', 'request_id': 'req-d7f8cc46-6f4c-4505-8b73-b212d933e586'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:51.674936 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6669cd6341d64115ae07443a1100014d', 'request_id': 'req-d7f8cc46-6f4c-4505-8b73-b212d933e586'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:51.682754 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6669cd6341d64115ae07443a1100014d', 'request_id': 'req-d7f8cc46-6f4c-4505-8b73-b212d933e586'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:51.694633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] The token cache is being invalidate because project 6669cd6341d64115ae07443a1100014d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:51.694919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:51.695606 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:51.697265 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1376/2754] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:51 2022] DELETE /identity/v3/projects/6669cd6341d64115ae07443a1100014d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:51.701204 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:51.702790 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:51.715869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa593c3-f2b8-4efb-9dc7-44c1bc4e36fd admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:51.773540 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c3e3b-454e-45d5-be84-2f19861d40e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:51.774428 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c3e3b-454e-45d5-be84-2f19861d40e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:51.774716 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c3e3b-454e-45d5-be84-2f19861d40e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:51.774998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c3e3b-454e-45d5-be84-2f19861d40e5 admin admin] PATH_INFO: `/v3/users/0d4395e15f294624b4d271d5ab3f8e34` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:51.776278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c3e3b-454e-45d5-be84-2f19861d40e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4395e15f294624b4d271d5ab3f8e34)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:51.778386 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19c3e3b-454e-45d5-be84-2f19861d40e5 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:51.962163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c19c3e3b-454e-45d5-be84-2f19861d40e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4395e15f294624b4d271d5ab3f8e34'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:51.974185 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c19c3e3b-454e-45d5-be84-2f19861d40e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4395e15f294624b4d271d5ab3f8e34'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:52.063760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c19c3e3b-454e-45d5-be84-2f19861d40e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4395e15f294624b4d271d5ab3f8e34'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:52.064381 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c19c3e3b-454e-45d5-be84-2f19861d40e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4395e15f294624b4d271d5ab3f8e34'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:52.065031 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-c19c3e3b-454e-45d5-be84-2f19861d40e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4395e15f294624b4d271d5ab3f8e34'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:52.078999 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1379/2755] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:51 2022] DELETE /identity/v3/users/0d4395e15f294624b4d271d5ab3f8e34 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:52.703668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:52.705222 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:52.719530 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8cc46-6f4c-4505-8b73-b212d933e586 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:52.783252 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:52.784125 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:52.784411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:52.784697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44 admin admin] PATH_INFO: `/v3/projects/31bb6aaf59a04fe79d87516372aca391` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:52.785940 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31bb6aaf59a04fe79d87516372aca391)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:52.788717 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:52.800072 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:52.960315 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31bb6aaf59a04fe79d87516372aca391', 'request_id': 'req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:53.035384 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31bb6aaf59a04fe79d87516372aca391', 'request_id': 'req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:53.042352 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31bb6aaf59a04fe79d87516372aca391', 'request_id': 'req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:53.052337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44 admin admin] The token cache is being invalidate because project 31bb6aaf59a04fe79d87516372aca391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:53.052553 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:53.053209 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-65d0b15f-73ac-4c84-9e14-bd66a4bdab44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:53.054771 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1377/2756] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:52 2022] DELETE /identity/v3/projects/31bb6aaf59a04fe79d87516372aca391 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:53.059830 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f3130-a29b-4374-8c05-bf15517d2daf None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.060354 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f3130-a29b-4374-8c05-bf15517d2daf None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.060454 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f3130-a29b-4374-8c05-bf15517d2daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:53.081597 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d31f3130-a29b-4374-8c05-bf15517d2daf None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:53.082924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d31f3130-a29b-4374-8c05-bf15517d2daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:53.144327 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1380/2757] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:53.152131 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b9beb-02ab-4890-947f-699c6423ec29 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.152427 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b9beb-02ab-4890-947f-699c6423ec29 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.152712 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b9beb-02ab-4890-947f-699c6423ec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:53.172306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-b84b9beb-02ab-4890-947f-699c6423ec29 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:53.176088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b84b9beb-02ab-4890-947f-699c6423ec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:53.182277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1378/2758] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:53.186474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f3130-a29b-4374-8c05-bf15517d2daf None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:53.197139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f3130-a29b-4374-8c05-bf15517d2daf None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:53.202048 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ca91b-27ab-409b-97a0-dcfae2bfe221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:53.210765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ca91b-27ab-409b-97a0-dcfae2bfe221 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.210765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ca91b-27ab-409b-97a0-dcfae2bfe221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.210765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ca91b-27ab-409b-97a0-dcfae2bfe221 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:53.210765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ca91b-27ab-409b-97a0-dcfae2bfe221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:53.210765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ca91b-27ab-409b-97a0-dcfae2bfe221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:53.210765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ca91b-27ab-409b-97a0-dcfae2bfe221 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:53.213052 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:53.218435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1381/2759] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:19:53.222929 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b9beb-02ab-4890-947f-699c6423ec29 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:53.232308 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b9beb-02ab-4890-947f-699c6423ec29 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:53.237228 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dece8f-08d7-460b-a639-b3884c455772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:53.237888 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dece8f-08d7-460b-a639-b3884c455772 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.238175 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dece8f-08d7-460b-a639-b3884c455772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.238455 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dece8f-08d7-460b-a639-b3884c455772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:53.239284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dece8f-08d7-460b-a639-b3884c455772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:53.241806 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dece8f-08d7-460b-a639-b3884c455772 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:53.328261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1379/2760] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:53 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:53.332824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ca91b-27ab-409b-97a0-dcfae2bfe221 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:53.342775 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ca91b-27ab-409b-97a0-dcfae2bfe221 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:53.398120 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5807ddb-9dd5-49f3-b11a-b0e52e2ed346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:53.398795 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5807ddb-9dd5-49f3-b11a-b0e52e2ed346 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.399073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5807ddb-9dd5-49f3-b11a-b0e52e2ed346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.399353 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5807ddb-9dd5-49f3-b11a-b0e52e2ed346 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:53.400043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5807ddb-9dd5-49f3-b11a-b0e52e2ed346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:53.401993 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5807ddb-9dd5-49f3-b11a-b0e52e2ed346 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:53.502824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1382/2761] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:53 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:53.507364 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dece8f-08d7-460b-a639-b3884c455772 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:53.517683 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dece8f-08d7-460b-a639-b3884c455772 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:53.522417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c87c1c-121f-4587-bc33-edb2d09845f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:53.523088 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c87c1c-121f-4587-bc33-edb2d09845f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.523356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c87c1c-121f-4587-bc33-edb2d09845f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.523649 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c87c1c-121f-4587-bc33-edb2d09845f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:53.524362 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c87c1c-121f-4587-bc33-edb2d09845f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:53.526004 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c87c1c-121f-4587-bc33-edb2d09845f2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:53.536910 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1380/2762] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:53.541814 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5807ddb-9dd5-49f3-b11a-b0e52e2ed346 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:53.552065 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5807ddb-9dd5-49f3-b11a-b0e52e2ed346 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:53.557635 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f43fb-c3a3-47b6-b173-1ac3001b9c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:53.558299 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f43fb-c3a3-47b6-b173-1ac3001b9c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.558583 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f43fb-c3a3-47b6-b173-1ac3001b9c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.558859 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f43fb-c3a3-47b6-b173-1ac3001b9c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:53.559582 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f43fb-c3a3-47b6-b173-1ac3001b9c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:53.561232 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f43fb-c3a3-47b6-b173-1ac3001b9c82 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:53.571418 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1383/2763] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:53.576226 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c87c1c-121f-4587-bc33-edb2d09845f2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:53.586271 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c87c1c-121f-4587-bc33-edb2d09845f2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:53.590708 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1d1de-65d8-4acb-8da5-4c1437607814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:53.591584 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d1de-65d8-4acb-8da5-4c1437607814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.591867 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d1de-65d8-4acb-8da5-4c1437607814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.592144 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d1de-65d8-4acb-8da5-4c1437607814 admin admin] PATH_INFO: `/v3/projects/8dabf656a1614689a4796e08e544e29f/users/2e60b51462424cbba5f832c612c65880/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:53.608828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1d1de-65d8-4acb-8da5-4c1437607814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dabf656a1614689a4796e08e544e29f, user_id=2e60b51462424cbba5f832c612c65880, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:53.611477 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1d1de-65d8-4acb-8da5-4c1437607814 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:53.620329 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f43fb-c3a3-47b6-b173-1ac3001b9c82 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:53.622115 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-3e1f43fb-c3a3-47b6-b173-1ac3001b9c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:53.635358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f43fb-c3a3-47b6-b173-1ac3001b9c82 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:53.641163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604638b-bcc2-4768-be79-65aede4ebb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:53.645068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604638b-bcc2-4768-be79-65aede4ebb9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.645068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604638b-bcc2-4768-be79-65aede4ebb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.645068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604638b-bcc2-4768-be79-65aede4ebb9b admin admin] PATH_INFO: `/v3/users/ab0ed56a89de45b191dbeba0df0426a9` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:53.645068 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604638b-bcc2-4768-be79-65aede4ebb9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0ed56a89de45b191dbeba0df0426a9)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:53.647739 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604638b-bcc2-4768-be79-65aede4ebb9b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:53.716422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1381/2764] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:53 2022] PUT /identity/v3/projects/8dabf656a1614689a4796e08e544e29f/users/2e60b51462424cbba5f832c612c65880/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:53.721464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd8725-889c-49b7-bcda-8a62efdde349 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.721735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd8725-889c-49b7-bcda-8a62efdde349 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.722011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfd8725-889c-49b7-bcda-8a62efdde349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:53.739805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-8dfd8725-889c-49b7-bcda-8a62efdde349 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:53.741076 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8dfd8725-889c-49b7-bcda-8a62efdde349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:53.800304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1382/2765] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:53.810016 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd8725-889c-49b7-bcda-8a62efdde349 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:53.811373 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8dfd8725-889c-49b7-bcda-8a62efdde349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:53.848401 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:53.848609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9604638b-bcc2-4768-be79-65aede4ebb9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0ed56a89de45b191dbeba0df0426a9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:53.860976 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9604638b-bcc2-4768-be79-65aede4ebb9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0ed56a89de45b191dbeba0df0426a9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:53.875567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfd8725-889c-49b7-bcda-8a62efdde349 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:53.879210 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0d17a-7b5d-4422-a265-b2e1a186e9aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:53.879857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0d17a-7b5d-4422-a265-b2e1a186e9aa service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.880140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0d17a-7b5d-4422-a265-b2e1a186e9aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.880417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0d17a-7b5d-4422-a265-b2e1a186e9aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:53.889386 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0d17a-7b5d-4422-a265-b2e1a186e9aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:53.890811 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0d17a-7b5d-4422-a265-b2e1a186e9aa service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:53.901196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1383/2766] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:53.920832 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0d17a-7b5d-4422-a265-b2e1a186e9aa service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:53.922242 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9cc0d17a-7b5d-4422-a265-b2e1a186e9aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:53.936179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0d17a-7b5d-4422-a265-b2e1a186e9aa service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:53.940856 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:53.941741 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.942028 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.942312 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] PATH_INFO: `/v3/users/da3ba8a4c9c1478a876b3a7ab11d0d90` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:53.943516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3ba8a4c9c1478a876b3a7ab11d0d90)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:53.946227 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:53.955087 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9604638b-bcc2-4768-be79-65aede4ebb9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0ed56a89de45b191dbeba0df0426a9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:53.955786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9604638b-bcc2-4768-be79-65aede4ebb9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0ed56a89de45b191dbeba0df0426a9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:53.956477 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-9604638b-bcc2-4768-be79-65aede4ebb9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0ed56a89de45b191dbeba0df0426a9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:53.973208 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1384/2767] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:53 2022] DELETE /identity/v3/users/ab0ed56a89de45b191dbeba0df0426a9 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:53.978653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb74617-f788-4204-bce2-f31de2534408 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:53.978947 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb74617-f788-4204-bce2-f31de2534408 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:53.979230 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb74617-f788-4204-bce2-f31de2534408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:54.001493 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-2bb74617-f788-4204-bce2-f31de2534408 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:54.002914 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2bb74617-f788-4204-bce2-f31de2534408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:54.068287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:54.084816 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1385/2768] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:54.095001 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb74617-f788-4204-bce2-f31de2534408 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:54.096474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2bb74617-f788-4204-bce2-f31de2534408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:54.153059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb74617-f788-4204-bce2-f31de2534408 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:54.157075 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bf0a9-5eb2-41ed-a0bd-bf981d776be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:54.159340 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf0a9-5eb2-41ed-a0bd-bf981d776be9 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:54.159340 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf0a9-5eb2-41ed-a0bd-bf981d776be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:54.159340 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf0a9-5eb2-41ed-a0bd-bf981d776be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:54.167266 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bf0a9-5eb2-41ed-a0bd-bf981d776be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:54.168702 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bf0a9-5eb2-41ed-a0bd-bf981d776be9 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:54.179339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1386/2769] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:54.445212 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3ba8a4c9c1478a876b3a7ab11d0d90'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:54.461993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3ba8a4c9c1478a876b3a7ab11d0d90'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:54.538230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3ba8a4c9c1478a876b3a7ab11d0d90'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:54.538953 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3ba8a4c9c1478a876b3a7ab11d0d90'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:54.539540 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3ba8a4c9c1478a876b3a7ab11d0d90'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:54.552833 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1384/2770] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:19:53 2022] DELETE /identity/v3/users/da3ba8a4c9c1478a876b3a7ab11d0d90 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:54.557866 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3587a-1c57-421c-92d5-5bf846a97d22 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:54.558182 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3587a-1c57-421c-92d5-5bf846a97d22 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:54.558461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3587a-1c57-421c-92d5-5bf846a97d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:54.578554 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-13e3587a-1c57-421c-92d5-5bf846a97d22 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:54.579791 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-13e3587a-1c57-421c-92d5-5bf846a97d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:54.621801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:54.623686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:54.648109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1387/2771] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:54.664056 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3587a-1c57-421c-92d5-5bf846a97d22 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:54.665360 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-13e3587a-1c57-421c-92d5-5bf846a97d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:54.714369 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3181b-7dd4-46f7-ae4c-9cfd4505f48e admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:54.720159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:54.721142 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:54.721507 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:54.721864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b admin admin] PATH_INFO: `/v3/projects/dbab03669747457dbdac5136c042f858` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:54.723151 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbab03669747457dbdac5136c042f858)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:54.725894 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:54.746202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3587a-1c57-421c-92d5-5bf846a97d22 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:54.749964 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af074cbf-90fc-4b87-a5b5-009791776298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:54.753438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af074cbf-90fc-4b87-a5b5-009791776298 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:54.753438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af074cbf-90fc-4b87-a5b5-009791776298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:54.753438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af074cbf-90fc-4b87-a5b5-009791776298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:54.761710 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af074cbf-90fc-4b87-a5b5-009791776298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:54.763251 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af074cbf-90fc-4b87-a5b5-009791776298 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:54.776664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1388/2772] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:54.893389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbab03669747457dbdac5136c042f858', 'request_id': 'req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:54.895033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:54.995074 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbab03669747457dbdac5136c042f858', 'request_id': 'req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:55.001866 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbab03669747457dbdac5136c042f858', 'request_id': 'req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:55.013056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b admin admin] The token cache is being invalidate because project dbab03669747457dbdac5136c042f858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:55.013351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:55.014073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-53a66a82-94f7-4a9f-81b0-07be0d87cf1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:55.016167 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1385/2773] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:54 2022] DELETE /identity/v3/projects/dbab03669747457dbdac5136c042f858 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:55.024591 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddf3bf-9a8e-4206-a732-dfb9e87211d8 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.024913 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddf3bf-9a8e-4206-a732-dfb9e87211d8 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.025195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddf3bf-9a8e-4206-a732-dfb9e87211d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.045259 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-7dddf3bf-9a8e-4206-a732-dfb9e87211d8 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:55.046465 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-7dddf3bf-9a8e-4206-a732-dfb9e87211d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:55.078497 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:55.107972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1389/2774] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:55.119510 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914d685-e708-4ecd-9590-2c2d0146770f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.119798 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914d685-e708-4ecd-9590-2c2d0146770f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.120075 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914d685-e708-4ecd-9590-2c2d0146770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.139552 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-1914d685-e708-4ecd-9590-2c2d0146770f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:55.140693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-1914d685-e708-4ecd-9590-2c2d0146770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:55.149465 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1386/2775] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:55.154050 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddf3bf-9a8e-4206-a732-dfb9e87211d8 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:55.164176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddf3bf-9a8e-4206-a732-dfb9e87211d8 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:55.169130 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5edad1-9f79-4fbf-83e3-efa124d148e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:55.169879 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5edad1-9f79-4fbf-83e3-efa124d148e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.170238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5edad1-9f79-4fbf-83e3-efa124d148e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.170586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5edad1-9f79-4fbf-83e3-efa124d148e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.171397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5edad1-9f79-4fbf-83e3-efa124d148e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:55.171780 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5edad1-9f79-4fbf-83e3-efa124d148e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:55.173436 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5edad1-9f79-4fbf-83e3-efa124d148e1 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:55.188514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1390/2776] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:19:55.192320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914d685-e708-4ecd-9590-2c2d0146770f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:55.201864 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914d685-e708-4ecd-9590-2c2d0146770f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:55.208066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc2663-8d15-49e2-8eb7-7e31b4e226e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:55.208729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2663-8d15-49e2-8eb7-7e31b4e226e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.209052 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2663-8d15-49e2-8eb7-7e31b4e226e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.209545 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc2663-8d15-49e2-8eb7-7e31b4e226e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.210669 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc2663-8d15-49e2-8eb7-7e31b4e226e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:55.212629 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc2663-8d15-49e2-8eb7-7e31b4e226e3 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:55.314674 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1387/2777] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:55 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:55.314863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5edad1-9f79-4fbf-83e3-efa124d148e1 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:55.314863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6a5edad1-9f79-4fbf-83e3-efa124d148e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:55.315837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc2663-8d15-49e2-8eb7-7e31b4e226e3 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:55.330897 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5edad1-9f79-4fbf-83e3-efa124d148e1 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:55.383237 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc2663-8d15-49e2-8eb7-7e31b4e226e3 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:55.387991 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2014ed-131d-4a76-898b-aa17a5251ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:55.388679 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2014ed-131d-4a76-898b-aa17a5251ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.388990 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2014ed-131d-4a76-898b-aa17a5251ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.389270 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2014ed-131d-4a76-898b-aa17a5251ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.390012 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2014ed-131d-4a76-898b-aa17a5251ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:55.391843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2014ed-131d-4a76-898b-aa17a5251ea2 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:55.393885 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:55.394804 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.395097 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.395380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] PATH_INFO: `/v3/projects/b4fd831100ca4415b18259b4787a778b` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.396595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4fd831100ca4415b18259b4787a778b)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:55.399267 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:55.493653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1388/2778] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:55 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:55.497440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2014ed-131d-4a76-898b-aa17a5251ea2 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:55.507880 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2014ed-131d-4a76-898b-aa17a5251ea2 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:55.512544 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023d9b6-b10e-44ab-862f-d29446d26dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:55.513244 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023d9b6-b10e-44ab-862f-d29446d26dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.513529 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023d9b6-b10e-44ab-862f-d29446d26dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.513933 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023d9b6-b10e-44ab-862f-d29446d26dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.514684 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023d9b6-b10e-44ab-862f-d29446d26dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:55.516298 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d023d9b6-b10e-44ab-862f-d29446d26dc1 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:55.533024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1389/2779] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:55.533024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023d9b6-b10e-44ab-862f-d29446d26dc1 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:55.544071 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d023d9b6-b10e-44ab-862f-d29446d26dc1 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:55.557760 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4fd831100ca4415b18259b4787a778b', 'request_id': 'req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:55.609073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f206fe-46b8-4316-9c26-94aa9a019100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:55.609755 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f206fe-46b8-4316-9c26-94aa9a019100 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.610051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f206fe-46b8-4316-9c26-94aa9a019100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.610328 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f206fe-46b8-4316-9c26-94aa9a019100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.611066 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f206fe-46b8-4316-9c26-94aa9a019100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:55.612649 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4fd831100ca4415b18259b4787a778b', 'request_id': 'req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:55.616729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f206fe-46b8-4316-9c26-94aa9a019100 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:55.628205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4fd831100ca4415b18259b4787a778b', 'request_id': 'req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:55.628360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1390/2780] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:55.628360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbb3cf-4437-482a-8de5-8c876f409c05 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.628592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbb3cf-4437-482a-8de5-8c876f409c05 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.629179 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cbb3cf-4437-482a-8de5-8c876f409c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.637287 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] The token cache is being invalidate because project b4fd831100ca4415b18259b4787a778b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:19:55.637676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:55.638365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:19:55.640078 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1391/2781] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:19:55 2022] DELETE /identity/v3/projects/b4fd831100ca4415b18259b4787a778b => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:55.643928 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:55.645305 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:55.657957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-45cbb3cf-4437-482a-8de5-8c876f409c05 None None] MFA Rules not processed for user `2e60b51462424cbba5f832c612c65880`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:55.659194 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-45cbb3cf-4437-482a-8de5-8c876f409c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:55.659796 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792c585-aa0d-4cfa-a441-c7d0fca6ea3c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:55.665324 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f65a6d-7d8d-45e3-94e3-1affb9c17d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:55.666205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f65a6d-7d8d-45e3-94e3-1affb9c17d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.667975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f65a6d-7d8d-45e3-94e3-1affb9c17d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.667975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f65a6d-7d8d-45e3-94e3-1affb9c17d26 admin admin] PATH_INFO: `/v3/projects/d98c5356d54b4a5584f15d127c6710a7/users/7539297f66c244838cc504d54d2d9513/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.682294 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f65a6d-7d8d-45e3-94e3-1affb9c17d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98c5356d54b4a5584f15d127c6710a7, user_id=7539297f66c244838cc504d54d2d9513, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:55.685044 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f65a6d-7d8d-45e3-94e3-1affb9c17d26 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:55.723471 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1391/2782] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:55.725763 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74d6c-9df7-4231-be9a-d8e3497c8c45 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.726058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74d6c-9df7-4231-be9a-d8e3497c8c45 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.726336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a74d6c-9df7-4231-be9a-d8e3497c8c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.743811 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-22a74d6c-9df7-4231-be9a-d8e3497c8c45 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:55.745063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-22a74d6c-9df7-4231-be9a-d8e3497c8c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:55.753295 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1392/2783] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:55.754062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a74d6c-9df7-4231-be9a-d8e3497c8c45 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:55.755357 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-22a74d6c-9df7-4231-be9a-d8e3497c8c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:55.796310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1392/2784] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:55 2022] PUT /identity/v3/projects/d98c5356d54b4a5584f15d127c6710a7/users/7539297f66c244838cc504d54d2d9513/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:19:55.797811 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fc43a-845a-4119-84dc-0f840e791359 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.798103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fc43a-845a-4119-84dc-0f840e791359 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.798383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fc43a-845a-4119-84dc-0f840e791359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.819758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e34fc43a-845a-4119-84dc-0f840e791359 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:55.821053 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e34fc43a-845a-4119-84dc-0f840e791359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:55.827642 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a74d6c-9df7-4231-be9a-d8e3497c8c45 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:55.850841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:55.888861 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1815e7-884c-4759-bf51-3d991a8539d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:55.889518 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1815e7-884c-4759-bf51-3d991a8539d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.889805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1815e7-884c-4759-bf51-3d991a8539d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.890140 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1815e7-884c-4759-bf51-3d991a8539d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.895523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1393/2785] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:55.897460 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d003a-7c17-490f-a2bb-fce1fdb3794d None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.897761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d003a-7c17-490f-a2bb-fce1fdb3794d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.898043 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d003a-7c17-490f-a2bb-fce1fdb3794d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.925396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-e96d003a-7c17-490f-a2bb-fce1fdb3794d None None] MFA Rules not processed for user `7539297f66c244838cc504d54d2d9513`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:55.926606 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e96d003a-7c17-490f-a2bb-fce1fdb3794d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:55.947922 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1815e7-884c-4759-bf51-3d991a8539d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:55.949503 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1815e7-884c-4759-bf51-3d991a8539d9 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:55.958973 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1393/2786] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:55.960475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1815e7-884c-4759-bf51-3d991a8539d9 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:55.972316 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1815e7-884c-4759-bf51-3d991a8539d9 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:55.976863 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ada166-cbf2-4b1c-b1ee-a639ba20cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:55.977605 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ada166-cbf2-4b1c-b1ee-a639ba20cfeb admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:55.977899 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ada166-cbf2-4b1c-b1ee-a639ba20cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:55.978183 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ada166-cbf2-4b1c-b1ee-a639ba20cfeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:55.978920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ada166-cbf2-4b1c-b1ee-a639ba20cfeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:19:55.979234 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ada166-cbf2-4b1c-b1ee-a639ba20cfeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:55.981024 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ada166-cbf2-4b1c-b1ee-a639ba20cfeb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:55.993039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1394/2787] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:56.000507 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1394/2788] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:19:56.000987 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d003a-7c17-490f-a2bb-fce1fdb3794d None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.001638 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ada166-cbf2-4b1c-b1ee-a639ba20cfeb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.008751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d003a-7c17-490f-a2bb-fce1fdb3794d None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.012923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ada166-cbf2-4b1c-b1ee-a639ba20cfeb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.013786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359cd6c-f01e-4acc-a721-dfae04e0a058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.014614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359cd6c-f01e-4acc-a721-dfae04e0a058 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.015252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359cd6c-f01e-4acc-a721-dfae04e0a058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.015535 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359cd6c-f01e-4acc-a721-dfae04e0a058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.016479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359cd6c-f01e-4acc-a721-dfae04e0a058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.018464 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359cd6c-f01e-4acc-a721-dfae04e0a058 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.018867 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755c7f6-af94-48a8-b6d3-7f6e31ddd081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.020655 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755c7f6-af94-48a8-b6d3-7f6e31ddd081 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.021164 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:56.028581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755c7f6-af94-48a8-b6d3-7f6e31ddd081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.028581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755c7f6-af94-48a8-b6d3-7f6e31ddd081 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.028581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755c7f6-af94-48a8-b6d3-7f6e31ddd081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.028581 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755c7f6-af94-48a8-b6d3-7f6e31ddd081 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.091240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1395/2789] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:55 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:56.092932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359cd6c-f01e-4acc-a721-dfae04e0a058 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.154440 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359cd6c-f01e-4acc-a721-dfae04e0a058 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.159120 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738200c4-eac6-42fc-ac85-7b22078de600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.159781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738200c4-eac6-42fc-ac85-7b22078de600 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.160061 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738200c4-eac6-42fc-ac85-7b22078de600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.160337 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738200c4-eac6-42fc-ac85-7b22078de600 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.161055 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738200c4-eac6-42fc-ac85-7b22078de600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.163787 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738200c4-eac6-42fc-ac85-7b22078de600 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.174693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1395/2790] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:19:56 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:19:56.178634 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755c7f6-af94-48a8-b6d3-7f6e31ddd081 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.239577 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755c7f6-af94-48a8-b6d3-7f6e31ddd081 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.244449 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f3b7-ff5a-4781-96dd-0d84f67175a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.245150 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f3b7-ff5a-4781-96dd-0d84f67175a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.245437 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f3b7-ff5a-4781-96dd-0d84f67175a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.245723 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35f3b7-ff5a-4781-96dd-0d84f67175a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.246413 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f3b7-ff5a-4781-96dd-0d84f67175a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.248314 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35f3b7-ff5a-4781-96dd-0d84f67175a9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.256977 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1396/2791] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:56 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:56.260990 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738200c4-eac6-42fc-ac85-7b22078de600 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.270565 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738200c4-eac6-42fc-ac85-7b22078de600 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.275919 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800624d-17d5-44d5-a18b-3222c152794b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.276557 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800624d-17d5-44d5-a18b-3222c152794b admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.276877 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800624d-17d5-44d5-a18b-3222c152794b admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.277164 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800624d-17d5-44d5-a18b-3222c152794b admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.277891 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800624d-17d5-44d5-a18b-3222c152794b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.279757 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800624d-17d5-44d5-a18b-3222c152794b admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.290768 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1397/2792] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:56.294246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800624d-17d5-44d5-a18b-3222c152794b admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.303826 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800624d-17d5-44d5-a18b-3222c152794b admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.308451 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bc767-b922-4751-94ca-58ca426c14b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.309332 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bc767-b922-4751-94ca-58ca426c14b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.309617 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bc767-b922-4751-94ca-58ca426c14b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.309899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bc767-b922-4751-94ca-58ca426c14b7 admin admin] PATH_INFO: `/v3/projects/f9dcbbd172f04853a9dc4acf93287244/users/6d7293aa92974714bd22c4dab31006c1/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.325169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bc767-b922-4751-94ca-58ca426c14b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9dcbbd172f04853a9dc4acf93287244, user_id=6d7293aa92974714bd22c4dab31006c1, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.327794 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bc767-b922-4751-94ca-58ca426c14b7 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.344706 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1396/2793] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:19:56 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 13:19:56.348476 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f3b7-ff5a-4781-96dd-0d84f67175a9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.358482 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35f3b7-ff5a-4781-96dd-0d84f67175a9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.363149 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d64cea-8d9f-42c5-a1b0-7cd6d6198a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.363772 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d64cea-8d9f-42c5-a1b0-7cd6d6198a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.364055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d64cea-8d9f-42c5-a1b0-7cd6d6198a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.364335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d64cea-8d9f-42c5-a1b0-7cd6d6198a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.365086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d64cea-8d9f-42c5-a1b0-7cd6d6198a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.367259 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d64cea-8d9f-42c5-a1b0-7cd6d6198a08 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.377213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1397/2794] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:56.380691 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d64cea-8d9f-42c5-a1b0-7cd6d6198a08 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.390585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d64cea-8d9f-42c5-a1b0-7cd6d6198a08 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.395309 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2f024-20b9-4e9d-acae-48b67eaabaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.395951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2f024-20b9-4e9d-acae-48b67eaabaeb admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.396238 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2f024-20b9-4e9d-acae-48b67eaabaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.396521 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2f024-20b9-4e9d-acae-48b67eaabaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.397383 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2f024-20b9-4e9d-acae-48b67eaabaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.398951 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2f024-20b9-4e9d-acae-48b67eaabaeb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.409975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1398/2795] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:19:56.413970 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2f024-20b9-4e9d-acae-48b67eaabaeb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.417266 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1398/2796] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:56 2022] PUT /identity/v3/projects/f9dcbbd172f04853a9dc4acf93287244/users/6d7293aa92974714bd22c4dab31006c1/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:56.420653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bc767-b922-4751-94ca-58ca426c14b7 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.424049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2f024-20b9-4e9d-acae-48b67eaabaeb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.482662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d5398-32bf-4d65-a86e-c65b29883825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.483656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d5398-32bf-4d65-a86e-c65b29883825 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.484019 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d5398-32bf-4d65-a86e-c65b29883825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.484377 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d5398-32bf-4d65-a86e-c65b29883825 admin admin] PATH_INFO: `/v3/projects/bf48146e1af64ea7b1365fa8e63261cb/users/873e526f6adf4567bbdddd578c977309/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.484604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bc767-b922-4751-94ca-58ca426c14b7 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.489321 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8f1d2-7040-44b1-8bd5-767bbf1e4750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.489984 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8f1d2-7040-44b1-8bd5-767bbf1e4750 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.490273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8f1d2-7040-44b1-8bd5-767bbf1e4750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.491120 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8f1d2-7040-44b1-8bd5-767bbf1e4750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.491846 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8f1d2-7040-44b1-8bd5-767bbf1e4750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.493495 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8f1d2-7040-44b1-8bd5-767bbf1e4750 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.499986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d5398-32bf-4d65-a86e-c65b29883825 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf48146e1af64ea7b1365fa8e63261cb, user_id=873e526f6adf4567bbdddd578c977309, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.502699 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d5398-32bf-4d65-a86e-c65b29883825 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.503426 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1399/2797] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:19:56.508323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8f1d2-7040-44b1-8bd5-767bbf1e4750 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.518084 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8f1d2-7040-44b1-8bd5-767bbf1e4750 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.523341 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e79c47-b573-4712-86fd-7b882b277063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.524209 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e79c47-b573-4712-86fd-7b882b277063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.524494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e79c47-b573-4712-86fd-7b882b277063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.524776 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e79c47-b573-4712-86fd-7b882b277063 admin admin] PATH_INFO: `/v3/projects/f9dcbbd172f04853a9dc4acf93287244/users/6d7293aa92974714bd22c4dab31006c1/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.529203 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e79c47-b573-4712-86fd-7b882b277063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9dcbbd172f04853a9dc4acf93287244, user_id=6d7293aa92974714bd22c4dab31006c1, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.529772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e79c47-b573-4712-86fd-7b882b277063 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.539842 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1400/2798] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:56 2022] PUT /identity/v3/projects/f9dcbbd172f04853a9dc4acf93287244/users/6d7293aa92974714bd22c4dab31006c1/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:56.549738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b062d-2f6e-4007-bf98-175a9ec245d4 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.550032 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b062d-2f6e-4007-bf98-175a9ec245d4 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.550317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b062d-2f6e-4007-bf98-175a9ec245d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.576950 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-911b062d-2f6e-4007-bf98-175a9ec245d4 None None] MFA Rules not processed for user `6d7293aa92974714bd22c4dab31006c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:56.578161 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-911b062d-2f6e-4007-bf98-175a9ec245d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:56.609277 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1399/2799] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:19:56 2022] PUT /identity/v3/projects/bf48146e1af64ea7b1365fa8e63261cb/users/873e526f6adf4567bbdddd578c977309/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:19:56.636245 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b22237-9a73-4824-a404-155675c594b4 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.637966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b22237-9a73-4824-a404-155675c594b4 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.639044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b22237-9a73-4824-a404-155675c594b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.656491 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1401/2800] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:19:56.670278 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b062d-2f6e-4007-bf98-175a9ec245d4 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.675230 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-26b22237-9a73-4824-a404-155675c594b4 None None] MFA Rules not processed for user `873e526f6adf4567bbdddd578c977309`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:56.683307 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-26b22237-9a73-4824-a404-155675c594b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:56.731917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b062d-2f6e-4007-bf98-175a9ec245d4 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.761398 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1400/2801] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:19:56.773366 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b22237-9a73-4824-a404-155675c594b4 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:19:56.776586 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-26b22237-9a73-4824-a404-155675c594b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:56.791818 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb202fd-5132-439b-94b4-2f598febba18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.792479 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb202fd-5132-439b-94b4-2f598febba18 service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.792786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb202fd-5132-439b-94b4-2f598febba18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.793972 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb202fd-5132-439b-94b4-2f598febba18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.798906 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:56.833747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b22237-9a73-4824-a404-155675c594b4 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:19:56.837749 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d4c2a-14c6-4cfe-aa58-ec8cf7d006f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:19:56.838405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4c2a-14c6-4cfe-aa58-ec8cf7d006f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:56.838689 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4c2a-14c6-4cfe-aa58-ec8cf7d006f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:56.838969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d4c2a-14c6-4cfe-aa58-ec8cf7d006f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:56.847657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d4c2a-14c6-4cfe-aa58-ec8cf7d006f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.850554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d4c2a-14c6-4cfe-aa58-ec8cf7d006f8 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.858742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1401/2802] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:19:56.860659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb202fd-5132-439b-94b4-2f598febba18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:19:56.862193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb202fd-5132-439b-94b4-2f598febba18 service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:19:56.872959 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1402/2803] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:19:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:19:56.882033 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:57.040974 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:57.274571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:19:57.803425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bb07b-ca97-4b83-a247-e1b213ec73da None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:19:57.804037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bb07b-ca97-4b83-a247-e1b213ec73da None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:19:57.804037 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bb07b-ca97-4b83-a247-e1b213ec73da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:19:57.821954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-a48bb07b-ca97-4b83-a247-e1b213ec73da None None] MFA Rules not processed for user `2e60b51462424cbba5f832c612c65880`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:19:57.823939 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-a48bb07b-ca97-4b83-a247-e1b213ec73da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:19:57.893165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1402/2804] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:19:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:00.010824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb202fd-5132-439b-94b4-2f598febba18 service cinder] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:00.075073 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb202fd-5132-439b-94b4-2f598febba18 service cinder] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:00.079640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:00.080503 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:00.080783 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:00.081086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] PATH_INFO: `/v3/users/7539297f66c244838cc504d54d2d9513` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:00.082288 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=7539297f66c244838cc504d54d2d9513)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:00.084457 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:00.323015 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7539297f66c244838cc504d54d2d9513'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:00.334994 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7539297f66c244838cc504d54d2d9513'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:00.413494 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7539297f66c244838cc504d54d2d9513'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:00.414167 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7539297f66c244838cc504d54d2d9513'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:00.414781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7539297f66c244838cc504d54d2d9513'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:00.416841 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:00.428461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1403/2805] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:20:00 2022] DELETE /identity/v3/users/7539297f66c244838cc504d54d2d9513 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:00.438185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe9432-01b4-4dd3-8260-a28869fddd5f None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:00.438185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe9432-01b4-4dd3-8260-a28869fddd5f None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:00.438185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe9432-01b4-4dd3-8260-a28869fddd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:00.451967 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-51fe9432-01b4-4dd3-8260-a28869fddd5f None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:00.453232 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-51fe9432-01b4-4dd3-8260-a28869fddd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:00.512935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1403/2806] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:00.522679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:00.524174 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:00.583127 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da62f2-6f09-447e-a005-399b620fd7ae admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:00.586893 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69389ca2-21d0-42be-a2fe-5061bdad0612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:00.587609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69389ca2-21d0-42be-a2fe-5061bdad0612 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:00.587874 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69389ca2-21d0-42be-a2fe-5061bdad0612 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:00.588676 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69389ca2-21d0-42be-a2fe-5061bdad0612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:00.599423 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69389ca2-21d0-42be-a2fe-5061bdad0612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:00.600873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69389ca2-21d0-42be-a2fe-5061bdad0612 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:00.616948 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1404/2807] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:20:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:20:01.053556 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe9432-01b4-4dd3-8260-a28869fddd5f None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:01.054989 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-51fe9432-01b4-4dd3-8260-a28869fddd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:01.067987 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe9432-01b4-4dd3-8260-a28869fddd5f None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:01.087613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:01.087613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:01.087613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:01.087613 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] PATH_INFO: `/v3/projects/d98c5356d54b4a5584f15d127c6710a7` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:01.088084 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d98c5356d54b4a5584f15d127c6710a7)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:01.090021 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:01.098934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=100 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:01.227671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd98c5356d54b4a5584f15d127c6710a7', 'request_id': 'req-6fef6ed0-775a-4ecb-a62d-949a84c6a814'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:01.319250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd98c5356d54b4a5584f15d127c6710a7', 'request_id': 'req-6fef6ed0-775a-4ecb-a62d-949a84c6a814'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:01.327269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd98c5356d54b4a5584f15d127c6710a7', 'request_id': 'req-6fef6ed0-775a-4ecb-a62d-949a84c6a814'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:01.343792 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] The token cache is being invalidate because project d98c5356d54b4a5584f15d127c6710a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:20:01.344303 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:01.345136 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:01.347214 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1404/2808] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:20:01 2022] DELETE /identity/v3/projects/d98c5356d54b4a5584f15d127c6710a7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:01.351248 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69389ca2-21d0-42be-a2fe-5061bdad0612 service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:01.362412 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69389ca2-21d0-42be-a2fe-5061bdad0612 service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:01.426927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd4a29-3c0c-4c2e-a0c0-d3c750d9a946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:01.426927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd4a29-3c0c-4c2e-a0c0-d3c750d9a946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:01.426927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd4a29-3c0c-4c2e-a0c0-d3c750d9a946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:01.426927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd4a29-3c0c-4c2e-a0c0-d3c750d9a946 admin admin] PATH_INFO: `/v3/users/6d7293aa92974714bd22c4dab31006c1` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:01.427481 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd4a29-3c0c-4c2e-a0c0-d3c750d9a946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7293aa92974714bd22c4dab31006c1)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:01.428740 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd4a29-3c0c-4c2e-a0c0-d3c750d9a946 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:01.701009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8bfd4a29-3c0c-4c2e-a0c0-d3c750d9a946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7293aa92974714bd22c4dab31006c1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:01.714470 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8bfd4a29-3c0c-4c2e-a0c0-d3c750d9a946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7293aa92974714bd22c4dab31006c1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:01.783742 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8bfd4a29-3c0c-4c2e-a0c0-d3c750d9a946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7293aa92974714bd22c4dab31006c1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:01.784396 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8bfd4a29-3c0c-4c2e-a0c0-d3c750d9a946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7293aa92974714bd22c4dab31006c1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:01.785035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8bfd4a29-3c0c-4c2e-a0c0-d3c750d9a946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7293aa92974714bd22c4dab31006c1'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:01.799487 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1405/2809] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:20:01 2022] DELETE /identity/v3/users/6d7293aa92974714bd22c4dab31006c1 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:20:02.349614 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:02.351938 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:02.368603 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef6ed0-775a-4ecb-a62d-949a84c6a814 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:02.440374 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1abe8f-0942-49ec-a60f-9785ff506a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:02.441282 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1abe8f-0942-49ec-a60f-9785ff506a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:02.441568 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1abe8f-0942-49ec-a60f-9785ff506a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:02.441851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1abe8f-0942-49ec-a60f-9785ff506a90 admin admin] PATH_INFO: `/v3/projects/f9dcbbd172f04853a9dc4acf93287244` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:02.443058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1abe8f-0942-49ec-a60f-9785ff506a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9dcbbd172f04853a9dc4acf93287244)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:02.445051 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1abe8f-0942-49ec-a60f-9785ff506a90 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:02.571826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e1abe8f-0942-49ec-a60f-9785ff506a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9dcbbd172f04853a9dc4acf93287244', 'request_id': 'req-4e1abe8f-0942-49ec-a60f-9785ff506a90'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:02.662269 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e1abe8f-0942-49ec-a60f-9785ff506a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9dcbbd172f04853a9dc4acf93287244', 'request_id': 'req-4e1abe8f-0942-49ec-a60f-9785ff506a90'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:02.671057 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e1abe8f-0942-49ec-a60f-9785ff506a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9dcbbd172f04853a9dc4acf93287244', 'request_id': 'req-4e1abe8f-0942-49ec-a60f-9785ff506a90'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:02.686322 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e1abe8f-0942-49ec-a60f-9785ff506a90 admin admin] The token cache is being invalidate because project f9dcbbd172f04853a9dc4acf93287244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:20:02.686622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e1abe8f-0942-49ec-a60f-9785ff506a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:02.687671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-4e1abe8f-0942-49ec-a60f-9785ff506a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:02.690011 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1405/2810] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:20:02 2022] DELETE /identity/v3/projects/f9dcbbd172f04853a9dc4acf93287244 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:02.700291 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14486e-e6e2-4b59-a795-2368f58035a2 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:02.700911 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14486e-e6e2-4b59-a795-2368f58035a2 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:02.701365 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d14486e-e6e2-4b59-a795-2368f58035a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:02.722945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-2d14486e-e6e2-4b59-a795-2368f58035a2 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:02.724276 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2d14486e-e6e2-4b59-a795-2368f58035a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:02.730720 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:02.792548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1406/2811] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:02.794460 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7ca06-c23b-4c4d-b801-fcd19adb6a1b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:02.794751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7ca06-c23b-4c4d-b801-fcd19adb6a1b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:02.795041 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7ca06-c23b-4c4d-b801-fcd19adb6a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:02.817579 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-55c7ca06-c23b-4c4d-b801-fcd19adb6a1b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:02.818805 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-55c7ca06-c23b-4c4d-b801-fcd19adb6a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:02.829193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1406/2812] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:02.833421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14486e-e6e2-4b59-a795-2368f58035a2 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:02.846798 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d14486e-e6e2-4b59-a795-2368f58035a2 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:02.852751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160873a4-9dca-4fcf-8595-080a54440085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:02.853567 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160873a4-9dca-4fcf-8595-080a54440085 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:02.854154 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160873a4-9dca-4fcf-8595-080a54440085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:02.854965 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160873a4-9dca-4fcf-8595-080a54440085 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:02.856303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160873a4-9dca-4fcf-8595-080a54440085 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:20:02.856303 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160873a4-9dca-4fcf-8595-080a54440085 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:02.858266 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160873a4-9dca-4fcf-8595-080a54440085 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:02.892981 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1407/2813] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:20:02.897286 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7ca06-c23b-4c4d-b801-fcd19adb6a1b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:02.909122 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7ca06-c23b-4c4d-b801-fcd19adb6a1b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:02.922715 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e2f0-d693-4b89-ab33-e40742891f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:02.923412 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e2f0-d693-4b89-ab33-e40742891f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:02.923705 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e2f0-d693-4b89-ab33-e40742891f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:02.923990 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e2f0-d693-4b89-ab33-e40742891f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:02.928356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471e2f0-d693-4b89-ab33-e40742891f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:02.928356 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471e2f0-d693-4b89-ab33-e40742891f29 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:02.949756 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:03.040387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1407/2814] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:20:02 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:20:03.042235 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160873a4-9dca-4fcf-8595-080a54440085 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:03.072755 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160873a4-9dca-4fcf-8595-080a54440085 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:03.163124 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6ac7-9faa-4c58-828e-de3786b44ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:03.164325 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6ac7-9faa-4c58-828e-de3786b44ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:03.164766 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6ac7-9faa-4c58-828e-de3786b44ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:03.165561 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6ac7-9faa-4c58-828e-de3786b44ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:03.166664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6ac7-9faa-4c58-828e-de3786b44ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:03.169376 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c6ac7-9faa-4c58-828e-de3786b44ac8 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:03.253213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1408/2815] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:20:03 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:20:03.257585 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e2f0-d693-4b89-ab33-e40742891f29 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:03.285513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e2f0-d693-4b89-ab33-e40742891f29 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:03.285513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf484ce-8d29-43ed-b0e9-99c67ff32beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:03.285513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf484ce-8d29-43ed-b0e9-99c67ff32beb admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:03.285513 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf484ce-8d29-43ed-b0e9-99c67ff32beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:03.286338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf484ce-8d29-43ed-b0e9-99c67ff32beb admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:03.286338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf484ce-8d29-43ed-b0e9-99c67ff32beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:03.286338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf484ce-8d29-43ed-b0e9-99c67ff32beb admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:03.294624 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1408/2816] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:20:03.298462 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6ac7-9faa-4c58-828e-de3786b44ac8 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:03.310121 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c6ac7-9faa-4c58-828e-de3786b44ac8 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:03.315383 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408d455-9fad-4125-a33f-65638acac0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:03.316047 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408d455-9fad-4125-a33f-65638acac0de admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:03.316331 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408d455-9fad-4125-a33f-65638acac0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:03.316605 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408d455-9fad-4125-a33f-65638acac0de admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:03.317397 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408d455-9fad-4125-a33f-65638acac0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:03.319032 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408d455-9fad-4125-a33f-65638acac0de admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:03.333161 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1409/2817] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:20:03.334478 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf484ce-8d29-43ed-b0e9-99c67ff32beb admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:03.345934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf484ce-8d29-43ed-b0e9-99c67ff32beb admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:03.350825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99810e74-e882-4ab0-8b2b-cb6320fdf8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:03.351730 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810e74-e882-4ab0-8b2b-cb6320fdf8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:03.352013 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810e74-e882-4ab0-8b2b-cb6320fdf8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:03.352404 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99810e74-e882-4ab0-8b2b-cb6320fdf8a8 admin admin] PATH_INFO: `/v3/projects/837acd34cee048c7bd2948483038a269/users/5b9a5ac5b7d3422b81c5b39818efcc5b/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:03.371202 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99810e74-e882-4ab0-8b2b-cb6320fdf8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=837acd34cee048c7bd2948483038a269, user_id=5b9a5ac5b7d3422b81c5b39818efcc5b, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:03.373901 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99810e74-e882-4ab0-8b2b-cb6320fdf8a8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:03.447736 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1409/2818] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:20:03 2022] PUT /identity/v3/projects/837acd34cee048c7bd2948483038a269/users/5b9a5ac5b7d3422b81c5b39818efcc5b/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:03.462045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75324602-b40f-4cb7-b954-fd27fda9849a None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:03.462584 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75324602-b40f-4cb7-b954-fd27fda9849a None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:03.463052 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75324602-b40f-4cb7-b954-fd27fda9849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:03.494466 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-75324602-b40f-4cb7-b954-fd27fda9849a None None] MFA Rules not processed for user `5b9a5ac5b7d3422b81c5b39818efcc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:03.496222 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-75324602-b40f-4cb7-b954-fd27fda9849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:03.575149 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1410/2819] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:03.584941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99810e74-e882-4ab0-8b2b-cb6320fdf8a8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:03.587109 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-99810e74-e882-4ab0-8b2b-cb6320fdf8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:03.656295 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99810e74-e882-4ab0-8b2b-cb6320fdf8a8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:03.661002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28712a-250e-4054-8a5a-6974d37ad942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:03.662185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28712a-250e-4054-8a5a-6974d37ad942 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:03.662863 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28712a-250e-4054-8a5a-6974d37ad942 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:03.663284 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28712a-250e-4054-8a5a-6974d37ad942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:03.673495 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28712a-250e-4054-8a5a-6974d37ad942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:03.674914 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28712a-250e-4054-8a5a-6974d37ad942 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:03.684367 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1410/2820] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:20:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:20:08.697869 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75324602-b40f-4cb7-b954-fd27fda9849a None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:08.699391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-75324602-b40f-4cb7-b954-fd27fda9849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:08.709155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:08.716843 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28712a-250e-4054-8a5a-6974d37ad942 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:08.718354 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-7a28712a-250e-4054-8a5a-6974d37ad942 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:08.777461 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75324602-b40f-4cb7-b954-fd27fda9849a None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:08.785867 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a7738-4bf9-4526-b587-d65667b41455 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b5745bfb5d4e6ca172bb8fab229e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:08.786537 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a7738-4bf9-4526-b587-d65667b41455 service placement] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:08.786822 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a7738-4bf9-4526-b587-d65667b41455 service placement] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:08.787099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a7738-4bf9-4526-b587-d65667b41455 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:08.787601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28712a-250e-4054-8a5a-6974d37ad942 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:08.788917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-505a7738-4bf9-4526-b587-d65667b41455 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:08.792610 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:08.793592 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:08.793882 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:08.794159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] PATH_INFO: `/v3/users/873e526f6adf4567bbdddd578c977309` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:08.795422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=873e526f6adf4567bbdddd578c977309)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:08.797624 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:08.801427 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a7738-4bf9-4526-b587-d65667b41455 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:08.803233 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a7738-4bf9-4526-b587-d65667b41455 service placement] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:08.814153 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1411/2821] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:20:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:20:09.088743 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '873e526f6adf4567bbdddd578c977309'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:09.106524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '873e526f6adf4567bbdddd578c977309'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:09.109497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:09.205462 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '873e526f6adf4567bbdddd578c977309'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:09.206768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '873e526f6adf4567bbdddd578c977309'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:09.207526 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '873e526f6adf4567bbdddd578c977309'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:09.220969 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1411/2822] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:20:08 2022] DELETE /identity/v3/users/873e526f6adf4567bbdddd578c977309 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:20:09.225555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a619b15-360f-4c8d-909b-3342d02871ca None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:09.225851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a619b15-360f-4c8d-909b-3342d02871ca None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:09.226131 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a619b15-360f-4c8d-909b-3342d02871ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:09.246669 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-6a619b15-360f-4c8d-909b-3342d02871ca None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:09.248505 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6a619b15-360f-4c8d-909b-3342d02871ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:09.308475 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1412/2823] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:09.318941 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:09.320447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:09.385278 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c1ea0-ac79-4bb8-9b8c-28ff587ba785 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:09.389108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5c8f4-7c2f-4a5b-9d58-d3b7e5a6ee7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:09.389768 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5c8f4-7c2f-4a5b-9d58-d3b7e5a6ee7f service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:09.390574 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5c8f4-7c2f-4a5b-9d58-d3b7e5a6ee7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:09.390860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5c8f4-7c2f-4a5b-9d58-d3b7e5a6ee7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:09.402444 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5c8f4-7c2f-4a5b-9d58-d3b7e5a6ee7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:09.404570 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5c8f4-7c2f-4a5b-9d58-d3b7e5a6ee7f service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:09.420654 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1412/2824] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:20:09.950829 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a619b15-360f-4c8d-909b-3342d02871ca None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:09.952285 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-6a619b15-360f-4c8d-909b-3342d02871ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:09.964330 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a619b15-360f-4c8d-909b-3342d02871ca None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:09.970465 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:09.971384 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:09.971662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:09.971938 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115 admin admin] PATH_INFO: `/v3/projects/bf48146e1af64ea7b1365fa8e63261cb` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:09.973870 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf48146e1af64ea7b1365fa8e63261cb)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:09.975905 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:10.081860 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf48146e1af64ea7b1365fa8e63261cb', 'request_id': 'req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:10.155555 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf48146e1af64ea7b1365fa8e63261cb', 'request_id': 'req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:10.162767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf48146e1af64ea7b1365fa8e63261cb', 'request_id': 'req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:10.176909 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115 admin admin] The token cache is being invalidate because project bf48146e1af64ea7b1365fa8e63261cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:20:10.177280 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:10.178007 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-a86645ca-0488-4ae8-b3b7-de0bd0bfc115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:10.180012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1413/2825] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:20:09 2022] DELETE /identity/v3/projects/bf48146e1af64ea7b1365fa8e63261cb => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:10.184889 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc39ce8-946c-42da-9344-ebab32ce7069 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:10.186485 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc39ce8-946c-42da-9344-ebab32ce7069 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:10.186485 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc39ce8-946c-42da-9344-ebab32ce7069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:10.205620 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-efc39ce8-946c-42da-9344-ebab32ce7069 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:10.206837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-efc39ce8-946c-42da-9344-ebab32ce7069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:10.277738 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1413/2826] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:10.286404 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95827bea-6b0b-4a3b-88a4-27f026c71db6 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:10.286698 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95827bea-6b0b-4a3b-88a4-27f026c71db6 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:10.286975 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95827bea-6b0b-4a3b-88a4-27f026c71db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:10.310301 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-95827bea-6b0b-4a3b-88a4-27f026c71db6 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:10.311534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-95827bea-6b0b-4a3b-88a4-27f026c71db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:10.323123 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1414/2827] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:20:10.329042 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc39ce8-946c-42da-9344-ebab32ce7069 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:10.338988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc39ce8-946c-42da-9344-ebab32ce7069 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:10.344619 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ae8ba-c32d-4877-9111-41e155a9abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:10.345261 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ae8ba-c32d-4877-9111-41e155a9abda admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:10.345609 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ae8ba-c32d-4877-9111-41e155a9abda admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:10.345956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ae8ba-c32d-4877-9111-41e155a9abda admin admin] PATH_INFO: `/v3/domains` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:10.346760 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ae8ba-c32d-4877-9111-41e155a9abda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80299) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:20:10.347155 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ae8ba-c32d-4877-9111-41e155a9abda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:10.348837 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ae8ba-c32d-4877-9111-41e155a9abda admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:10.362409 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1414/2828] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:20:10.366659 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95827bea-6b0b-4a3b-88a4-27f026c71db6 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:10.377606 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95827bea-6b0b-4a3b-88a4-27f026c71db6 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:10.382534 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533377c-96a4-48a4-b90b-2925eae2d402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:10.383314 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533377c-96a4-48a4-b90b-2925eae2d402 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:10.383604 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533377c-96a4-48a4-b90b-2925eae2d402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:10.383882 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533377c-96a4-48a4-b90b-2925eae2d402 admin admin] PATH_INFO: `/v3/projects` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:10.384571 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533377c-96a4-48a4-b90b-2925eae2d402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:10.386508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533377c-96a4-48a4-b90b-2925eae2d402 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:10.396653 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:10.531824 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1415/2829] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:20:10 2022] POST /identity/v3/projects => generated 397 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:20:10.535747 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ae8ba-c32d-4877-9111-41e155a9abda admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:10.546363 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ae8ba-c32d-4877-9111-41e155a9abda admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:10.607623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19695f44-8854-4ff1-8b94-4ba735de6b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:10.608336 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19695f44-8854-4ff1-8b94-4ba735de6b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:10.608622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19695f44-8854-4ff1-8b94-4ba735de6b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:10.608957 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19695f44-8854-4ff1-8b94-4ba735de6b9b admin admin] PATH_INFO: `/v3/users` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:10.609655 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19695f44-8854-4ff1-8b94-4ba735de6b9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:10.611567 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19695f44-8854-4ff1-8b94-4ba735de6b9b admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:10.693871 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1415/2830] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:20:10 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:20:10.698380 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533377c-96a4-48a4-b90b-2925eae2d402 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:10.710144 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533377c-96a4-48a4-b90b-2925eae2d402 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:10.714916 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f4868-4b13-42da-8d0a-69ae88fd90d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:10.715569 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4868-4b13-42da-8d0a-69ae88fd90d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:10.715851 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4868-4b13-42da-8d0a-69ae88fd90d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:10.717354 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f4868-4b13-42da-8d0a-69ae88fd90d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:10.724614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f4868-4b13-42da-8d0a-69ae88fd90d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:10.724614 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f4868-4b13-42da-8d0a-69ae88fd90d4 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:10.740192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1416/2831] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 13:20:10.744446 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19695f44-8854-4ff1-8b94-4ba735de6b9b admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:10.749780 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:10.755533 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19695f44-8854-4ff1-8b94-4ba735de6b9b admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:10.760734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd7c9a-9286-4546-a9d1-c026945674a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:10.761439 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd7c9a-9286-4546-a9d1-c026945674a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:10.761725 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd7c9a-9286-4546-a9d1-c026945674a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:10.762027 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd7c9a-9286-4546-a9d1-c026945674a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:10.763539 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd7c9a-9286-4546-a9d1-c026945674a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:10.765729 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd7c9a-9286-4546-a9d1-c026945674a0 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:10.777188 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1416/2832] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:20:10.782125 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f4868-4b13-42da-8d0a-69ae88fd90d4 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:10.792242 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f4868-4b13-42da-8d0a-69ae88fd90d4 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:10.797594 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68065c42-4c99-42de-aba2-939e1cbf2091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:10.798469 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68065c42-4c99-42de-aba2-939e1cbf2091 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:10.798749 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68065c42-4c99-42de-aba2-939e1cbf2091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:10.799117 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68065c42-4c99-42de-aba2-939e1cbf2091 admin admin] PATH_INFO: `/v3/projects/02c8f6ed1b6f412384217c57061c851d/users/f664b546ae8a40d195deb630924f1ef7/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:10.814221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68065c42-4c99-42de-aba2-939e1cbf2091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c8f6ed1b6f412384217c57061c851d, user_id=f664b546ae8a40d195deb630924f1ef7, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:10.817109 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68065c42-4c99-42de-aba2-939e1cbf2091 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:10.920498 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1417/2833] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:20:10 2022] PUT /identity/v3/projects/02c8f6ed1b6f412384217c57061c851d/users/f664b546ae8a40d195deb630924f1ef7/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:10.931727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374950-7305-4faa-b8a1-7fbdf18e8cae None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:10.932023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374950-7305-4faa-b8a1-7fbdf18e8cae None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:10.932306 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72374950-7305-4faa-b8a1-7fbdf18e8cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:10.959942 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-72374950-7305-4faa-b8a1-7fbdf18e8cae None None] MFA Rules not processed for user `f664b546ae8a40d195deb630924f1ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:10.961393 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-72374950-7305-4faa-b8a1-7fbdf18e8cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:11.028017 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1417/2834] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:11.042725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68065c42-4c99-42de-aba2-939e1cbf2091 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:11.045032 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-68065c42-4c99-42de-aba2-939e1cbf2091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:11.104401 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68065c42-4c99-42de-aba2-939e1cbf2091 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:11.108166 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c6786-3e81-47b2-a948-264b8146a59f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:11.108827 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c6786-3e81-47b2-a948-264b8146a59f service cinder] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:11.109116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c6786-3e81-47b2-a948-264b8146a59f service cinder] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:11.109395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c6786-3e81-47b2-a948-264b8146a59f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:11.118151 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c6786-3e81-47b2-a948-264b8146a59f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:11.119599 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c6786-3e81-47b2-a948-264b8146a59f service cinder] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:11.129306 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1418/2835] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:20:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:20:15.632007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72374950-7305-4faa-b8a1-7fbdf18e8cae None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:15.633440 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-72374950-7305-4faa-b8a1-7fbdf18e8cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:15.698047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72374950-7305-4faa-b8a1-7fbdf18e8cae None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:15.702749 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:15.703621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:15.703909 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:15.704187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] PATH_INFO: `/v3/users/5b9a5ac5b7d3422b81c5b39818efcc5b` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:15.707015 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b9a5ac5b7d3422b81c5b39818efcc5b)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:15.707309 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:16.039601 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b9a5ac5b7d3422b81c5b39818efcc5b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:16.055207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b9a5ac5b7d3422b81c5b39818efcc5b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:16.160464 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b9a5ac5b7d3422b81c5b39818efcc5b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:16.161134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b9a5ac5b7d3422b81c5b39818efcc5b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:16.161750 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b9a5ac5b7d3422b81c5b39818efcc5b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:16.170715 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:16.175587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1418/2836] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:20:15 2022] DELETE /identity/v3/users/5b9a5ac5b7d3422b81c5b39818efcc5b => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:16.180272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85726621-37e3-4fdb-9e3a-fc3323f7e917 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:16.180754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85726621-37e3-4fdb-9e3a-fc3323f7e917 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:16.180880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85726621-37e3-4fdb-9e3a-fc3323f7e917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:16.199099 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-85726621-37e3-4fdb-9e3a-fc3323f7e917 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:16.200310 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-85726621-37e3-4fdb-9e3a-fc3323f7e917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:16.265472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1419/2837] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:16.281423 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:16.285229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:16.314828 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f913f4-1439-4d30-aa83-303d5e496f91 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:16.315120 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f913f4-1439-4d30-aa83-303d5e496f91 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:16.315402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f913f4-1439-4d30-aa83-303d5e496f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:16.340063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-92f913f4-1439-4d30-aa83-303d5e496f91 None None] MFA Rules not processed for user `2e60b51462424cbba5f832c612c65880`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:16.341395 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-92f913f4-1439-4d30-aa83-303d5e496f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:16.353741 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4250d7-51a9-4b8e-b290-c2fa1f424133 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:16.357453 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22d513-60cf-4857-8662-e74e262b183b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:16.363246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22d513-60cf-4857-8662-e74e262b183b service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:16.363246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22d513-60cf-4857-8662-e74e262b183b service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:16.363246 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22d513-60cf-4857-8662-e74e262b183b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:16.368345 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22d513-60cf-4857-8662-e74e262b183b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:16.370304 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22d513-60cf-4857-8662-e74e262b183b service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:16.380317 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1419/2838] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:20:16.400199 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1420/2839] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:20:16.991682 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22d513-60cf-4857-8662-e74e262b183b service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:16.993326 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-bb22d513-60cf-4857-8662-e74e262b183b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:17.006980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22d513-60cf-4857-8662-e74e262b183b service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:17.012055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ebf64-546a-4351-a13b-42b02d011a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:17.015995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ebf64-546a-4351-a13b-42b02d011a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:17.015995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ebf64-546a-4351-a13b-42b02d011a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:17.015995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ebf64-546a-4351-a13b-42b02d011a69 admin admin] PATH_INFO: `/v3/projects/837acd34cee048c7bd2948483038a269` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:17.015995 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ebf64-546a-4351-a13b-42b02d011a69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=837acd34cee048c7bd2948483038a269)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:17.016734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ebf64-546a-4351-a13b-42b02d011a69 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:17.158680 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-db1ebf64-546a-4351-a13b-42b02d011a69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '837acd34cee048c7bd2948483038a269', 'request_id': 'req-db1ebf64-546a-4351-a13b-42b02d011a69'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:17.245048 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-db1ebf64-546a-4351-a13b-42b02d011a69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '837acd34cee048c7bd2948483038a269', 'request_id': 'req-db1ebf64-546a-4351-a13b-42b02d011a69'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:17.253563 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-db1ebf64-546a-4351-a13b-42b02d011a69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '837acd34cee048c7bd2948483038a269', 'request_id': 'req-db1ebf64-546a-4351-a13b-42b02d011a69'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:17.264966 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-db1ebf64-546a-4351-a13b-42b02d011a69 admin admin] The token cache is being invalidate because project 837acd34cee048c7bd2948483038a269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:20:17.265896 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-db1ebf64-546a-4351-a13b-42b02d011a69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:17.266566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-db1ebf64-546a-4351-a13b-42b02d011a69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:17.268289 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1420/2840] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:20:16 2022] DELETE /identity/v3/projects/837acd34cee048c7bd2948483038a269 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:17.370767 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f913f4-1439-4d30-aa83-303d5e496f91 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:17.372238 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-92f913f4-1439-4d30-aa83-303d5e496f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:17.382408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:17.388499 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f913f4-1439-4d30-aa83-303d5e496f91 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:17.451634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:17.452640 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:17.453009 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:17.453236 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] PATH_INFO: `/v3/users/f664b546ae8a40d195deb630924f1ef7` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:17.454531 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f664b546ae8a40d195deb630924f1ef7)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:17.456518 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:17.674586 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f664b546ae8a40d195deb630924f1ef7'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:17.686510 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f664b546ae8a40d195deb630924f1ef7'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:17.770339 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f664b546ae8a40d195deb630924f1ef7'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:17.770969 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f664b546ae8a40d195deb630924f1ef7'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:17.771579 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f664b546ae8a40d195deb630924f1ef7'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:17.786213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1421/2841] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:20:17 2022] DELETE /identity/v3/users/f664b546ae8a40d195deb630924f1ef7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:17.790804 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3b361-c12f-4739-a9b4-137c56340d5c None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:17.791091 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3b361-c12f-4739-a9b4-137c56340d5c None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:17.791993 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3b361-c12f-4739-a9b4-137c56340d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:17.811275 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-e9f3b361-c12f-4739-a9b4-137c56340d5c None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:17.815062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e9f3b361-c12f-4739-a9b4-137c56340d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:17.873172 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1421/2842] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:17.886508 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:17.887927 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:17.947205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f61408-37a2-4cf0-9e52-5b997e8275ad admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:17.951016 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574d2f9-b8cd-4c9a-b64f-8eea433a6253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:17.951685 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574d2f9-b8cd-4c9a-b64f-8eea433a6253 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:17.952092 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574d2f9-b8cd-4c9a-b64f-8eea433a6253 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:17.952995 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574d2f9-b8cd-4c9a-b64f-8eea433a6253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:17.962524 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574d2f9-b8cd-4c9a-b64f-8eea433a6253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:17.963917 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574d2f9-b8cd-4c9a-b64f-8eea433a6253 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:17.974074 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1422/2843] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:20:18.379823 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3b361-c12f-4739-a9b4-137c56340d5c None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:18.381358 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-e9f3b361-c12f-4739-a9b4-137c56340d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:18.394954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f3b361-c12f-4739-a9b4-137c56340d5c None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:18.399788 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:18.400672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:18.400988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:18.401267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140 admin admin] PATH_INFO: `/v3/projects/02c8f6ed1b6f412384217c57061c851d` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:18.402488 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c8f6ed1b6f412384217c57061c851d)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:18.404828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:18.431668 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:18.555839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c8f6ed1b6f412384217c57061c851d', 'request_id': 'req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:18.663119 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c8f6ed1b6f412384217c57061c851d', 'request_id': 'req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:18.669946 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c8f6ed1b6f412384217c57061c851d', 'request_id': 'req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:18.680789 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140 admin admin] The token cache is being invalidate because project 02c8f6ed1b6f412384217c57061c851d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:20:18.681105 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:18.681732 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-0491c27a-7ce0-44b8-a14f-9f2a4cf77140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:20:18.683323 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1422/2844] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:20:18 2022] DELETE /identity/v3/projects/02c8f6ed1b6f412384217c57061c851d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:18.688951 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f75700-998b-4994-b08c-fdabf2b5f4cd None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:18.689433 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f75700-998b-4994-b08c-fdabf2b5f4cd None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:18.689563 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f75700-998b-4994-b08c-fdabf2b5f4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:18.708949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-46f75700-998b-4994-b08c-fdabf2b5f4cd None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:18.710139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-46f75700-998b-4994-b08c-fdabf2b5f4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:18.730664 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:18.770163 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1423/2845] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:18.778196 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ebbb-e1a9-4b15-812b-3cc361dcf08b None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:18.778516 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ebbb-e1a9-4b15-812b-3cc361dcf08b None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:18.778799 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55ebbb-e1a9-4b15-812b-3cc361dcf08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:18.798480 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-da55ebbb-e1a9-4b15-812b-3cc361dcf08b None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:18.799686 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-da55ebbb-e1a9-4b15-812b-3cc361dcf08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:18.807751 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1423/2846] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:18.811923 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f75700-998b-4994-b08c-fdabf2b5f4cd None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:18.821622 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f75700-998b-4994-b08c-fdabf2b5f4cd None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:18.826171 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4235d-2792-4e55-92d6-d2404ffc278a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:18.826821 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4235d-2792-4e55-92d6-d2404ffc278a admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:18.827116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4235d-2792-4e55-92d6-d2404ffc278a admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:18.827474 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4235d-2792-4e55-92d6-d2404ffc278a admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:18.828202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4235d-2792-4e55-92d6-d2404ffc278a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:20:18.828512 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4235d-2792-4e55-92d6-d2404ffc278a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:18.830161 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4235d-2792-4e55-92d6-d2404ffc278a admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:18.841513 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1424/2847] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 13:20:18.847058 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ebbb-e1a9-4b15-812b-3cc361dcf08b None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:18.856725 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55ebbb-e1a9-4b15-812b-3cc361dcf08b None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:18.868663 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a69ff-c7c5-4ca6-aea8-557d96c22e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:18.869506 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a69ff-c7c5-4ca6-aea8-557d96c22e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:18.869796 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a69ff-c7c5-4ca6-aea8-557d96c22e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:18.870097 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a69ff-c7c5-4ca6-aea8-557d96c22e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:18.870760 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a69ff-c7c5-4ca6-aea8-557d96c22e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:18.872734 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4a69ff-c7c5-4ca6-aea8-557d96c22e69 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:19.002207 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1424/2848] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:20:18 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:20:19.006280 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4235d-2792-4e55-92d6-d2404ffc278a admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:19.016472 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4235d-2792-4e55-92d6-d2404ffc278a admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:19.081189 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04538ad-29e0-404d-8d59-070f490b1e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:19.081786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04538ad-29e0-404d-8d59-070f490b1e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:19.082070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04538ad-29e0-404d-8d59-070f490b1e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:19.082345 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04538ad-29e0-404d-8d59-070f490b1e19 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:19.083033 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04538ad-29e0-404d-8d59-070f490b1e19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:19.084998 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04538ad-29e0-404d-8d59-070f490b1e19 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:19.189634 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1425/2849] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:20:19 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:20:19.193696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a69ff-c7c5-4ca6-aea8-557d96c22e69 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:19.204594 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a69ff-c7c5-4ca6-aea8-557d96c22e69 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:19.209165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294e2db-f6b1-4e13-93d4-df61125f16e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:19.209822 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294e2db-f6b1-4e13-93d4-df61125f16e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:19.210114 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294e2db-f6b1-4e13-93d4-df61125f16e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:19.210394 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294e2db-f6b1-4e13-93d4-df61125f16e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:19.211239 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294e2db-f6b1-4e13-93d4-df61125f16e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:19.212860 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294e2db-f6b1-4e13-93d4-df61125f16e9 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:19.224396 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1425/2850] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:20:19.228511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04538ad-29e0-404d-8d59-070f490b1e19 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:19.239338 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04538ad-29e0-404d-8d59-070f490b1e19 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:19.244177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32b72a-6918-43be-8470-75df1795d022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:19.244872 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32b72a-6918-43be-8470-75df1795d022 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:19.245159 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32b72a-6918-43be-8470-75df1795d022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:19.245462 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32b72a-6918-43be-8470-75df1795d022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:19.246194 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32b72a-6918-43be-8470-75df1795d022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:19.247796 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32b72a-6918-43be-8470-75df1795d022 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:19.261649 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1426/2851] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:20:19.262878 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294e2db-f6b1-4e13-93d4-df61125f16e9 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:19.273844 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294e2db-f6b1-4e13-93d4-df61125f16e9 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:19.278735 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a72583-737c-48af-bf2e-5dcb26ef6702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:19.279877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a72583-737c-48af-bf2e-5dcb26ef6702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:19.280160 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a72583-737c-48af-bf2e-5dcb26ef6702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:19.280497 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a72583-737c-48af-bf2e-5dcb26ef6702 admin admin] PATH_INFO: `/v3/projects/53b3a1d657d94275a460f02fc4e91b08/users/7a243e2660c74b57825654abc251cdf9/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:19.297096 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a72583-737c-48af-bf2e-5dcb26ef6702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b3a1d657d94275a460f02fc4e91b08, user_id=7a243e2660c74b57825654abc251cdf9, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:19.301108 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a72583-737c-48af-bf2e-5dcb26ef6702 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:19.433840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1426/2852] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:20:19 2022] PUT /identity/v3/projects/53b3a1d657d94275a460f02fc4e91b08/users/7a243e2660c74b57825654abc251cdf9/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:19.444450 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff53ab0-5212-45df-99d3-11d31b55de97 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:19.444746 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff53ab0-5212-45df-99d3-11d31b55de97 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:19.445176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff53ab0-5212-45df-99d3-11d31b55de97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:19.464257 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-2ff53ab0-5212-45df-99d3-11d31b55de97 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:19.465511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-2ff53ab0-5212-45df-99d3-11d31b55de97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:19.527192 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1427/2853] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:20:19.537566 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a72583-737c-48af-bf2e-5dcb26ef6702 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:19.539259 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-53a72583-737c-48af-bf2e-5dcb26ef6702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:19.602047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a72583-737c-48af-bf2e-5dcb26ef6702 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:19.605696 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a673618-2b03-46c1-b800-273db7b9c48f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:19.606365 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a673618-2b03-46c1-b800-273db7b9c48f service neutron] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:19.606646 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a673618-2b03-46c1-b800-273db7b9c48f service neutron] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:19.606920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a673618-2b03-46c1-b800-273db7b9c48f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:19.616225 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a673618-2b03-46c1-b800-273db7b9c48f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:19.617697 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a673618-2b03-46c1-b800-273db7b9c48f service neutron] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:19.628466 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1427/2854] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:20:25.436793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c78589-32f2-41de-88e4-5bbfc9053010 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:25.436793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c78589-32f2-41de-88e4-5bbfc9053010 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:25.437595 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c78589-32f2-41de-88e4-5bbfc9053010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:25.464856 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-c3c78589-32f2-41de-88e4-5bbfc9053010 None None] MFA Rules not processed for user `7a243e2660c74b57825654abc251cdf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:25.466082 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-c3c78589-32f2-41de-88e4-5bbfc9053010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:25.488177 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:25.562328 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1428/2855] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:25.563008 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a673618-2b03-46c1-b800-273db7b9c48f service neutron] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:25.573000 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a673618-2b03-46c1-b800-273db7b9c48f service neutron] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:25.580342 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae38d7-32a5-46b3-840f-d2a9b15be8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:25.581363 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae38d7-32a5-46b3-840f-d2a9b15be8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:25.581839 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae38d7-32a5-46b3-840f-d2a9b15be8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:25.582124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccae38d7-32a5-46b3-840f-d2a9b15be8b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:25.582840 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae38d7-32a5-46b3-840f-d2a9b15be8b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:25.584920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccae38d7-32a5-46b3-840f-d2a9b15be8b8 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:25.671850 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1428/2856] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:20:25 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:20:25.674012 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c78589-32f2-41de-88e4-5bbfc9053010 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:25.685086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c78589-32f2-41de-88e4-5bbfc9053010 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:25.744071 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390b8b9-4eeb-4ef1-8828-2e89453cafb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:25.744880 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390b8b9-4eeb-4ef1-8828-2e89453cafb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:25.745169 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390b8b9-4eeb-4ef1-8828-2e89453cafb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:25.745447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f390b8b9-4eeb-4ef1-8828-2e89453cafb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:25.746150 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390b8b9-4eeb-4ef1-8828-2e89453cafb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:25.748183 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f390b8b9-4eeb-4ef1-8828-2e89453cafb7 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:25.880155 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1429/2857] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:20:25 2022] POST /identity/v3/users => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:20:25.889023 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae38d7-32a5-46b3-840f-d2a9b15be8b8 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:25.899937 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccae38d7-32a5-46b3-840f-d2a9b15be8b8 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:25.905130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27bdb1-69f0-4e81-9f38-ac90db2d60ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:25.905835 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27bdb1-69f0-4e81-9f38-ac90db2d60ed admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:25.906157 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27bdb1-69f0-4e81-9f38-ac90db2d60ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:25.906447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27bdb1-69f0-4e81-9f38-ac90db2d60ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:25.907180 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27bdb1-69f0-4e81-9f38-ac90db2d60ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:25.908765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27bdb1-69f0-4e81-9f38-ac90db2d60ed admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:25.919469 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1429/2858] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:20:25.924607 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390b8b9-4eeb-4ef1-8828-2e89453cafb7 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:25.935323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f390b8b9-4eeb-4ef1-8828-2e89453cafb7 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:25.941526 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0940e7b-89e9-44ef-bda3-1e5df72da6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:25.943593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940e7b-89e9-44ef-bda3-1e5df72da6cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:25.943593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940e7b-89e9-44ef-bda3-1e5df72da6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:25.943593 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940e7b-89e9-44ef-bda3-1e5df72da6cc admin admin] PATH_INFO: `/v3/projects/845e596521be4a71a897458c1249d9d2/users/7f19aaefb3eb436bb1f59591089dfab4/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:25.959781 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0940e7b-89e9-44ef-bda3-1e5df72da6cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=845e596521be4a71a897458c1249d9d2, user_id=7f19aaefb3eb436bb1f59591089dfab4, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:25.962662 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0940e7b-89e9-44ef-bda3-1e5df72da6cc admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:26.035613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1430/2859] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:20:25 2022] PUT /identity/v3/projects/845e596521be4a71a897458c1249d9d2/users/7f19aaefb3eb436bb1f59591089dfab4/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:26.039587 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27bdb1-69f0-4e81-9f38-ac90db2d60ed admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:26.050606 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27bdb1-69f0-4e81-9f38-ac90db2d60ed admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:26.063925 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:26.109988 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762c048-81fb-400e-84e0-2c3c7ad44149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:26.110671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c048-81fb-400e-84e0-2c3c7ad44149 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:26.110955 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c048-81fb-400e-84e0-2c3c7ad44149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:26.111237 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762c048-81fb-400e-84e0-2c3c7ad44149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:26.112062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762c048-81fb-400e-84e0-2c3c7ad44149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:26.113704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b762c048-81fb-400e-84e0-2c3c7ad44149 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:26.125038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1430/2860] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:20:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:20:26.129429 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0940e7b-89e9-44ef-bda3-1e5df72da6cc admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:26.140231 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0940e7b-89e9-44ef-bda3-1e5df72da6cc admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:26.145080 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e75a6-e67a-4519-af81-b23b88ec4d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:26.145889 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e75a6-e67a-4519-af81-b23b88ec4d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:26.146176 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e75a6-e67a-4519-af81-b23b88ec4d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:26.146456 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e75a6-e67a-4519-af81-b23b88ec4d30 admin admin] PATH_INFO: `/v3/projects/845e596521be4a71a897458c1249d9d2/users/7f19aaefb3eb436bb1f59591089dfab4/roles/0374c5203588439693ac9f7fe25bbe6d` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:26.148547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e75a6-e67a-4519-af81-b23b88ec4d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845e596521be4a71a897458c1249d9d2, user_id=7f19aaefb3eb436bb1f59591089dfab4, role_id=0374c5203588439693ac9f7fe25bbe6d)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:26.151262 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e75a6-e67a-4519-af81-b23b88ec4d30 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:26.162925 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1431/2861] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:20:26 2022] PUT /identity/v3/projects/845e596521be4a71a897458c1249d9d2/users/7f19aaefb3eb436bb1f59591089dfab4/roles/0374c5203588439693ac9f7fe25bbe6d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:20:32.163101 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1d9e7-8819-4980-a4e4-da743ffcf9fe None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:32.163571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1d9e7-8819-4980-a4e4-da743ffcf9fe None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:32.163797 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1d9e7-8819-4980-a4e4-da743ffcf9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:32.196522 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-5ac1d9e7-8819-4980-a4e4-da743ffcf9fe None None] MFA Rules not processed for user `7f19aaefb3eb436bb1f59591089dfab4`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:32.197784 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-5ac1d9e7-8819-4980-a4e4-da743ffcf9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:32.278422 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1431/2862] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:32.293277 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e75a6-e67a-4519-af81-b23b88ec4d30 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:32.295834 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d25e75a6-e67a-4519-af81-b23b88ec4d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:32.387642 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e75a6-e67a-4519-af81-b23b88ec4d30 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:32.392370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca30b-ed63-4078-9a17-042fbd2bb7ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe6832291d504cff9e787c0d791c70ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:32.393181 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca30b-ed63-4078-9a17-042fbd2bb7ba service glance] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:32.393541 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca30b-ed63-4078-9a17-042fbd2bb7ba service glance] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:32.393899 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ca30b-ed63-4078-9a17-042fbd2bb7ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:32.430785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:32.470745 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ca30b-ed63-4078-9a17-042fbd2bb7ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:32.472511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ca30b-ed63-4078-9a17-042fbd2bb7ba service glance] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:32.484697 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1432/2863] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:20:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:20:32.742754 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a46c76-3e1b-45b1-9cac-29138f4f5f56 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:32.743047 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a46c76-3e1b-45b1-9cac-29138f4f5f56 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:32.743330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a46c76-3e1b-45b1-9cac-29138f4f5f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:32.762022 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-f1a46c76-3e1b-45b1-9cac-29138f4f5f56 None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:32.763254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-f1a46c76-3e1b-45b1-9cac-29138f4f5f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:32.825292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1432/2864] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:20:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:32.957523 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca30b-ed63-4078-9a17-042fbd2bb7ba service glance] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:32.959008 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-826ca30b-ed63-4078-9a17-042fbd2bb7ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:33.045514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ca30b-ed63-4078-9a17-042fbd2bb7ba service glance] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:33.051476 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b7bad-4285-45a5-8574-84ea435bd711 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:33.052139 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b7bad-4285-45a5-8574-84ea435bd711 service swift] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:33.052420 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b7bad-4285-45a5-8574-84ea435bd711 service swift] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:33.052696 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b7bad-4285-45a5-8574-84ea435bd711 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:33.062609 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b7bad-4285-45a5-8574-84ea435bd711 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:33.064217 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b7bad-4285-45a5-8574-84ea435bd711 service swift] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:33.074892 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1433/2865] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:20:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:20:38.653472 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf6cc8-f524-42c7-ae37-4d0228a751c5 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:38.653980 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf6cc8-f524-42c7-ae37-4d0228a751c5 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:38.654090 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf6cc8-f524-42c7-ae37-4d0228a751c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:38.675445 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-4abf6cc8-f524-42c7-ae37-4d0228a751c5 None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:38.676693 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-4abf6cc8-f524-42c7-ae37-4d0228a751c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:38.684632 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1433/2866] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:20:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:38.706758 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b7bad-4285-45a5-8574-84ea435bd711 service swift] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:38.719045 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b7bad-4285-45a5-8574-84ea435bd711 service swift] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:38.726458 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1cf1c-9e36-409b-8aec-cc6d9de0207c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:38.727453 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1cf1c-9e36-409b-8aec-cc6d9de0207c service swift] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:38.727806 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1cf1c-9e36-409b-8aec-cc6d9de0207c service swift] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:38.728223 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1cf1c-9e36-409b-8aec-cc6d9de0207c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:38.739631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1cf1c-9e36-409b-8aec-cc6d9de0207c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:38.741873 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1cf1c-9e36-409b-8aec-cc6d9de0207c service swift] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:38.752237 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1434/2867] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:20:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:20:43.972633 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732d105-e9f7-4f11-aea8-a162bae577e0 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:43.973187 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732d105-e9f7-4f11-aea8-a162bae577e0 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:43.973273 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732d105-e9f7-4f11-aea8-a162bae577e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:44.002948 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-9732d105-e9f7-4f11-aea8-a162bae577e0 None None] MFA Rules not processed for user `7a243e2660c74b57825654abc251cdf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:44.004197 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9732d105-e9f7-4f11-aea8-a162bae577e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:44.017809 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1434/2868] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:20:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:47.619106 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ab7d0-8b6a-4495-b8d2-29d7d1c8d6fa None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:47.619671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ab7d0-8b6a-4495-b8d2-29d7d1c8d6fa None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:47.619671 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ab7d0-8b6a-4495-b8d2-29d7d1c8d6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:47.640772 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-752ab7d0-8b6a-4495-b8d2-29d7d1c8d6fa None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:47.642510 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-752ab7d0-8b6a-4495-b8d2-29d7d1c8d6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:47.650514 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1435/2869] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:20:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:47.665264 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732d105-e9f7-4f11-aea8-a162bae577e0 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:47.678851 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732d105-e9f7-4f11-aea8-a162bae577e0 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:47.684130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e5905-d187-45bf-a822-e350955e1446 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:47.684834 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e5905-d187-45bf-a822-e350955e1446 service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:47.685171 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e5905-d187-45bf-a822-e350955e1446 service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:47.685451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e5905-d187-45bf-a822-e350955e1446 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:47.696467 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e5905-d187-45bf-a822-e350955e1446 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:47.698717 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e5905-d187-45bf-a822-e350955e1446 service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:47.710663 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1435/2870] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:20:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:20:57.633979 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=55 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:57.775863 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=93 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:20:57.818424 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa903b-9c60-4738-ab4c-470fa3e43cfe None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:57.818754 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa903b-9c60-4738-ab4c-470fa3e43cfe None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:57.819035 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faa903b-9c60-4738-ab4c-470fa3e43cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:57.845225 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-4faa903b-9c60-4738-ab4c-470fa3e43cfe None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:20:57.847021 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4faa903b-9c60-4738-ab4c-470fa3e43cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:20:57.857273 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1436/2871] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jun 23 13:20:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:20:57.879937 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e5905-d187-45bf-a822-e350955e1446 service swift] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:20:57.897451 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e5905-d187-45bf-a822-e350955e1446 service swift] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:20:57.916423 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dba8a-bbe1-4710-af59-3886ec9e826b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:20:57.917983 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dba8a-bbe1-4710-af59-3886ec9e826b service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:20:57.918452 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dba8a-bbe1-4710-af59-3886ec9e826b service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:20:57.918917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dba8a-bbe1-4710-af59-3886ec9e826b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:20:57.943423 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dba8a-bbe1-4710-af59-3886ec9e826b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:20:57.945425 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dba8a-bbe1-4710-af59-3886ec9e826b service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:20:57.957081 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1436/2872] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:20:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:21:01.286334 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa903b-9c60-4738-ab4c-470fa3e43cfe None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:01.287910 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-4faa903b-9c60-4738-ab4c-470fa3e43cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:01.363808 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faa903b-9c60-4738-ab4c-470fa3e43cfe None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:01.368619 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274c9ad-93cb-40ba-b19f-3040ff17bdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:01.369652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274c9ad-93cb-40ba-b19f-3040ff17bdfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:01.369936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274c9ad-93cb-40ba-b19f-3040ff17bdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:01.370211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274c9ad-93cb-40ba-b19f-3040ff17bdfa admin admin] PATH_INFO: `/v3/users/2e60b51462424cbba5f832c612c65880` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:01.371408 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274c9ad-93cb-40ba-b19f-3040ff17bdfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e60b51462424cbba5f832c612c65880)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:01.374057 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274c9ad-93cb-40ba-b19f-3040ff17bdfa admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:01.549409 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d274c9ad-93cb-40ba-b19f-3040ff17bdfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e60b51462424cbba5f832c612c65880'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:01.565751 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d274c9ad-93cb-40ba-b19f-3040ff17bdfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e60b51462424cbba5f832c612c65880'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:01.702037 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d274c9ad-93cb-40ba-b19f-3040ff17bdfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e60b51462424cbba5f832c612c65880'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:01.702631 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d274c9ad-93cb-40ba-b19f-3040ff17bdfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e60b51462424cbba5f832c612c65880'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:01.703262 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d274c9ad-93cb-40ba-b19f-3040ff17bdfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e60b51462424cbba5f832c612c65880'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:01.716735 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1437/2873] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:21:01 2022] DELETE /identity/v3/users/2e60b51462424cbba5f832c612c65880 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:21:02.006672 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dba8a-bbe1-4710-af59-3886ec9e826b service swift] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:02.030554 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dba8a-bbe1-4710-af59-3886ec9e826b service swift] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:02.111424 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:02.112320 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:02.112662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:02.112975 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770 admin admin] PATH_INFO: `/v3/projects/8dabf656a1614689a4796e08e544e29f` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:02.116765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dabf656a1614689a4796e08e544e29f)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:02.116765 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:02.269281 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dabf656a1614689a4796e08e544e29f', 'request_id': 'req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:02.359986 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dabf656a1614689a4796e08e544e29f', 'request_id': 'req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:02.367062 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dabf656a1614689a4796e08e544e29f', 'request_id': 'req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:02.378722 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770 admin admin] The token cache is being invalidate because project 8dabf656a1614689a4796e08e544e29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:21:02.385881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:02.385881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-41e0ec00-7688-4e2f-89c3-fc2f3dd9d770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:02.385881 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1437/2874] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:21:02 2022] DELETE /identity/v3/projects/8dabf656a1614689a4796e08e544e29f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:21:02.386202 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa7c76-1ee5-4647-b460-fd58609ed01d None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:02.386674 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa7c76-1ee5-4647-b460-fd58609ed01d None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:02.386786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa7c76-1ee5-4647-b460-fd58609ed01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:02.406988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-f6aa7c76-1ee5-4647-b460-fd58609ed01d None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:21:02.408195 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-f6aa7c76-1ee5-4647-b460-fd58609ed01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:02.469861 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1438/2875] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:21:02.478786 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea06c7-0955-43c8-a147-3862561efe92 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:02.479077 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea06c7-0955-43c8-a147-3862561efe92 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:02.479361 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea06c7-0955-43c8-a147-3862561efe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:02.500639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-dfea06c7-0955-43c8-a147-3862561efe92 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:21:02.500639 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-dfea06c7-0955-43c8-a147-3862561efe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:02.508825 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1438/2876] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 13:21:02.513103 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa7c76-1ee5-4647-b460-fd58609ed01d None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:02.523249 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa7c76-1ee5-4647-b460-fd58609ed01d None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:02.527984 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802ac24-e40f-4f4e-ae78-d52f4b8cc6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:02.529727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802ac24-e40f-4f4e-ae78-d52f4b8cc6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:02.529727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802ac24-e40f-4f4e-ae78-d52f4b8cc6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:02.529727 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802ac24-e40f-4f4e-ae78-d52f4b8cc6b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:02.530240 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802ac24-e40f-4f4e-ae78-d52f4b8cc6b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80298) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 13:21:02.530559 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802ac24-e40f-4f4e-ae78-d52f4b8cc6b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:02.532190 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802ac24-e40f-4f4e-ae78-d52f4b8cc6b9 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:02.540679 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:21:02.543922 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1439/2877] 10.222.0.16 () {58 vars in 1152 bytes} [Thu Jun 23 13:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 13:21:02.548711 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea06c7-0955-43c8-a147-3862561efe92 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:02.557982 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea06c7-0955-43c8-a147-3862561efe92 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:02.563800 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7712bc-1056-49d6-9cc2-0a10d59eb553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:02.564531 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7712bc-1056-49d6-9cc2-0a10d59eb553 admin admin] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:02.564826 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7712bc-1056-49d6-9cc2-0a10d59eb553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:02.565126 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7712bc-1056-49d6-9cc2-0a10d59eb553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:02.565880 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7712bc-1056-49d6-9cc2-0a10d59eb553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:02.567828 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7712bc-1056-49d6-9cc2-0a10d59eb553 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:02.657782 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1439/2878] 10.222.0.16 () {60 vars in 1152 bytes} [Thu Jun 23 13:21:02 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:21:02.662317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802ac24-e40f-4f4e-ae78-d52f4b8cc6b9 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:02.673785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802ac24-e40f-4f4e-ae78-d52f4b8cc6b9 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:02.731435 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a99bc-7b06-4f52-b49b-91ee85ab274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:02.732110 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a99bc-7b06-4f52-b49b-91ee85ab274c admin admin] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:02.732393 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a99bc-7b06-4f52-b49b-91ee85ab274c admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:02.733603 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a99bc-7b06-4f52-b49b-91ee85ab274c admin admin] PATH_INFO: `/v3/users` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:02.734322 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a99bc-7b06-4f52-b49b-91ee85ab274c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:02.736317 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a99bc-7b06-4f52-b49b-91ee85ab274c admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:02.834714 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1440/2879] 10.222.0.16 () {60 vars in 1143 bytes} [Thu Jun 23 13:21:02 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 13:21:02.839014 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7712bc-1056-49d6-9cc2-0a10d59eb553 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:02.850159 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7712bc-1056-49d6-9cc2-0a10d59eb553 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:02.854801 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0010821-4cd7-4661-a54d-83e761ff8f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:02.855489 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0010821-4cd7-4661-a54d-83e761ff8f27 admin admin] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:02.855777 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0010821-4cd7-4661-a54d-83e761ff8f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:02.856056 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0010821-4cd7-4661-a54d-83e761ff8f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:02.856792 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0010821-4cd7-4661-a54d-83e761ff8f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:02.859330 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0010821-4cd7-4661-a54d-83e761ff8f27 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:02.870250 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1440/2880] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:21:02.874473 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a99bc-7b06-4f52-b49b-91ee85ab274c admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:02.884613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a99bc-7b06-4f52-b49b-91ee85ab274c admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:02.889437 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e31a0-af2a-4fe1-83fe-04bf449c3490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:02.890083 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e31a0-af2a-4fe1-83fe-04bf449c3490 admin admin] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:02.890370 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e31a0-af2a-4fe1-83fe-04bf449c3490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:02.890652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e31a0-af2a-4fe1-83fe-04bf449c3490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:02.891389 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e31a0-af2a-4fe1-83fe-04bf449c3490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:02.893039 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e31a0-af2a-4fe1-83fe-04bf449c3490 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:02.903042 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1441/2881] 10.222.0.16 () {58 vars in 1121 bytes} [Thu Jun 23 13:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 13:21:02.907926 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0010821-4cd7-4661-a54d-83e761ff8f27 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:02.918267 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0010821-4cd7-4661-a54d-83e761ff8f27 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:02.924537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b9d28-3998-4741-a3cd-eb3a07a0a98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:02.925474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b9d28-3998-4741-a3cd-eb3a07a0a98a admin admin] REQUEST_METHOD: `PUT` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:02.925759 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b9d28-3998-4741-a3cd-eb3a07a0a98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:02.926038 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b9d28-3998-4741-a3cd-eb3a07a0a98a admin admin] PATH_INFO: `/v3/projects/e6bc1591197a4646a84a1f4cc712071a/users/aaeb4b7342a14f598907df48983cf945/roles/3d2f155e5f1f4acbaff64a9c464d9d92` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:02.940904 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b9d28-3998-4741-a3cd-eb3a07a0a98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6bc1591197a4646a84a1f4cc712071a, user_id=aaeb4b7342a14f598907df48983cf945, role_id=3d2f155e5f1f4acbaff64a9c464d9d92)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:02.943589 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b9d28-3998-4741-a3cd-eb3a07a0a98a admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:03.102649 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1441/2882] 10.222.0.16 () {60 vars in 1482 bytes} [Thu Jun 23 13:21:02 2022] PUT /identity/v3/projects/e6bc1591197a4646a84a1f4cc712071a/users/aaeb4b7342a14f598907df48983cf945/roles/3d2f155e5f1f4acbaff64a9c464d9d92 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 13:21:03.113093 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5077c04-1de9-45f6-b3b8-fb6861d89d67 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:03.113401 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5077c04-1de9-45f6-b3b8-fb6861d89d67 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:03.113685 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5077c04-1de9-45f6-b3b8-fb6861d89d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:03.151909 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-a5077c04-1de9-45f6-b3b8-fb6861d89d67 None None] MFA Rules not processed for user `aaeb4b7342a14f598907df48983cf945`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:21:03.156832 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-a5077c04-1de9-45f6-b3b8-fb6861d89d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:03.235467 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1442/2883] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:21:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:21:03.246920 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b9d28-3998-4741-a3cd-eb3a07a0a98a admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:03.248727 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-d11b9d28-3998-4741-a3cd-eb3a07a0a98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:03.265456 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:21:03.317200 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b9d28-3998-4741-a3cd-eb3a07a0a98a admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:03.321168 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae37178-a66a-49d3-aad5-266c8e75d209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:03.321847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae37178-a66a-49d3-aad5-266c8e75d209 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:03.322135 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae37178-a66a-49d3-aad5-266c8e75d209 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:03.322416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae37178-a66a-49d3-aad5-266c8e75d209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:03.334903 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae37178-a66a-49d3-aad5-266c8e75d209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:03.336341 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae37178-a66a-49d3-aad5-266c8e75d209 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:03.347917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1442/2884] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:21:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:21:05.114431 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909d0d0-b6ea-4745-803e-4dcd098c0005 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:05.114960 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909d0d0-b6ea-4745-803e-4dcd098c0005 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:05.115085 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909d0d0-b6ea-4745-803e-4dcd098c0005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:05.134221 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d909d0d0-b6ea-4745-803e-4dcd098c0005 None None] MFA Rules not processed for user `aaeb4b7342a14f598907df48983cf945`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:21:05.135547 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d909d0d0-b6ea-4745-803e-4dcd098c0005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:05.147765 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1443/2885] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:21:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:21:12.812130 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae37178-a66a-49d3-aad5-266c8e75d209 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:12.813877 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-fae37178-a66a-49d3-aad5-266c8e75d209 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:12.890349 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae37178-a66a-49d3-aad5-266c8e75d209 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:12.895162 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:12.896040 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:12.896319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:12.896622 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] PATH_INFO: `/v3/users/ebeab772bc3a42608af8215ee8264d5b` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:12.897857 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebeab772bc3a42608af8215ee8264d5b)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:12.899758 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:13.098798 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebeab772bc3a42608af8215ee8264d5b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:13.111327 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebeab772bc3a42608af8215ee8264d5b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:13.182110 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebeab772bc3a42608af8215ee8264d5b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:13.182742 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebeab772bc3a42608af8215ee8264d5b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:13.183403 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebeab772bc3a42608af8215ee8264d5b'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:13.196193 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1443/2886] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:21:12 2022] DELETE /identity/v3/users/ebeab772bc3a42608af8215ee8264d5b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:21:13.446613 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909d0d0-b6ea-4745-803e-4dcd098c0005 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:13.459388 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909d0d0-b6ea-4745-803e-4dcd098c0005 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:13.517102 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:13.517968 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:13.518252 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:13.518527 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] PATH_INFO: `/v3/projects/744f6f94c38a43cdb86f936500bd0188` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:13.519725 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=744f6f94c38a43cdb86f936500bd0188)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:13.521738 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:13.524021 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:21:13.641400 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '744f6f94c38a43cdb86f936500bd0188', 'request_id': 'req-76ae3840-dcec-4fa3-b095-b1dbe3f63202'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:13.736013 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '744f6f94c38a43cdb86f936500bd0188', 'request_id': 'req-76ae3840-dcec-4fa3-b095-b1dbe3f63202'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:13.743402 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '744f6f94c38a43cdb86f936500bd0188', 'request_id': 'req-76ae3840-dcec-4fa3-b095-b1dbe3f63202'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:13.754553 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] The token cache is being invalidate because project 744f6f94c38a43cdb86f936500bd0188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80298) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:21:13.754845 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:13.755501 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:13.757075 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1444/2887] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:21:13 2022] DELETE /identity/v3/projects/744f6f94c38a43cdb86f936500bd0188 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:21:13.761001 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:13.762571 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:13.776885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00045c10-10ce-4596-a5dc-cf1be45eb467 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:13.814561 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:21:13.838911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:13.839803 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:13.840092 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:13.840378 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] PATH_INFO: `/v3/users/25de631f900b4446bec0949363418938` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:13.842170 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] RBAC: Authorizing `identity:delete_user(user_id=25de631f900b4446bec0949363418938)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:13.844086 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:14.045434 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25de631f900b4446bec0949363418938'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:14.072657 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25de631f900b4446bec0949363418938'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:14.146876 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25de631f900b4446bec0949363418938'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:14.147524 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25de631f900b4446bec0949363418938'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:14.148134 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25de631f900b4446bec0949363418938'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:14.164174 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1444/2888] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:21:13 2022] DELETE /identity/v3/users/25de631f900b4446bec0949363418938 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:21:14.402459 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:14.403988 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:14.462308 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae3840-dcec-4fa3-b095-b1dbe3f63202 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:14.492185 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:14.493607 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:14.518511 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4671422-4562-4f4f-978f-0e7d3dd01187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:14.519480 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4671422-4562-4f4f-978f-0e7d3dd01187 service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:14.519785 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4671422-4562-4f4f-978f-0e7d3dd01187 service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:14.520063 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4671422-4562-4f4f-978f-0e7d3dd01187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:14.522569 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-e4671422-4562-4f4f-978f-0e7d3dd01187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:14.563385 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4f790-3689-4ff5-b8d8-aaf1fe5ee08d admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:14.567954 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:14.568917 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:14.569164 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:14.569447 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] PATH_INFO: `/v3/projects/1b41e9e5b5ec45a2bbf9f1838300d516` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:14.570650 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b41e9e5b5ec45a2bbf9f1838300d516)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:14.573254 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:14.590447 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4671422-4562-4f4f-978f-0e7d3dd01187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:14.592086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4671422-4562-4f4f-978f-0e7d3dd01187 service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:14.596201 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:21:14.602597 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1445/2889] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:21:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:21:14.697034 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b41e9e5b5ec45a2bbf9f1838300d516', 'request_id': 'req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:14.765551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b41e9e5b5ec45a2bbf9f1838300d516', 'request_id': 'req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:14.767089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:21:14.773046 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b41e9e5b5ec45a2bbf9f1838300d516', 'request_id': 'req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:14.784388 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] The token cache is being invalidate because project 1b41e9e5b5ec45a2bbf9f1838300d516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:21:14.784698 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:14.785473 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:14.787031 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1445/2890] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:21:14 2022] DELETE /identity/v3/projects/1b41e9e5b5ec45a2bbf9f1838300d516 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:21:24.410352 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87904f3e-44c7-4887-8d77-26bcd4897ab5 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:24.410857 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87904f3e-44c7-4887-8d77-26bcd4897ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:24.410954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87904f3e-44c7-4887-8d77-26bcd4897ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:24.428726 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-87904f3e-44c7-4887-8d77-26bcd4897ab5 None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:21:24.429952 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-87904f3e-44c7-4887-8d77-26bcd4897ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:24.484444 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1446/2891] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:21:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:21:24.496063 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:24.497502 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:24.566073 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077cb5d-9913-48ff-84ed-b1bacc6f33ea admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:24.571671 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a297471-3ad8-4a98-816c-8f8a3507ad22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:24.572337 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a297471-3ad8-4a98-816c-8f8a3507ad22 service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:24.572621 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a297471-3ad8-4a98-816c-8f8a3507ad22 service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:24.572935 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a297471-3ad8-4a98-816c-8f8a3507ad22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:24.582293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a297471-3ad8-4a98-816c-8f8a3507ad22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:24.583885 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a297471-3ad8-4a98-816c-8f8a3507ad22 service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:24.592055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1446/2892] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:21:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:21:25.588281 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648c17f-797d-4e81-80ab-3b8d0883104f None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:25.588793 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648c17f-797d-4e81-80ab-3b8d0883104f None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:25.588908 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648c17f-797d-4e81-80ab-3b8d0883104f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:25.607077 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-d648c17f-797d-4e81-80ab-3b8d0883104f None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:21:25.611304 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d648c17f-797d-4e81-80ab-3b8d0883104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:25.615941 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1447/2893] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jun 23 13:21:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:21:25.628165 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a297471-3ad8-4a98-816c-8f8a3507ad22 service swift] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:25.640405 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a297471-3ad8-4a98-816c-8f8a3507ad22 service swift] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:25.646272 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6d104-162f-442e-a91c-2f4d0ce9302c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:25.647055 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6d104-162f-442e-a91c-2f4d0ce9302c service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:25.647338 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6d104-162f-442e-a91c-2f4d0ce9302c service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:25.647615 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6d104-162f-442e-a91c-2f4d0ce9302c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:25.655815 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6d104-162f-442e-a91c-2f4d0ce9302c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:25.657499 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6d104-162f-442e-a91c-2f4d0ce9302c service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:25.666274 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1447/2894] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:21:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 13:21:26.168648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7135e-5538-42a1-8b3b-eba8cb78f0c3 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:26.168978 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7135e-5538-42a1-8b3b-eba8cb78f0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:26.169263 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7135e-5538-42a1-8b3b-eba8cb78f0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:26.188205 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-13b7135e-5538-42a1-8b3b-eba8cb78f0c3 None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:21:26.190116 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-13b7135e-5538-42a1-8b3b-eba8cb78f0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:26.197358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1448/2895] 10.222.0.16 () {58 vars in 1009 bytes} [Thu Jun 23 13:21:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:21:26.209660 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6d104-162f-442e-a91c-2f4d0ce9302c service swift] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:26.220360 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6d104-162f-442e-a91c-2f4d0ce9302c service swift] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:26.225551 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e38ea-a51a-420d-af02-ee8f1fb7d3c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:26.226181 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e38ea-a51a-420d-af02-ee8f1fb7d3c4 service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:26.226537 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e38ea-a51a-420d-af02-ee8f1fb7d3c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:26.226810 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e38ea-a51a-420d-af02-ee8f1fb7d3c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:26.234919 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e38ea-a51a-420d-af02-ee8f1fb7d3c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:26.237203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e38ea-a51a-420d-af02-ee8f1fb7d3c4 service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:26.245189 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1448/2896] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:21:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:21:26.831323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2af47-fe77-414e-b98f-c6d96abef947 None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:26.834954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2af47-fe77-414e-b98f-c6d96abef947 None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:26.834954 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2af47-fe77-414e-b98f-c6d96abef947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:26.850456 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-cab2af47-fe77-414e-b98f-c6d96abef947 None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:21:26.851656 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cab2af47-fe77-414e-b98f-c6d96abef947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:26.858896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1449/2897] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jun 23 13:21:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:21:26.872536 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e38ea-a51a-420d-af02-ee8f1fb7d3c4 service swift] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:26.884252 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e38ea-a51a-420d-af02-ee8f1fb7d3c4 service swift] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:26.889302 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e665a794-849f-4549-8adb-d2af61853dd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:26.889934 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665a794-849f-4549-8adb-d2af61853dd7 service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:26.890213 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665a794-849f-4549-8adb-d2af61853dd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:26.890486 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e665a794-849f-4549-8adb-d2af61853dd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:26.899709 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665a794-849f-4549-8adb-d2af61853dd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:26.901308 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e665a794-849f-4549-8adb-d2af61853dd7 service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:26.910198 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1449/2898] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:21:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:21:29.492212 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2af47-fe77-414e-b98f-c6d96abef947 None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:29.493693 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-cab2af47-fe77-414e-b98f-c6d96abef947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:29.557747 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2af47-fe77-414e-b98f-c6d96abef947 None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:29.562220 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:29.563086 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:29.563374 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:29.563648 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] PATH_INFO: `/v3/users/aaeb4b7342a14f598907df48983cf945` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:29.564884 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaeb4b7342a14f598907df48983cf945)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:29.566786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:29.731815 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaeb4b7342a14f598907df48983cf945'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:29.743587 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaeb4b7342a14f598907df48983cf945'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:29.838741 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaeb4b7342a14f598907df48983cf945'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:29.839391 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaeb4b7342a14f598907df48983cf945'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:29.840005 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaeb4b7342a14f598907df48983cf945'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:29.853706 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1450/2899] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:21:29 2022] DELETE /identity/v3/users/aaeb4b7342a14f598907df48983cf945 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:21:29.858229 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4f554-06fc-4b69-8a5f-130909ed6169 None None] REQUEST_METHOD: `POST` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:29.858721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4f554-06fc-4b69-8a5f-130909ed6169 None None] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:29.858865 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4f554-06fc-4b69-8a5f-130909ed6169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:29.881285 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.auth.core [None req-44b4f554-06fc-4b69-8a5f-130909ed6169 None None] MFA Rules not processed for user `9a24de1c35d841e4a22851782428ca15`. Rule list: `[]` (Enabled: `True`). {{(pid=80299) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:21:29.882493 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-44b4f554-06fc-4b69-8a5f-130909ed6169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:29.940381 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1450/2900] 10.222.0.16 () {58 vars in 957 bytes} [Thu Jun 23 13:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:21:29.949945 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:29.951335 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:29.957366 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:21:30.010469 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4547795-35a3-4523-9a89-0114e717d296 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:30.014515 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ba9a7-8225-423c-9020-9f127803cc4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:30.015211 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ba9a7-8225-423c-9020-9f127803cc4d service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:30.015606 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ba9a7-8225-423c-9020-9f127803cc4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:30.016293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ba9a7-8225-423c-9020-9f127803cc4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:30.026413 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ba9a7-8225-423c-9020-9f127803cc4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:30.027847 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ba9a7-8225-423c-9020-9f127803cc4d service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:30.037807 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1451/2901] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:21:30.263911 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4f554-06fc-4b69-8a5f-130909ed6169 None None] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:21:30.264915 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-44b4f554-06fc-4b69-8a5f-130909ed6169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:21:30.278138 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4f554-06fc-4b69-8a5f-130909ed6169 None None] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:21:30.283182 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:21:30.284049 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:21:30.284335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:21:30.284612 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] PATH_INFO: `/v3/projects/e6bc1591197a4646a84a1f4cc712071a` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:21:30.285847 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6bc1591197a4646a84a1f4cc712071a)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:21:30.287759 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:21:30.381685 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:21:30.396293 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6bc1591197a4646a84a1f4cc712071a', 'request_id': 'req-02bd20c9-6eac-4326-a6bf-0df71747cb06'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:30.473718 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6bc1591197a4646a84a1f4cc712071a', 'request_id': 'req-02bd20c9-6eac-4326-a6bf-0df71747cb06'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:30.480923 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6bc1591197a4646a84a1f4cc712071a', 'request_id': 'req-02bd20c9-6eac-4326-a6bf-0df71747cb06'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:30.492124 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] The token cache is being invalidate because project e6bc1591197a4646a84a1f4cc712071a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:21:30.492417 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:30.493089 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:21:30.494676 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1451/2902] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:21:30 2022] DELETE /identity/v3/projects/e6bc1591197a4646a84a1f4cc712071a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:21:40.061949 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=25 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:21:40.519335 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=13,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:22:30.066863 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ba9a7-8225-423c-9020-9f127803cc4d service neutron] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:30.072148 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-090ba9a7-8225-423c-9020-9f127803cc4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:30.079932 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ba9a7-8225-423c-9020-9f127803cc4d service neutron] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:30.129432 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4eeb60-5984-44e8-b9ee-ac227770a7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83858713769b41af800bab317602bf2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:30.129990 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4eeb60-5984-44e8-b9ee-ac227770a7ca service neutron] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:30.130272 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4eeb60-5984-44e8-b9ee-ac227770a7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:30.130548 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4eeb60-5984-44e8-b9ee-ac227770a7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:30.132309 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-3f4eeb60-5984-44e8-b9ee-ac227770a7ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:30.207970 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4eeb60-5984-44e8-b9ee-ac227770a7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:30.209456 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4eeb60-5984-44e8-b9ee-ac227770a7ca service neutron] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:30.221293 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1452/2903] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:22:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:22:33.430136 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:33.432041 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:33.489897 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd20c9-6eac-4326-a6bf-0df71747cb06 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:33.493817 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2c70f-e4c6-4cde-8f2d-62552a939b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75e6ac80e76b41e4976f5a10daad85d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:33.495523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2c70f-e4c6-4cde-8f2d-62552a939b50 service cinder] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:33.495523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2c70f-e4c6-4cde-8f2d-62552a939b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:33.495523 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2c70f-e4c6-4cde-8f2d-62552a939b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:33.496778 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-84e2c70f-e4c6-4cde-8f2d-62552a939b50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:33.510670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2c70f-e4c6-4cde-8f2d-62552a939b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:33.512083 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2c70f-e4c6-4cde-8f2d-62552a939b50 service cinder] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:33.522880 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1452/2904] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:22:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 13:22:39.923850 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb004883-caef-455a-b714-fff86c72762a None None] REQUEST_METHOD: `POST` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:39.924296 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb004883-caef-455a-b714-fff86c72762a None None] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:39.924399 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb004883-caef-455a-b714-fff86c72762a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:39.942438 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.auth.core [None req-eb004883-caef-455a-b714-fff86c72762a None None] MFA Rules not processed for user `6af4358779f947acade2ed0293893b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80298) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 13:22:39.943621 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-eb004883-caef-455a-b714-fff86c72762a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:39.998691 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1453/2905] 10.222.0.16 () {58 vars in 967 bytes} [Thu Jun 23 13:22:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 13:22:40.132475 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2c70f-e4c6-4cde-8f2d-62552a939b50 service cinder] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:40.134514 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-84e2c70f-e4c6-4cde-8f2d-62552a939b50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:40.203652 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2c70f-e4c6-4cde-8f2d-62552a939b50 service cinder] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:40.208721 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b3424-e622-416c-919a-76f9f4829df1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '599a53720ecd4e729a6720a85b653eb0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:40.209411 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b3424-e622-416c-919a-76f9f4829df1 service swift] REQUEST_METHOD: `GET` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:40.209704 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b3424-e622-416c-919a-76f9f4829df1 service swift] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:40.209987 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b3424-e622-416c-919a-76f9f4829df1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:40.218670 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b3424-e622-416c-919a-76f9f4829df1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:40.220292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b3424-e622-416c-919a-76f9f4829df1 service swift] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:40.230002 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1453/2906] 10.222.0.16 () {60 vars in 1384 bytes} [Thu Jun 23 13:22:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 13:22:48.454502 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb004883-caef-455a-b714-fff86c72762a None None] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:48.455924 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-eb004883-caef-455a-b714-fff86c72762a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:48.505761 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=100 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:22:48.523575 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb004883-caef-455a-b714-fff86c72762a None None] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:48.531100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:48.531100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:48.531100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:48.531100 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] PATH_INFO: `/v3/users/7a243e2660c74b57825654abc251cdf9` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:48.532554 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a243e2660c74b57825654abc251cdf9)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:48.534598 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:48.721898 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a243e2660c74b57825654abc251cdf9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:48.733936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a243e2660c74b57825654abc251cdf9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:48.820188 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a243e2660c74b57825654abc251cdf9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:48.820737 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a243e2660c74b57825654abc251cdf9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:48.821375 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a243e2660c74b57825654abc251cdf9'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:48.834554 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1454/2907] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:22:48 2022] DELETE /identity/v3/users/7a243e2660c74b57825654abc251cdf9 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:22:49.154784 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b3424-e622-416c-919a-76f9f4829df1 service swift] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:49.164623 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b3424-e622-416c-919a-76f9f4829df1 service swift] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:49.227010 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:49.228827 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:49.229257 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:49.229662 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] PATH_INFO: `/v3/projects/53b3a1d657d94275a460f02fc4e91b08` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:49.231387 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b3a1d657d94275a460f02fc4e91b08)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:49.234389 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:49.365653 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:22:49.375845 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b3a1d657d94275a460f02fc4e91b08', 'request_id': 'req-3f48759d-866e-4ad2-9bea-02dd0fd4e681'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:49.454645 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b3a1d657d94275a460f02fc4e91b08', 'request_id': 'req-3f48759d-866e-4ad2-9bea-02dd0fd4e681'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:49.461203 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b3a1d657d94275a460f02fc4e91b08', 'request_id': 'req-3f48759d-866e-4ad2-9bea-02dd0fd4e681'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:49.471956 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] The token cache is being invalidate because project 53b3a1d657d94275a460f02fc4e91b08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:22:49.472237 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:49.472900 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:49.474436 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1454/2908] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:22:49 2022] DELETE /identity/v3/projects/53b3a1d657d94275a460f02fc4e91b08 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:22:49.479349 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:49.481206 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:49.493817 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba78391-4054-49ba-ac5f-af7be9dcbe84 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:49.550786 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:49.551652 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:49.551936 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:49.552213 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] PATH_INFO: `/v3/users/7f19aaefb3eb436bb1f59591089dfab4` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:49.553421 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f19aaefb3eb436bb1f59591089dfab4)` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:49.555358 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:49.771059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f19aaefb3eb436bb1f59591089dfab4'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:49.783986 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f19aaefb3eb436bb1f59591089dfab4'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:49.786538 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:22:49.905070 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f19aaefb3eb436bb1f59591089dfab4'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:49.906040 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f19aaefb3eb436bb1f59591089dfab4'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:49.906724 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.notifications [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f19aaefb3eb436bb1f59591089dfab4'} {{(pid=80298) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:49.920323 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1455/2909] 10.222.0.16 () {58 vars in 1223 bytes} [Thu Jun 23 13:22:49 2022] DELETE /identity/v3/users/7f19aaefb3eb436bb1f59591089dfab4 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:22:50.153760 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] Authenticating user token {{(pid=80299) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:22:50.155630 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.fernet_utils [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80299) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:22:50.175416 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48759d-866e-4ad2-9bea-02dd0fd4e681 admin admin] Validating token access rules against request {{(pid=80299) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:22:50.227656 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a24de1c35d841e4a22851782428ca15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1fdf0ec9cffa45efa95f679088c42ed8', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80299) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:22:50.228673 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:22:50.229007 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:22:50.229292 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77 admin admin] PATH_INFO: `/v3/projects/845e596521be4a71a897458c1249d9d2` {{(pid=80299) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:22:50.230496 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=845e596521be4a71a897458c1249d9d2)` {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:22:50.232474 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77 admin admin] RBAC: Authorization granted {{(pid=80299) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:22:50.313420 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845e596521be4a71a897458c1249d9d2', 'request_id': 'req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:50.374044 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845e596521be4a71a897458c1249d9d2', 'request_id': 'req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:50.380351 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845e596521be4a71a897458c1249d9d2', 'request_id': 'req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77'} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:50.391380 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77 admin admin] The token cache is being invalidate because project 845e596521be4a71a897458c1249d9d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80299) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 13:22:50.391663 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:50.392290 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG keystone.notifications [None req-6c857bf8-69c0-4ec2-8629-d69a61a1ad77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80299) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 13:22:50.393862 dv-cinder-847335-1-smb devstack@keystone.service[80299]: [pid: 80299|app: 0|req: 1455/2910] 10.222.0.16 () {58 vars in 1232 bytes} [Thu Jun 23 13:22:50 2022] DELETE /identity/v3/projects/845e596521be4a71a897458c1249d9d2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 13:22:59.962839 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:DELETE=1,keystone:SELECT=6 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:23:00.388319 dv-cinder-847335-1-smb devstack@keystone.service[80299]: DEBUG dbcounter [-] [80299] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=80299) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 13:25:11.958655 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] Authenticating user token {{(pid=80298) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 13:25:11.960059 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:12.225535 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7a951-0257-41d5-ab5a-407fd8a4ad82 admin admin] Validating token access rules against request {{(pid=80298) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 13:25:12.283907 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac6667-7d3c-421d-95b0-4e90e19a6fd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69b5745bfb5d4e6ca172bb8fab229e58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '66de76d7ea7a45a6b698f8b1295c66c3', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80298) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 13:25:12.284556 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac6667-7d3c-421d-95b0-4e90e19a6fd0 service placement] REQUEST_METHOD: `GET` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 13:25:12.284896 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac6667-7d3c-421d-95b0-4e90e19a6fd0 service placement] SCRIPT_NAME: `/identity` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 13:25:12.285246 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac6667-7d3c-421d-95b0-4e90e19a6fd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80298) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 13:25:12.287010 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.fernet_utils [None req-dcac6667-7d3c-421d-95b0-4e90e19a6fd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80298) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 13:25:12.298136 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac6667-7d3c-421d-95b0-4e90e19a6fd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 13:25:12.299711 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac6667-7d3c-421d-95b0-4e90e19a6fd0 service placement] RBAC: Authorization granted {{(pid=80298) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 13:25:12.310193 dv-cinder-847335-1-smb devstack@keystone.service[80298]: [pid: 80298|app: 0|req: 1456/2911] 10.222.0.16 () {60 vars in 1365 bytes} [Thu Jun 23 13:25:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 13:25:22.305961 dv-cinder-847335-1-smb devstack@keystone.service[80298]: DEBUG dbcounter [-] [80298] Writing DB stats keystone:SELECT=89 {{(pid=80298) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}